http://forums.visokio.com/discussions/tagged/data_sources/feed.rss Mon, 30 Oct 17 12:25:20 -0400 Tagged with data_sources - Visokio Forums en-CA http://forums.visokio.com/discussion/3250/data-discordance-caused-by-google-analytics-api Fri, 16 Jun 2017 04:57:49 -0400 CarenaLi 3250@/discussions
Thanks for reading this and hope you are well.

Recently we have experienced data discordance between the numbers pulled through Omniscope and the actual ones showing on Google Analytics.

Does anyone have the same issue?

Many thanks!]]> http://forums.visokio.com/discussion/3248/data-sources-bigquery-connector-in-and-out Fri, 09 Jun 2017 05:30:45 -0400 costart 3248@/discussions I often use omniscope to help build my reports but I am often using Bigquery to store my data. Be great to add it in.

Cheers,
Robert]]> http://forums.visokio.com/discussion/2849/refresh-controlling-upstream-refreshes-when-joining-many-filess Wed, 18 Feb 2015 11:31:28 -0500 benjamin 2849@/discussions
I have a series of DataManager blocks and at near the end of the series i am joining various streams of blocks together by a merge

Whenever i update the merge (either by changing the join criteria, adding fields etc) the whole upstream data gets refreshed in all the other blocks.

Is there any way to stop this, i do not want it to refresh data when nothing has changed, I just want to update with my new fields in the join criteria

Thanks]]> http://forums.visokio.com/discussion/2911/sources-initiating-a-ping-and-getting-the-results Wed, 22 Apr 2015 04:25:46 -0400 sherriff 2911@/discussions http://forums.visokio.com/discussion/2854/import-connected-data-sources-moveds Wed, 25 Feb 2015 10:40:09 -0500 rng 2854@/discussions http://forums.visokio.com/discussion/1685

Error Message: "The external data source DataManager is not available. Make sure that the file has not been renamed, moved, or deleted. Check your network connection is working."

Any thoughts? Thanks in advance

-Rohan]]> http://forums.visokio.com/discussion/2834/sources-kdb-database Fri, 30 Jan 2015 12:15:14 -0500 chris 2834@/discussions
Some of our clients have asked whether Omniscope supports reading/writing data to KDB+ (see http://kx.com/software.php).

KDB is not currently on our list of supported databases, however it is still possible to connect and pull in data in Omniscope, here's how:

1. Start KDB, specifying the port we want the webserver to listen on, for example on windows to start KDB on port 5000:

q -p 5000

2. Download the KDBC JDBC driver. This can be downloaded from:

http://kx.com/q/c/jdbc.jar

3. Open Omniscope, drag in a "Database table" block from the sources.

4. In "Select database" choose "JDBC (Advanced)".

5. In "Driver jar path" select the JDBC driver downloaded in step 2.

6. In "Driver class:" enter "jdbc".

7. In "JDBC URL" enter "jdbc:q:localhost:5000". If we are running KDB on a different port change the url.

8. Enter the username/password (if configured).

9 Click the "Connect" button. You should now be able to select a table and download the data, incorporating it into your DataManager workflow.

I've attached a screenshot with a configuration I was successfully able to use to connect and download 1 million records into Omniscope. This runs in a few seconds with the sample data I tested.

In the next few days we intend to add "KDB" to the list of supported databases, so you can use this instead of having to select the "JDBC (Advanced)" option. I'll post back once this has been implemented.

In the meantime please let us know if you encounter any problems using the method described above.

Chris
]]> http://forums.visokio.com/discussion/2221/idea-sources-json-filess Tue, 02 Jul 2013 08:04:43 -0400 ChloeWalton 2221@/discussions http://forums.visokio.com/discussion/2490/new-sources-mongodb-database-connector Mon, 10 Mar 2014 07:22:35 -0400 bfromson1 2490@/discussions
Would be useful if Omniscope could hook directly to the data stored in MongoDB repositories...

Anyone else interested?

https://www.mongodb.org/]]> http://forums.visokio.com/discussion/2483/sources-ftp-with-changing-file-namess Fri, 28 Feb 2014 10:01:21 -0500 ChristianGroupM 2483@/discussions
I would like to use the FTP Data Source block to import my reports to Omniscope, but what to do when the target data file name is post-pended every day with a changing date?

For example:
repot_14586_02262014
repot_14586_02272014
repot_14586_02282014

How can I parameterise the source connection block so that I import only the newest version of the report into Omniscope automatically?

Best Regards, Christian]]> http://forums.visokio.com/discussion/2641/idea-sources-free-form-tablesarrayss Tue, 08 Jul 2014 07:17:49 -0400 daniel 2641@/discussions
For example, one could define the number of columns and rows and populate an empty table matrix of cells, which you can then fill in with values within the DataManager.

The idea is to actually reduce having to create separate lookup Excel/csv files and to have a way to do a free-text table all within the DataManager space. This will also make moving the IOK file around easier as it will have fewer external file dependencies if we can embed all the data (and not just a 10-record snapshot) within the DM space within the IOK file itself. ]]> http://forums.visokio.com/discussion/2504/sources-excel-decimals-imported-as-integers-using-excel-readers Thu, 27 Mar 2014 08:04:09 -0400 Alexander 2504@/discussions
I am encoutering a bug in Omniscope. My source is a group of .xls files. In the configuration of the "Group Import" I have chosen the Omniscope reader option, as there is no Office installed on our server.

In the Excel files there are decimals, but Excel shows them as integers. Omniscope reads them as integers, instead of decimals.

When importing into the same Omniscope file on my local machine, I use the Excel direct reader option. Then the decimals are imported into the DataManager source block. Therefore, I assume that the problem is the Omniscope Reader. I am available for a screen share.

(Using 2.8 b.1235)

]]> http://forums.visokio.com/discussion/2456/sources-reading-.rtf-rich-text-filess Mon, 27 Jan 2014 06:38:32 -0500 daniel 2456@/discussions
]]> http://forums.visokio.com/discussion/2238/connector-google-bigquery-column-titless Wed, 10 Jul 2013 02:01:43 -0400 nuriozlu 2238@/discussions It seems strange do you have any idea about the problem ?]]> http://forums.visokio.com/discussion/2246/new-sources-ingresvectorwise-support-2.9- Wed, 17 Jul 2013 05:29:01 -0400 chris 2246@/discussions
In Omniscope 2.9 we have now added support for reading/writing to Actian Ingres and Vectorwise databases. For more information on these databases see:

http://www.actian.com/products/ingres
http://www.actian.com/products/vectorwise
]]> http://forums.visokio.com/discussion/2173/sources-how-to-unserialize-php-datas Wed, 29 May 2013 03:34:27 -0400 naruemon 2173@/discussions
One of our data sources is kept as serialized data from php serialize() function.

The data is in the following format:
a:3:{i:0;s:2:"74";i:1;s:3:"185";i:2;s:3:"151";} --> total data is 3 contains 74, 185, 151
a:2:{i:0;s:3:"120";i:1;s:3:"119";} --> total data is 2 contains 120, 119
The number of info in this format is vary from 1 - 200.

I would like to get the data in easier format to manage. So I could use de-tokenize function to organize data. Do we have any function to manage this format of data? Thank you.]]> http://forums.visokio.com/discussion/2181/sources-renaming-folders-of-filess Wed, 05 Jun 2013 08:07:21 -0400 SteveP 2181@/discussions
If we try to open one of these files in a DataManager, there doesn't appear to be a way of doing it, without renaming the file to something like smith001.txt

Is there a way to EITHER open the files with their current names, OR do something to rename all of the files first?

Thanks]]> http://forums.visokio.com/discussion/2159/sources-deleting-incoming-emails-once-processeds Wed, 22 May 2013 09:12:48 -0400 Barcl 2159@/discussions
It would be useful to delete all messages received more than xx days ago or something similar that avoid going over quota.

Thanks]]> http://forums.visokio.com/discussion/2128/sources-connecting-to-ftp-server-errors Fri, 10 May 2013 04:33:19 -0400 tamax 2128@/discussions
One of our customer is having trouble when trying to connect Visokio to our FTP Server. He says his firewall and proxy is correctly configured and every other program tested can connect correctly except Visokio.

This is his message:

I’ve tried connecting to the FTP site using filezilla and it works fine so I think it is something to do with the setup of the program. Can you pass this on to Visokio support? I am seeing the following in the firewall logs:

May 8 09:14:58 UTC: %FW-3-FTP_NON_MATCHING_IP_ADDR: (target:class)-(CSM_Inside-Outside_1:CSM_ZBF_CLASS_MAP_3):Non-matching address 0.0.0.0 used in EPSV response -- FTP client 10.34.25.15 FTP server 50.16.213.75

May 8 09:14:58 UTC: %FW-6-SESS_AUDIT_TRAIL: (target:class)-(CSM_Inside-Outside_1:CSM_ZBF_CLASS_MAP_3):Stop ftp session: initiator (10.34.25.15:62838) sent 48 bytes -- responder (50.16.213.75:21) sent 114 bytes

Do you have any idea?

Thanks a lot,
Maxime]]> http://forums.visokio.com/discussion/2133/sources-dropboxgoogledrive-support-2.8-.- Fri, 10 May 2013 12:17:38 -0400 chris 2133@/discussions
In the Omniscope file menu you can open (and subsequently save) a DropBox/GoogleDrive file directly by selecting "File > Open online file".

In DataManager, DropBox and GoogleDrive is supported in both the "Data file" source block and the "Data file" publisher block. You can also add a dropbox folder to your DataManager bookmarks by clicking the "Add" button in the bookmarks toolbar and selecting "Folder of files".]]> http://forums.visokio.com/discussion/2041/idea-sources-variable-first-row-data-locations Thu, 07 Mar 2013 07:05:30 -0500 Master_Chief 2041@/discussions
Rather than edit the source block each time I add a new one, is there a way to search the file and locate where the data starts based on a cell marker (a cell value which remains constant throughout all of the files) and use this as the new data table.

Previously I have used Excel macros to loop through columns to locate where data starts, but the aim is to move all of the VBA code into an Omniscope trial to be completely automated. ]]> http://forums.visokio.com/discussion/1891/datamanager-error-on-line-1-premature-end-of-files Sun, 11 Nov 2012 10:14:31 -0500 Alexander 1891@/discussions http://forums.visokio.com/discussion/1871/sources-improved-xml-data-import-2.8- Mon, 29 Oct 2012 06:15:39 -0400 richard 1871@/discussions
1. Add in an XML file using the 'Data file' source and choose 'Definition' as the transform type
2. Edit the definition and using the table, select the tags/attributes to import into the dataset.
3. Choose the tag/attribute ('Record item') which will identify dataset records in the XML data

Additional options include the default labelling format for the dataset fields and previews of the XML and dataset.]]> http://forums.visokio.com/discussion/1608/idea-sources-detaching-data-file-from-an-exchange-based-emails Tue, 19 Jun 2012 04:54:39 -0400 Kefsid 1608@/discussions http://forums.visokio.com/discussion/1798/idea-source-auditability-tracking-the-originchanges-in-fieldss Fri, 28 Sep 2012 09:42:16 -0400 davedunckley 1798@/discussions http://forums.visokio.com/discussion/1823/connector-google-bigquery-data-source-2.8- Wed, 10 Oct 2012 06:42:32 -0400 chris 1823@/discussions
Google BigQuery is a cloud database that allows you to analyse very large data-sets (apparently billions of rows). The Omniscope feed allows you to download and query data in a similar way to any other database.

At the moment we have only added a BigQuery feed, although in the future we plan to integrate BigQuery into the DataManager bookmarks and also add a BigQuery data publisher.

Please let us know if you have any feedback/ideas/problems using this functionality.]]> http://forums.visokio.com/discussion/1765/sources-sas-compatibilitys Mon, 17 Sep 2012 09:51:59 -0400 amchance 1765@/discussions http://forums.visokio.com/discussion/1238/sources-skype-and-other-im-feedss Sun, 22 Jan 2012 09:03:14 -0500 sherriff 1238@/discussions http://forums.visokio.com/discussion/816/import-excel-file-source-bugs Mon, 13 Jun 2011 09:53:54 -0400 edtclarke 816@/discussions
The sheet has 86 rows of data and 4061 columns which need to be transposed. When I import the sheet via the [File] block I get no error message but it only imports 500 fields (columns) and all 86 records (rows).

I then tried changing the [Reader] from 'Excel as CSV' to 'Excel direct'. This then gives me a warning message headed 'Row/column limit':
"It is not possible to import more than 676 columns and 1048576 records. Your excel document has 4061 columns and 86 records. Your data has been truncated to fit the limits"

So 3 questions really:
1 - Why is there a '676' limit when Excel 2010 allows 16384 columns?
2 - Why does it only import 500 columns NOT 676?
3 - Why do you not get a warning when using the 'Excel as CSV' option (also the same for the 'Omniscope' [Reader]?]]>