http://forums.visokio.com/discussions/tagged/DataManager_workspace/p2/feed.rss Mon, 30 Oct 17 13:21:33 -0400 Tagged with DataManager_workspace - Visokio Forums en-CA http://forums.visokio.com/discussion/1850/datamanager-custom-alerts-for-data-qualitys Mon, 22 Oct 2012 12:28:41 -0400 JfJf 1850@/discussions
For example, If I have a data stream lets say Shoe Models from sales, and I wanna cross it over with an static price excel sheet so I would be getting a merge between the Shoe Models & Shoe Prices to get my sales data. If a new model is released, it would be registered in the sales, but I need to include it In the Shoe prices so it would be successfully merged and counted; these unsuccessfully merged records would be a part of non-merged records, or in the case that I get a many:many relationship, it would be very useful to have a block or an extension of the data Validation block that would flag custom issues between blocks, so these errors could be fixed faster and easier.

In this shoes example, the solution would be IF I get less records of a particular field in the the merge output than the amount of records from that same field in a previous block, then it would be flagged as [missing records] or simply error.

It would be like adding an additional layer to the formulas that could include the Block name. So a formula which is usually [Function][Field][Record], could be [Function][Block][Field][Record]. I don't know if this is already possible, but it would be useful for data integrity and improved automation.

Thank you, JfJf

]]> http://forums.visokio.com/discussion/1819/outputs-showing-publish-button-in-other-tabss Tue, 09 Oct 2012 06:50:41 -0400 Alfonso 1819@/discussions http://forums.visokio.com/discussion/1706/idea-datamanager-remove-fields-in-deduplicate-blocks Wed, 15 Aug 2012 09:22:54 -0400 Mees 1706@/discussions
Thanks - A]]> http://forums.visokio.com/discussion/1763/datamanager-copyingduplicating-multiple-blockss Fri, 14 Sep 2012 07:23:43 -0400 dszl136154 1763@/discussions
Thanks]]> http://forums.visokio.com/discussion/1632/datamanager-deleting-empty-fields-in-batch-output Fri, 29 Jun 2012 12:16:53 -0400 mokirk 1632@/discussions http://forums.visokio.com/discussion/1657/datamanager-custom-script-operation-2.8- Tue, 17 Jul 2012 08:36:04 -0400 steve 1657@/discussions
The "Custom Script" operation allows you to execute arbitrary Javascript to transform one or more inputs into a new output.

The result of the Javascript must be a two-dimensional array, indexed as [column][row] (i.e. [field][record]). You can optionally choose to provide the field name as the first row in this 'table'.

The inputs are accessible via "input1", "input2", etc. and also via "inputs[0]", "inputs[1]". These objects provide access to all regular Omniscope Javascript functions, such as:


input1.recordCount()
input[0].subset_sum("Price")


Here is an example script which simply ignores inputs, and produces static data:

[
["1, 1", "1, 2", "1, 3"],
["2, 1", "2, 2", "2, 3"],
["3, 1", "3, 2", "3, 3"]
]


Here is another which returns a 2x1 table of metadata about two inputs:

[
[
input1.recordCount()
],
[
input2.recordCount()
]
]


Here is another which does a sideways concatenation of multiple inputs:

working = new Array();
for (i in inputs) {
var input = inputs[i].dataArray(null, null, true);
for (n in input) working.push(input[n]);
}
working;


See attached example. Requires 2.8 or later.]]> http://forums.visokio.com/discussion/1623/scheduler-configure-output-blocks-from-scheduler Wed, 27 Jun 2012 06:00:06 -0400 rborobia 1623@/discussions From Scheduler I can configure source blocks of DataManager (block name, source, ....), but
¿Could I configure output blocks (output file, template, ...) ?
Thanks, Raúl]]> http://forums.visokio.com/discussion/1576/import-com-error-reading-from-a-spreadsheets Mon, 04 Jun 2012 15:15:11 -0400 mhersk 1576@/discussions http://forums.visokio.com/discussion/1442/datamanager-field-metadata-operation-2.8- Mon, 02 Apr 2012 06:28:49 -0400 steve 1442@/discussions
This is a very simple operation currently without any configuration options. For every input field, it creates an output record describing that field, with attributes such as Name, Type, Min, Max, etc.]]> http://forums.visokio.com/discussion/1459/datamanager-more-attributes-in-iok-file-metadata-block-2.8- Wed, 11 Apr 2012 15:17:58 -0400 steve 1459@/discussions
- Record count
- Field count
- Field names, comma-separated
- Source file/URL/summaries, comma-separated
- Tab names, comma-separated (includes hidden tabs).]]> http://forums.visokio.com/discussion/1514/formula-in-datamanager-for-lag-or-lead-or-previous_value-s Tue, 01 May 2012 17:44:50 -0400 joemako 1514@/discussions
for example, in a data set like:

ID,Value
1,10
2,20
3,30

I would like to get the result set:

ID,Value,Previous_Value
1,10,
2,20,10
3,30,20]]> http://forums.visokio.com/discussion/1458/datamanager-database-source-field-picker-2.8- Wed, 11 Apr 2012 13:06:29 -0400 chris 1458@/discussions http://forums.visokio.com/discussion/1240/datamanager-setting-data-blocks-back-to-not-configured Mon, 23 Jan 2012 04:58:00 -0500 SteveP 1240@/discussions
When I scroll around the DataManager page, the Data block which connects to the MySQL table suddenly switches back to "not configured", with the red "Execute" button highlighted. If I click on it, the block instantly returns to its correct state, with the records retrieved and passed to the next block.

It seems to happen as soon as the data block has scrolled off the screen. This has become a problem as the datamanager page has grown - when you go to edit the operations at the bottom of the page, the data block at the top shows the error and everything else beloe it falls over.

Any idea why this is happening? I am using ServerPlus v2.6b800

Thanks in anticipation!]]> http://forums.visokio.com/discussion/1251/database-connections-filtering-pass-through Wed, 25 Jan 2012 05:42:01 -0500 JorgenP 1251@/discussions
In my case, I have 6 queries in Access, which are all linked up with the respondents ID, in order always to know what the individual has answered. My data covers the entire 2011 - but if I only want to drag out certain weeks in 2011, and pass them through to DataManager, is it then possible to have a filter in Omniscope which decides the weeks that are been passed through. At the moment, I am getting the entire dataset from 2011, which makes the system too slow on my machine.]]> http://forums.visokio.com/discussion/1177/filtering-via-merges-with-lists Tue, 20 Dec 2011 06:19:10 -0500 LukeWhiteley 1177@/discussions
[SOLVED: Merging in the list by the two relevant fields worked]]]> http://forums.visokio.com/discussion/1014/datamanager-not-loadingdropping-fields-after-full-refreshs Tue, 27 Sep 2011 13:21:12 -0400 Wayne 1014@/discussions http://forums.visokio.com/discussion/962/idea-datamanager-multi-block-copys Wed, 31 Aug 2011 09:31:23 -0400 TomW 962@/discussions
Thanks - Tom]]> http://forums.visokio.com/discussion/904/datamanager-api-feeds-and-sql-servers Tue, 02 Aug 2011 23:12:49 -0400 shamong 904@/discussions
Meaning to say, the data is extracted from the feeds and linked to the SQL Server stored locally for some minor processing to be done straight from the server?

Thanks!]]> http://forums.visokio.com/discussion/888/field-organiser-defining-value-colours-shapess Tue, 26 Jul 2011 03:51:53 -0400 steve 888@/discussions
Currently you can only do this after loading data into the DataExplorer side of Omniscope and accessing:

Data > Manage Fields > Options]]> http://forums.visokio.com/discussion/825/datamanager-field-organiser-issue Thu, 16 Jun 2011 06:44:03 -0400 aknotts 825@/discussions
Hi - I have put a spreadsheet File source and a Field organiser on my DataManager workspace pallette. I have changed the format of some fields (eg the data input format M/d/yyyy and have set the output/save format to yyyy-MMM-dd and have removed the thousand separator in several fields). When I load it into Omniscope, these changes are lost. It is as if the Reset All button has been clicked.

Just tested again (see attached).

1. default position for column NIC is that thousand separators are shown
2. untick thousand separators and the Load button appears
3. Click load and data displayed without separators
4. collapse the NIC column in the field organiser and the Load buttoin appears again
5. Click Load
6. Thousand separators appear again but if you expand the NIC column it says they are off.

See attached screen shots

Can you check it out?

Thanks

Andy]]> http://forums.visokio.com/discussion/816/import-excel-file-source-bugs Mon, 13 Jun 2011 09:53:54 -0400 edtclarke 816@/discussions
The sheet has 86 rows of data and 4061 columns which need to be transposed. When I import the sheet via the [File] block I get no error message but it only imports 500 fields (columns) and all 86 records (rows).

I then tried changing the [Reader] from 'Excel as CSV' to 'Excel direct'. This then gives me a warning message headed 'Row/column limit':
"It is not possible to import more than 676 columns and 1048576 records. Your excel document has 4061 columns and 86 records. Your data has been truncated to fit the limits"

So 3 questions really:
1 - Why is there a '676' limit when Excel 2010 allows 16384 columns?
2 - Why does it only import 500 columns NOT 676?
3 - Why do you not get a warning when using the 'Excel as CSV' option (also the same for the 'Omniscope' [Reader]?]]> http://forums.visokio.com/discussion/786/create-and-access-variables-in-data-manager Sun, 22 May 2011 07:37:17 -0400 Guy_Cuthbert 786@/discussions

1. the first adds all formulae which I want to treat as if they were data values read, or merged, from my data source(s) and does NOT carry these through as formulae (the default setting)
2. the second adds all the formulae which I want to use as formulae in my model, and so I set the "Preserve formulae in output" option

I say nearly all formulae, because the exception is any formula which involves the use of a variable. There is no way of referencing a variable in the formula editor within the DM environment (from a Field organizer block).

Could we please have a means of referencing variables inside DM? It's so much more manageable to keep all field work inside DM, and this is the only remaining omission AFAIK.]]> http://forums.visokio.com/discussion/676/database-table-block-auto-rename Mon, 14 Mar 2011 05:05:32 -0400 edtclarke 676@/discussions If I make any changes to the template I need to point it at our development database as Omniscope won't connect to our live server. When I do this, the block renames itself.

I can understand that when a block is first configured it 'suggests' a name for itself but if I have specified a name for a block it would seem reasonable that it should remain that name until I specify otherwise]]> http://forums.visokio.com/discussion/305/datamanager-cannot-access-file-errors Tue, 04 May 2010 09:44:36 -0400 SteveP 305@/discussions
If we run the procedure and publish to a brand new file, it works perfectly.

Once that file is there, and we try to re-run to publish to the same file, using the "Use target file view configuration" option, we get the following error -

"Publishing error
Cannot Access File
The file you are trying to access is currently locked by elsewhere inside Omniscope. Please try again.
Could not obtain lock within timeout 60000ms"

The target file is definitely not open anywhere.

Any ideas what the problem might be? We are currently using 2.6 b236

Thanks, Steve]]> http://forums.visokio.com/discussion/601/idea-datamanager-for-each-file-loopbatch-processs Wed, 19 Jan 2011 11:30:27 -0500 edtclarke 601@/discussions
I needed to perform a number of tasks on each file, before appending them together so batch append wouldn't have been appropriate. What would have worked well is a batch container which would perform a given set of operations to every file passed. You can do this in SSIS (for each file loop container) - it saves time and keeps the process map a lot cleaner and easier to understand.]]> http://forums.visokio.com/discussion/535/handling-zipped-files-in-dms Wed, 01 Dec 2010 11:09:45 -0500 edtclarke 535@/discussions
Thanks,
Ed]]> http://forums.visokio.com/discussion/534/automatically-publish-outputs Wed, 01 Dec 2010 10:23:40 -0500 edtclarke 534@/discussions
Thanks,
Ed]]> http://forums.visokio.com/discussion/519/disappearing-dm-source-blocks-when-saving-a-file-with-professional Tue, 23 Nov 2010 08:53:30 -0500 edtclarke 519@/discussions
Has anyone else experienced this? Would it not be better if the DM blocks were left untouched?]]> http://forums.visokio.com/discussion/422/how-to-use-dm-parameterss Tue, 28 Sep 2010 14:02:06 -0400 Guy_Cuthbert 422@/discussions
As I'm looking at it in DM 2.6 b379, I have 3 types of parameter I can configure:

1. A fixed value, or a type of my choosing... this seems limited as a 'parameter', but I guess it does give me the ability to change settings manually inside DM and have different behaviours (useful for dev/test/live environments etc.)
2. A value from my existing Omniscope model - I can see how this works (and can get it to work) but it seems to be of limited value at present... I guess I will think of uses in due course (so would be interested in how others are using this)
3. A value derived from another Omniscope - this seems VERY useful, in that I can use one Omniscope DM to drive another, and another... offers LOTs of user/group/division/dept/category type customisation... BUT I can't select another Omniscope from the drop-down list presented

In the third option I had expected to see either a file browser (to find other IOK files to use as parameter value sources), or some form of Task Manager, so I can pick another Omniscope instance(?!) - but nothing appears.

Any explanations on how parameters do/will work - with examples of how they can be utilised - would be VERY welcome... it seems to me it could be incredibly powerful, but I'm struggling to make the most of it right now...

Thanks in advance!]]> http://forums.visokio.com/discussion/459/customise-import-behaviour Thu, 21 Oct 2010 16:12:46 -0400 sdhayes 459@/discussions When opening into an omniscope I can customise the import behaviour to handle this.
However, I can't appear to set this in a datamanager flow as the initial step
ie the first thing I need to do is import with the þ parameter, and then go on to some more advanced functions]]>