http://forums.visokio.com/discussions/tagged/ETL/feed.rss Mon, 30 Oct 17 15:53:23 -0400 Tagged with ETL - Visokio Forums en-CA http://forums.visokio.com/discussion/3027/datamanager-importing-data-without-columns-headers Tue, 10 Nov 2015 11:12:47 -0500 aknotts 3027@/discussions
We have a project where we are sent text files of raw data with no header row and we get a separate file which has the column headers in. I need to append the column headers to the top of the raw data so I can use it. I don't want to put a field organiser and manually go through and add the column names The assumption is that the order in the headers file is in the same order as the data.

Has anybody done this before and how did you get over it? I have attached a method I'm looking at but ideally I don't want to have to write out a file and read it back in again (especially as the files are in excess of 2million rows).

Thanks

Andy]]> http://forums.visokio.com/discussion/1818/datamanager-automatically-importexport-database-tabless Tue, 09 Oct 2012 06:39:56 -0400 Alfonso 1818@/discussions
I defined a data flow like this: Open database -> organize fields -> validate data -> publish data using a database table output only. My data flow does not include a load into the blue ouput block representing the in-memory DataExplorer output for visualisation/presentation/reporting. Could we have the ability to launch this type of ETL data flow in batch mode (silent or no prompts doesn't allow the publish process run automatically)? Please if you have any ideas, let me know. - Alfonso
]]>