Batch append files
The Batch append files data source allows you to append the contents of a set of data files within a designated folder.
Options
The File selection section allows you to configure which files you want to append.
- File type. Allows you to select the types of files that you want to import. All file types supported by Omniscope are listed here. When you select a particular file type, the configuration options for that file type are displayed, so if you choose the 'Microsoft Excel file type' then the configuration options specified (worksheet name, header/data rows etc) will be applied to all workbooks matching the selection criteria. If you need to import files requiring different import configurations you should consider using mulitple Batch append sources or importing the files individually. Most of the options available in the File and URL sources are available in the Batch append source.
- Folder. Allows you to select the directory containing the files that you want to append. At the present time the Batch append source does not allow you to select FTP directories.
- Scan sub-folders. Determines whether files in sub-folders inside the selected directory will be scanned. If unchecked only files in the selected directory will be appended. If checked files in the selected folder and all child folders will be appended.
- All/part of filenames. Allows you to filter which files you want to append. Whenever you change the file type the filename will change to reflect your selection, so if you choose the 'Excel workbook (Excel 2007)' file type the filename will automatically change to '*.xlsx'. You can enter multiple filters by separating each one using the ',' character. So for example if you want to append all .TXT and .DAT files you would enter '*.TXT,*.DAT'.
The Source field section determines whether Omniscope will create an additional field in the dataset that contains the file each row of data was obtained from. You can enter the name of the file and choose whether to remove the file extension. This feature is particularly useful if you are appending a series of files containing timestamps inside their filenames.
