De-duplicate
De-duplicate

The De-duplicate operation allows you to remove or retain the duplicate records in a data-set.
Options
- Field selection. The field selection deterimes how the duplicate records are calculated. You should select a set of fields which together uniquely identify a single record.
- Minimum group size Define by 2 if duplicates, 3 if triplicates, etc.
- Case sensitive
- Output