De-duplicate

De-duplicate 

The De-duplicate operation allows you to remove or retain the duplicate records in a data-set. 

 

 Options

  • Field selection. The field selection deterimes how the duplicate records are calculated. You should select a set of fields which together uniquely identify a single record. 
  • Minimum group size Define by 2 if duplicates, 3 if triplicates, etc.
  • Case sensitive
  • Output