Deduplicate
Removes duplicate rows, keeping the first occurrence of each. By default two rows are duplicates only when every column matches; name key columns to loosen that. For instance, treat any repeat of the same invoice number as a duplicate even if other fields differ.
Inputs
| Input | Accepts | Required |
|---|---|---|
Table | Table | Yes |
Outputs
| Output | Produces |
|---|---|
Result | Table |
Settings
Typed in on the node or set by the assistant, not wired.
| Setting | Default | Notes |
|---|---|---|
KeyColumns | — | Choose one or more columns from the connected table. Optional comma-separated columns that define what counts as a duplicate (e.g. Invoice_No or Customer,Date). Leave blank to require every column to match before a row is treated as a duplicate. |
Example
After stacking two payment files with a Union, your Payments table has 4,120
rows but some payments appear in both files. Set KeyColumns to Payment_ID and
the result keeps one row per payment: 3,987 rows, first occurrence wins. The
cleaned table appears as its own tab.
Tips
- Because the first occurrence is kept, sort the table first if you care which copy survives (e.g. most recent on top).
- To count duplicates rather than remove them, use GroupBy with Count instead.