Home / Tools / Remove duplicate CSV rows
CSV WORKSPACE

Remove duplicate CSV rowsFREE · LOCAL

Keep the first or last complete row for each key, in original source order.

Files and input stay in your browser. Input up to 5MB. Tables: 20,000 data rows · 200 columns. Output up to 20MB.

01Input and options

02Review the result

The table preview shows the first 50 data rows. Copy and download include the full text result; split ZIP contains all parts while copy shows only the first part. CSV / TSV downloads use UTF-8 BOM. Formula-like values may receive a protective apostrophe. Review leading zeros, dates and blanks when reopening in a spreadsheet.

Enter data or load an example to begin.

How to use Remove duplicate CSV rows

  1. Load the example to check the expected input shape, or select your file. Keep a separate copy of the original.
  2. Review the options and rules below. Run the tool, then compare representative values, row counts and headers.
  3. Copy the output or download a new file. Input changes clear the previous result so you cannot download stale output.

Rules and limitations

Key columns are 1-based: use 1 or 1,3, or leave blank to compare complete rows. Empty keys also match. Case and leading zeros matter. Ignoring surrounding whitespace affects matching only. Last means file order, not the latest date; values from discarded rows are not combined.

Worked example

Use the English example button above. Identifiers such as 0012 are strings; they should not silently become 12. For conversion, compare record counts before and after. For cleaning, filtering, comparison and lookup, check the operation-specific summary.

The example has four data rows, including two rows for 0012. With key column 1, either retention mode produces three rows. First keeps Alex in Sales; last keeps Alex in Planning. The last mode outputs 0024, 0036, then 0012 because retained rows keep their source order.

Troubleshooting

If columns shift, check the delimiter and quote fields containing delimiters or newlines. If characters look wrong, select the encoding before loading the original file again. CSV has no stored cell types; spreadsheet software may infer numbers and dates when opening it.

Does my file leave my device?

The tool processes selected files and pasted input in browser memory. It does not upload the file or its name. Hosting providers may process page-request metadata such as IP address and requested URL. See the privacy notice.

Read the usage reference · Choose another tool