How to use Remove duplicate text lines
- Load the example to check the expected input shape, or select your file. Keep a separate copy of the original.
- Review the options and rules below. Run the tool, then compare representative values, row counts and headers.
- Copy the output or download a new file. Input changes clear the previous result so you cannot download stale output.
Rules and limitations
Empty lines are removed and comparison is case-sensitive. Optional trim affects matching only; the original first line is kept. Up to 20,000 lines and 5MB are supported.
Worked example
Use the English example button above. Identifiers such as 0012 are strings; they should not silently become 12. For conversion, compare record counts before and after. For cleaning, filtering, comparison and lookup, check the operation-specific summary.
Troubleshooting
If columns shift, check the delimiter and quote fields containing delimiters or newlines. If characters look wrong, select the encoding before loading the original file again. CSV has no stored cell types; spreadsheet software may infer numbers and dates when opening it.
Does my file leave my device?
The tool processes selected files and pasted input in browser memory. It does not upload the file or its name. Hosting providers may process page-request metadata such as IP address and requested URL. See the privacy notice.