TextArray
100% local

Remove duplicate lines

Delete repeated lines from a list and keep only the unique ones.

Input
Output

Remove duplicate lines

Paste a list of lines and this tool returns only the unique ones, in the order they first appear. Use it to clean up email lists, keyword sets, log files, exported spreadsheet columns or any repetitive text where duplicates crept in.

By default the comparison trims leading and trailing whitespace, so "apple" and "apple " count as the same line. Turn on case-insensitive matching to treat "Apple" and "apple" as duplicates too — the first spelling that appears is the one that is kept. If you prefer the most recent occurrence instead, enable "Keep last". You can also sort the cleaned result alphabetically in one step instead of running a separate sort afterwards.

The tool handles Windows (CRLF) and Unix (LF) line endings interchangeably, and it is fast: tens of thousands of lines are processed in a few milliseconds, with the exact timing shown in the tally under the output. The tally also tells you how many lines came in, how many remain and how many duplicates were removed, so you can sanity-check the result at a glance.

Everything happens in your browser. Your text is never uploaded, so it is safe to use with private or sensitive lists — customer emails, internal hostnames, unpublished keyword research. When you are done, copy the result, download it as a .txt file, or move it back to the input to chain another cleanup step.

FAQ

Does it keep the original order?
Yes. The first occurrence of each line is kept and later duplicates are removed. Turn on "Keep last" to keep the final occurrence instead.
Can it ignore capitalisation?
Enable "Case-insensitive" and lines that differ only in case are treated as duplicates.
How are empty lines handled?
Empty lines are treated like any other line: the first one is kept and the rest are removed. Use the remove empty lines tool to drop them entirely.
Is there a size limit?
No fixed limit. Processing happens on your device, so even lists with hundreds of thousands of lines finish in milliseconds.
Is my list uploaded anywhere?
No. The tool runs entirely in your browser and your text never leaves your device.