TextArray
100% local

Remove duplicate words

Delete repeated words from text and keep only the first time each one appears.

Input
Output

Remove duplicate words

Paste text and this tool gives it back with the repeated words taken out, keeping the first time each word appears. It is the quickest way to tidy a keyword list, a tag field, a comma-separated set of product attributes, or a transcript where the speaker said the same word twice in a row.

Two options decide what counts as the same word. "Match case" is off by default, so "The" and "the" are one word and the spelling you wrote first is the one that stays. "Ignore punctuation" is on by default, so "red," and "red" match each other, while the output keeps its commas exactly where they were — only the comparison changes, never your text.

"Only consecutive repeats" is the option to reach for on running prose. It drops a word only when it repeats immediately, so "the the cat sat on the mat" becomes "the cat sat on the mat" and the second "the" that belongs there survives. Without it the tool deduplicates across the whole text, which is what you want for lists and tags but will thin out ordinary sentences, where the same word legitimately recurs.

Spacing and line breaks are preserved: a removed word takes the space in front of it, so nothing ends up double-spaced and your lines stay where they are. Windows and Unix line endings are both accepted. Everything runs in your browser — the text is never uploaded, so private notes, client transcripts and unpublished keyword research are safe here. Copy the result, download it as a .txt file, or move it back to the input to chain another cleanup step.

FAQ

Which occurrence of a word is kept?
The first one. Later repeats are removed, so each word keeps the position and the spelling it had the first time it appeared.
How do I remove only a stutter like "the the"?
Turn on "Only consecutive repeats". A word is then removed only when it repeats immediately, and the rest of your sentence is left intact.
Does it change my punctuation?
No. "Ignore punctuation" only affects how two words are compared. Every comma, full stop and bracket in the words that survive stays exactly as you typed it.
What happens to spacing and line breaks?
They are preserved. A removed word takes the space in front of it, so you never end up with double spaces, and your line breaks stay where they were.
Is my text uploaded anywhere?
No. The tool runs entirely in your browser and your text never leaves your device.