Duplicate word remover
Paste text with repeated words and get it back with each word only once, or with just the accidental doubles such as "the the" fixed. Punctuation and line breaks stay where they were.
Runs in your browser: nothing you enter is sent anywhere.
How to use it
- Paste your text. The cleaned version appears at once on the right.
- Leave “Ignore case” on if “The” and “the” are the same word for you.
- Choose “Every repeat” to build a list of unique words in order of first appearance, or “Only a word repeated right after itself” to fix typing slips.
- Copy the result.
How it works
The text is read from left to right. Each word is compared with the words seen so far (or only with the previous word in the second mode). A repeat is deleted with the spaces before it; if it stood at the start of a line, the spaces after it go instead, so no line starts with a gap.
Worked example
“the cat and the dog” has “the” twice. The second one is removed with its leading space, giving “the cat and dog”. With the second mode, “the the cat the” becomes “the cat the”: only the doubled word is removed.
Tips
Removing every repeat from normal prose breaks sentences, so it suits keyword lists, tags and word lists rather than articles. Use the second mode for proofreading.
Frequently asked questions
Which copy of a repeated word is kept?
The first one. Every later copy is removed together with the space in front of it, so "the cat and the dog" becomes "the cat and dog". Commas, full stops and line breaks are not touched.
What is the difference between the two modes?
Choosing every repeat removes a word whenever it already appeared earlier in the text, which also shortens normal prose, since words like "the" return all the time. The second mode fixes typing slips such as "the the" and leaves the rest alone.
What counts as a word?
A run of letters or digits, with a hyphen or apostrophe inside it kept ("well-known", "don't"). Letters of any alphabet work. Punctuation is never counted as a word.
Does it remove duplicate lines?
No, it works on words. To drop repeated lines, use the remove duplicate lines tool.