How to remove duplicate lines
- Paste text with one item per line: emails, URLs, keywords, product codes, names or log entries. A column copied from Excel or Google Sheets pastes as one value per line.
- Turn on Ignore case and Ignore extra spaces if the same item may be typed differently, as in most hand-made lists.
- Copy the result, or download it as a text file. The status line says how many repeats were removed.
Three ways to deduplicate
| Mode | Result | Use it for |
|---|---|---|
| One copy of every line | a, b, c | Cleaning a mailing list, keyword list or list of URLs |
| Only lines that appear once | c | Finding items that are in only one of two lists you pasted together |
| Only the repeated lines | a, b | Spotting double entries, repeated errors in a log or duplicate orders |
Compare two lists with one paste
Paste list A, then list B underneath, and choose Only the repeated lines. The result is every item that is in both lists, as long as neither list has repeats of its own (clean each one first). Choose Only lines that appear once to get the items that are in just one of the two lists.
What counts as a duplicate
By default two lines match only if they are identical, character for character. Apple and apple are different, and so are ben@example.com and ben@example.com with a trailing space you cannot see. Spaces like that are common in data copied from spreadsheets and PDFs, which is why “Ignore extra spaces” exists. Ignore case compares lines the way your browser lowercases text for your language.
The tool compares whole lines. To remove repeated words inside a sentence, or to tidy text that has broken line breaks, start with Remove Line Breaks. To see what changed between your original and cleaned list, paste both into Text Compare.
Duplicates in a CSV file
Each line of a CSV file is one record, so this tool removes rows that are identical in every column. To find rows that share only one field, such as the same email with different names, paste just that column. For a full table, open the file in the CSV viewer, sort by the column and review the matches.
Frequently asked questions
How do I remove duplicate lines from text?
Paste your list into the box. Each line that appears more than once is reduced to a single copy, and the original order is kept. Copy the result or download it as a .txt file.
Can it ignore capital letters and extra spaces?
Yes. Turn on “Ignore case” to treat Apple and apple as the same line, and “Ignore extra spaces” to treat lines that differ only in leading, trailing or repeated spaces as the same. With extra spaces ignored, the kept lines are also written trimmed.
Which copy of a duplicate line is kept?
The first one by default, so the list keeps its original order. Choose “Keep last copy” when later lines are more up to date, for example in an exported log or a list you added to over time.
How do I keep only the lines that are not repeated?
Choose “Only lines that appear once”. Every line that occurs two or more times is removed completely. To see the repeated lines instead, choose “Only the repeated lines”, and sort by count to see the most frequent first.
What happens to blank lines?
Blank lines stay where they are and are never counted as duplicates, so paragraphs and groups in your list keep their spacing. Turn on “Remove blank lines” to delete them all. Sorting also removes them.
Is my text uploaded?
No. The list is processed in this browser tab and is not sent to SuperUtils or saved. That matters for email lists, customer IDs and other private data.