Remove Duplicate Lines
Free tool to remove duplicate lines from a list or text. It keeps the first occurrence and the original order, with options to ignore case and extra spaces, right in your browser.
What it does
Removing duplicate lines keeps only the first appearance of each line and deletes the rest, without changing the order of what remains. It is the quick way to clean up a list of email addresses, product codes or names collected from several places. By default two lines are duplicates only if they are exactly the same; the options let you treat Apple and apple, or a line with a stray space at the end, as the same line.
How to use it
- Paste or type your text in the box.
- Choose whether case and extra spaces should make two lines count as different.
- Copy the result, which updates as you type.
Frequently asked questions
Which copy of a duplicate is kept?
The first one. Later copies are removed and every remaining line stays in its original position, so the list keeps the order it had.
Are "Apple" and "apple" duplicates?
Only with "Ignore upper and lower case" turned on. Then the first spelling is the one that stays. The comparison follows the language of the page, so letters such as the Turkish İ are handled correctly.
What about blank lines?
A blank line counts like any other, so only the first one stays. Turn on "Remove empty lines" to take them all out.
Is my text sent anywhere?
No. Everything happens in your browser, in the page itself. Nothing is sent to our server and nothing is stored, so it is safe to use with private lists and documents.
Wikipedia — Data deduplication
Wikipedia — Data cleansing
Wikipedia — Uniq