Remove Duplicate Lines Online

Paste a list and keep only the first copy of each line. The original order is preserved.

0 words · 0 characters

Example

With “Ignore upper/lower case” on

Before
apples
bananas
Apples
cherries
bananas
After
apples
bananas
cherries

Typical uses

Cleaning email lists, keyword lists, SKUs, and log files, or merging two lists without double entries. Paste both lists together and remove the duplicates in one pass.

Order is kept

The first time a line appears it stays where it is, and later copies are removed. To put the result in order as well, use Sort alphabetically.

Choosing what counts as a duplicate

Two lines are duplicates only if they match exactly, so small differences matter. “Ignore upper/lower case” treats “Toronto” and “toronto” as the same line, which is what you usually want for names, emails, and keywords. “Ignore spaces at the start and end” catches lines that differ only by a stray space, a common leftover from spreadsheets.

A worked example

Say you have newsletter sign-ups from two events. Paste both lists, one email per line, turn on “Ignore upper/lower case”, and copy the result: each address appears once, in the order it first appeared. To also put the list in order, run it through Sort alphabetically.

Frequently asked questions

Which copy is kept?

The first occurrence of each line is kept in its original position. Later copies are removed.

How many lines can I paste?

There’s no fixed limit. Lists of tens of thousands of lines work fine on a typical computer because everything runs in your browser.

How do I remove duplicates in Excel?

Select the column and choose Data › Remove Duplicates. Unlike this tool, Excel is not case-sensitive and there is no option to change that.