Remove Duplicate Lines

Keep one copy of each line, in its original position or alphabetic order.

Up to 200,000 UTF-16 units per input. Output limit: 4,000,000 characters.

Download text

Your text is processed in your browser and is not uploaded to ToolPixels. This tool does not save your text.

How to use it

  1. Paste or type your text, or load the example.
  2. Choose any options, then select Remove duplicates.
  3. Review the result, then copy it or download a text file.

Which lines are duplicates?

Matching compares the whole line, including leading and trailing spaces. The first occurrence is kept. Disable Match case to treat Apple and apple as duplicates. Disable Preserve original order to sort the retained lines using English collation. Empty lines are also deduplicated.

Line-based editing normalizes Windows and older Mac line endings to LF. Keep your original if line-ending style matters.

Related text tools