Skip to content
IEDE Data processing & engineering
Request a quote
Quick tools JSON formatterJSON ↔ CSV converterJSON ↔ YAML converterJSON to SQLJSON to TypeScriptXML formatterData size calculatorBase64 encoder/decoder
IEDE
Get in touch
  1. Home
  2. Tools
  3. Remove duplicate lines
Runs in your browserText & lists

Remove duplicate lines

Paste a list or load a file. Duplicates are removed in your browser.

Runs locally — nothing is uploaded
Result
Paste a list, one item per line.

How to use

  1. 1Paste a list or load a file, one item per line.
  2. 2Choose whether spaces and letter case matter.
  3. 3Copy the unique lines or download them.

The first one, in its original position. Turn on Sort result to order the list alphabetically.

Yes. Lines are compared with a hash map, so hundreds of thousands of lines take well under a second.

Apple and apple count as the same line; the first spelling is kept.

Related tools

Sort linesAlphabetical, natural, length, shuffle Filter linesKeep or drop lines that match Compare two listsOnly in A, only in B, in both Split and join textText to lines and lines to a list Find and replacePlain or regex replace with groups Text diffAdded and removed lines or words

Messy data?

Send a sample — we reply within one business day with an approach and a quote.

Get in touchServices