Remove duplicate lines from a text file

You can use this shell command:

uniq -u input.txt output.txt

Henning Koch 2011-09-27