Remove duplicate lines from a text file

You can use this shell command:

uniq -u input.txt output.txt
Henning Koch Over 12 years ago