A Very Simple Program to Remove duplicates in a text file. It can able to remove thousands of duplicate sentences with in a minute.
For Example you have an input text file which contains these lines:
hello I love Pakistan Country, hello hello city hello I love
Then the output text file will be.
hello I love Pakistan Country, hello city
A simple but effective tool and very easy to use. I widely using it in email marketing for remove duplicate emails.