Duplicate line removal editor?

[AvianFlux]

Is there a free .txt file utility/editor/script/whatever that will automatically remove all duplicate line entries from large .txt documents?

Something created dupes of every URL in my extensive IE Favorites folder. I fixed it by deleting the Favorites folder contents and importing a previously stored bookmarks file. I lost a few recent URL entries as a consequence, however.

[MYS]

A very good selection including some freeware ones here.

http://www.snapfiles.com/downloadfind.php?action=s&st=duplicates&search=Find

[iceni60]

-{ Quote: "Is there a free .txt file utility/editor/script/whatever that will automatically remove all duplicate line entries from large .txt documents?

Something created dupes of every URL in my extensive IE Favorites folder. I fixed it by deleting the Favorites folder contents and importing a previously stored bookmarks file. I lost a few recent URL entries as a consequence, however." }-
sorry if i have misunderstood what you are looking for, but if it's something that will delete duplicates in your bookmarks you can use AM-DeadLink (http://aignes.com/deadlink.htm) it will work for afew browsers including Mozilla, Firefox and IE.

i did take a screenshot, but the manage attachments isn't working for me at the moment. i will try again in a minute :)

[AvianFlux]

I think that's exactly what I am looking for. I already had it in my program files - buried among a hundred other apps, etc. - but had forgotten all about it.

Does it also find and remove dupes from ordinary .txt files? It looks like it does.

Thanks for the link and reminder. :)

[iceni60]

-{ Quote: "I think that's exactly what I am looking for. I already had it in my program files - buried among a hundred other apps, etc. - but had forgotten all about it.

Does it also find and remove dupes from ordinary .txt files? It looks like it does.

Thanks for the link and reminder. :)" }-
hi, AvianFlux :) i'm not too sure if it will work with any text file :-\ i haven't got time to play with it and see right now, i have to be at college in 20 mins. if it doesn't let us know and i'll have alook at some of the freeware sites i use :)