[SlugBug] text munging question

[pault]

hi all

i have a number of irc log files which i'd like to tidy up.

one of the problems is that these cover a period when my connection was flaky
[take a bow blueyonder]. so i ended up with multiple connections to the same
channel. as i had logging enabled i have lots of examples of the same line
being repeated two or three times. i would like to remove all the duplicate
lines.

i am open to suggestions as how this may best be accomplished [perl? regex?
dunno?]

pault
-- 
pault <mailto:pault at burngreave.net>
<http://www.burngreave.net/~pault/>
GnuPG key <http://keys.indymedia.org/search.py?search=pault>