[SlugBug] perl help required - helix server log parsing

[Bill Best]

Chris J wrote:

>>hi
>>
>>i'm running helix universal server for webcasting and have a problem 
>>getting stats from the server logfiles as they are not output in Common 
>>Log Format.
>>
>>i've obtained a perl script from RealNetworks which is supposed to parse 
>>the rmaccess.log file and create a standard format log file that can be 
>>interpreted by webalizer.
>>
> 
> I think perl's the wrong thing for this job.

fair enough but needs must when the devil drives and all that  ;o)

> Does this piece of sed do what's needed?

i will try this and let you know - many thanks  :o)

> It looks okay from here, but not got a webalizer  to test it
> with (next three lines as one):
> 
> 	sed 's/^\(.*\[.*\].*\)\[\(.*\)\] \[.*\] \[.*\].*/\1\"-\" \"\2\"/'
> 		< /path/to/helix/log/file.log
> 		> sanitized_log_file.log

i did find a shell script which can do this sort of thing - 
http://www.bluehaze.com.au/unix/roll_web_logs - for comparison which 
apparently works for the old RealServer but requires amending for the 
newer Helix Server.

have given your above script a try, Chris, but webalizer again failed 
with the error:

Skipping bad records (xxxxx)
Skipping bad records (xxxxx)
Skipping bad records (xxxxx)
No valid records found!

and this is some output that i have from your script:

192.168.1.26 - - [18/Jun/2004:04:06:17 +0000]  "GET 
ramgen/encoder/zetafm.rm HTTP/1.0" 200 0 "-" 
"WinNT_5.1_6.0.12.857_RealPlayer_RN30PRI_en-au_UNK"
192.168.1.26 - - [18/Jun/2004:04:06:19 +0000]  "GET 
encoder/zetafm.rm?cloakport=80,7554,7070 RTSPT/1.0" 404 0 "-" 
"WinNT_5.1_6.0.12.857_RealPlayer_RN30PRI_en-au_UNK"
192.168.1.26 - - [18/Jun/2004:04:06:20 +0000]  "GET 
encoder/zetafm.rm?cloakport=80%2c7554%2c7070 HTTP/1.0" 404 0 "-" 
"WinNT_5.1_6.0.12.857_RealPlayer_RN30PRI_en-au_UNK"
192.168.1.26 - - [18/Jun/2004:04:06:22 +0000]  "GET 
encoder/zetafm.rm?cloakport=80,7554,7070 RTSPT/1.0" 404 0 "-" 
"WinNT_5.1_6.0.12.857_RealPlayer_RN30PRI_en-au_UNK"
192.168.1.26 - - [18/Jun/2004:04:06:24 +0000]  "GET 
encoder/zetafm.rm?cloakport=80%2c7554%2c7070 HTTP/1.0" 404 0 "-" 
"WinNT_5.1_6.0.12.857_RealPlayer_RN30PRI_en-au_UNK"

hmmm....

bill