Hi Jeremy,
I've got a 120 meg log file at the moment. (And about 5 - 6
gig archived)
The machine has 128M physical ram
Bad lines:
195.21.242.118 - - [19/Apr/1999:32:00:03 +1000] "GET
/cgi-bin/usercount/mmphoto/
counter.pl HTTP/1.1" 200 1345
205.155.154.146 - - [19/Apr/1999:32:00:00 +1000] "GET /~david_t/fline5.htm
HTTP/
1.0" 200 3806
205.155.154.146 - - [19/Apr/1999:32:00:05 +1000] "GET /~david_t/dl3.gif
HTTP/1.0
" 200 1666
205.155.154.146 - - [19/Apr/1999:32:00:08 +1000] "GET
/~david_t/springl2.gif HTT
P/1.0" 200 3772
Good lines:
212.242.23.67 - - [28/Apr/1999:20:16:28 +1000] "GET /~david_t/db28.jpg
HTTP/1.1"
200 6763
203.21.24.5 - - [28/Apr/1999:20:16:28 +1000] "GET
/~westlake/graphics/hr_alpha/8
.gif HTTP/1.0" 200 1469
203.34.200.215 - - [28/Apr/1999:20:16:28 +1000] "GET /images/side006.jpg
HTTP/1.
0" 304 2613
Thanks for your help!
Andrew
At 12:03 AM 4/29/99 -0700, you wrote:
>If you can post some good and bad lines from the logs, I'll see what I
>can do in Perl. How big is each logfile? And how much memory do you have
>available on the system.?
>
>Jeremy Wadsack
>OutQuest Magazine
>a Wadsack-Allen publication
>
>Andrew Chung wrote:
>
>> Hi All!
>>
>> I have been using analog 3.11 fine on a sun solaris machine
>> processing apache logs.
>>
>> I have some suitespot logs that I'd like to get stats from,
>> but there is a problem! Corrupt log entries! Enterprise doesn't
>> know the difference between real time and netscape time
>>
>> In the log
>>
>> 00 = 25:00, should be 01:
>> 34 = 10:00, should be 10:00
>>
>> so if it was 10:04:36, it would write 34:04:36 as the time!
>>
>> Of course analog gets confused! I don't blame it!
>> Is there a log converter available by someone? I wrote one
>> in normal shell script, but there was over 8 gig of logs,
>> and my script could only handle logs under 1 meg!
>>
>> --- start of script ---
>> #!/bin/bash
>>
>> cat $1 | sed s/" "/"@"/g > $1.temp
>> for i in `cat $1.temp` ; do
>> HEADER=`echo $i | awk -F: '{print $1}'`
>> WTIME=`echo $i | awk -F: '{print $2}'`
>> FOOTER=`echo $i | awk -F: '{print $3 ":" $4}'`
>>
>> case $WTIME in
>> 24) echo "$HEADER:00:$FOOTER" | sed s/"@"/" "/g ;;
>> 25) echo "$HEADER:01:$FOOTER" | sed s/"@"/" "/g ;;
>> 26) echo "$HEADER:02:$FOOTER" | sed s/"@"/" "/g ;;
>> 27) echo "$HEADER:03:$FOOTER" | sed s/"@"/" "/g ;;
>> 28) echo "$HEADER:04:$FOOTER" | sed s/"@"/" "/g ;;
>> 29) echo "$HEADER:05:$FOOTER" | sed s/"@"/" "/g ;;
>> 30) echo "$HEADER:06:$FOOTER" | sed s/"@"/" "/g ;;
>> 31) echo "$HEADER:07:$FOOTER" | sed s/"@"/" "/g ;;
>> 32) echo "$HEADER:08:$FOOTER" | sed s/"@"/" "/g ;;
>> 33) echo "$HEADER:09:$FOOTER" | sed s/"@"/" "/g ;;
>> 34) echo "$HEADER:10:$FOOTER" | sed s/"@"/" "/g ;;
>> *) echo "$HEADER:$WTIME:$FOOTER" | sed s/"@"/" "/g ;;
>> esac
>> done
>>
>> rm -f $1.temp
>>
>> #--- end of script ---
>>
>> As you can see it is very inefficient! I am trying to write something
>> in perl, but I don't know much about perl!
>>
>> If anyone could help, it would be great!
>>
>> Cheers
>>
>> Andrew
>> --------------------------------------------------------------------
>> This is the analog-help mailing list. To unsubscribe from this
>> mailing list, send mail to [EMAIL PROTECTED]
>> with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
>> --------------------------------------------------------------------
>
>--
>
>
>--------------------------------------------------------------------
>This is the analog-help mailing list. To unsubscribe from this
>mailing list, send mail to [EMAIL PROTECTED]
>with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
>--------------------------------------------------------------------
_________________________________________________________
Andrew Chung
[EMAIL PROTECTED]
LiSP Internet - Information Technology Services
2 College Road BATHURST NSW 2795
Fax: +61 (02) 63325248
Web: http://www.lisp.com.au/
--------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe analog-help" in the main BODY OF THE MESSAGE.
--------------------------------------------------------------------
