Hi,
I've been using Analog 5.2 on RedHat 7.2 (2.4 kernel / ext3) for over a year
now, and everything has been working fine, until I tried to process my March
2005 log files. I have multiple hosts that support my sites, and I always
merge all log files into one large log file, and gzip it. I then process the
one large file with analog to get my results. Up through Feb 2005, the
compressed large file has been growing to about 2.8 GB in size, but still
analog has been working fine with it. Now, with my March 2005 compressed
file, it is over 3 GB (3241590586) to be exact, and analog is now saying it
can't find my file to process it. Nothing has changed with the way I process
the files, except for the file size of the file, and of course the file name,
which has never been an issue in the past.
Here's the command line I use to kick off the job:
nice \
analog \
-G \
+g/var/row/prod/reports/config/analog.200403+.mk.all.cfg \
+C"HOSTLOWMEM 2" +C"FILELOWMEM 2" +C"BROWLOWMEM 2" +C"REFLOWMEM 2"
+C"USERLOWMEM 2" +C"VHOSTLOWMEM 2" \
+C"DNS NONE" \
+C"FROM 050301" \
+C"TO 050331" \
+C"CHARTDIR charts/all/200503.farm." \
+C"LOCALCHARTDIR /var/row/prod/reports/output/mk/charts/all/200503.farm."
\
+C"OUTPUT HTML" \
+C"OUTFILE /var/row/prod/reports/output/mk/200503.farm.html" \
+C"DEBUG ON" \
+C"ERRFILE /var/row/prod/reports/output/mk/200503.farm.err" \
+C'LOGFORMAT (%j %v %j %j %t %S %j %j [%d/%M/%Y:%h:%n:%j] %u
"%j%w%r%wHTTP%j" %c %b "%f" "%B")' \
/var/row/prod/reports/logfiles/200503.farm.wc.dm.row.access.log.gz
Here's the output in the error file:
$ more /var/row/prod/reports/output/mk/200503.farm.err
F: Opening /usr/apps/analog/5.32/analog-5.32/lang/us.lng as language file
F: Closing language file /usr/apps/analog/5.32/analog-5.32/lang/us.lng
F: Opening /usr/apps/analog/5.32/analog-5.32/lang/usdom.tab as domains file
F: Closing domains file /usr/apps/analog/5.32/analog-5.32/lang/usdom.tab
F: Opening /usr/apps/analog/5.32/analog-5.32/lang/usdesc.txt as report
descriptions file
F: Closing report descriptions file
/usr/apps/analog/5.32/analog-5.32/lang/usdesc.txt
analog: Warning F: Failed to open logfile
/var/row/prod/reports/logfiles/200503.farm.wc.dm.row.access.log.gz: ignoring
it
F: Opening /var/row/prod/reports/output/mk/200503.farm.html as output file
analog: Warning R: Turning off empty time reports
analog: Warning R: Turning off empty Request Report
analog: Warning R: Turning off empty Redirection Report
analog: Warning R: Turning off empty Failure Report
analog: Warning R: Turning off empty File Type Report
analog: Warning R: Turning off empty Directory Report
analog: Warning R: Turning off empty Host Report
analog: Warning R: Turning off empty Host Redirection Report
analog: Warning R: Turning off empty Host Failure Report
analog: Warning R: Turning off empty Domain Report
analog: Warning R: Turning off empty Referrer Report
analog: Warning R: Turning off empty Referring Site Report
analog: Warning R: Turning off empty Redirected Referrer Report
analog: Warning R: Turning off empty Failed Referrer Report
analog: Warning R: Turning off empty Browser Report
analog: Warning R: Turning off empty Virtual Host Report
analog: Warning R: Turning off empty Virtual Host Redirection Report
analog: Warning R: Turning off empty Virtual Host Failure Report
analog: Warning R: Turning off empty User Report
analog: Warning R: Turning off empty User Redirection Report
analog: Warning R: Turning off empty User Failure Report
analog: Warning R: Turning off empty Organisation Report
analog: Warning R: Turning off empty Search Query Report
analog: Warning R: Turning off empty Search Word Report
analog: Warning R: Turning off empty Internal Search Query Report
analog: Warning R: Turning off empty Internal Search Word Report
analog: Warning R: Turning off empty Browser Summary
analog: Warning R: Turning off empty Operating System Report
analog: Warning R: Turning off empty File Size Report
analog: Warning R: Turning off empty Status Code Report
analog: Warning R: Turning off empty Processing Time Report
F: Closing /var/row/prod/reports/output/mk/200503.farm.html
As you can see, it seems to be complaining about the data file not being where
I said it was. But if I do an ls on that file ...
$ ls -l /var/row/prod/reports/logfiles/200503.farm.wc.dm.row.access.log.gz
-rw-rw-r-- 1 rowroot rowroot 3241590586 Apr 6 14:30
/var/row/prod/reports/logfiles/200503.farm.w
c.dm.row.access.log.gz
It's there, as I know it is. Anyone have any ideas of what may be going on?
Thanks,
- Jeff
+------------------------------------------------------------------------
| TO UNSUBSCRIBE from this list:
| http://lists.meer.net/mailman/listinfo/analog-help
|
| Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
| List archives: http://www.analog.cx/docs/mailing.html#listarchives
+------------------------------------------------------------------------
