Thanks for the info. I guess the cache file from analog is what I need to do instead of what I guessed I could get RM to do for me - A lot of tweaking and checking that doing analog on 3 weeks of log files will produce the same as doing it on 20 days of cache files plus one log file
I wonder what other sites with our hit rates are doing... Thanks again Michel > -------- Original Message -------- > Subject: Re: [analog-help] Report Magic dot dat files from Analog > From: "Aengus" <[EMAIL PROTECTED]> > Date: Sun, March 12, 2006 1:53 pm > To: "Support for analog web log analyzer" <[email protected]> > > On Sunday, March 12, 2006 5:17 AM [EDT], > analog-help at talent-aid.org <[EMAIL PROTECTED]> wrote: > > > Hi, > > > > I seem to have missed some functionality of analog+report magic. > > I have access logs in the order of 50MB zipped (gz) per day. > > I can happily ask analog to take all http access* files in a directory > > and create a report.dat > > However I want to daily take ONE access file and create a > > report_yyyymmdd.dat and then have report magic run over whatever > > report* files I have, creating yearly, monthly and daily pages from > > ALL that year's report*.dats > > > > So I have in analog.cfg output file report_%Y%M%D.dat > > What do I do to Report Magic to have it read > > report_20060227.dat > > report_20060228.dat > > report_20060301.dat > > report_20060302.dat > > report_20060303.dat > > report_20060304.dat > > report_20060305.dat > > report_20060306.dat > > report_20060307.dat > > report_20060308.dat > > report_20060309.dat > > report_20060310.dat > > report_20060311.dat > > report_20060312.dat > > > > and create 3 weeks worth of reporting? > > I cannot believe I would have to run analog over a whole year's worth > > of log files to get a year's worth of report magic html reports > > An Analog report is a summary of the information in your logfiles. If you > combine 2 weeks of summary information, you won't get the same answer that > you would if you analyzed the whole 2 weeks of data. > > For example, a Host that visits your site every day, reading a few pages > might not show up in your daily summaries at all, because other, > occassional, visitors would check out more of your site on any given day, > pushing your persistent visitor out of the top 20. But in an analysis of > all the logs, that daily visitor would show up, because over the two weeks > they would have hit more pages than those one off visitors. > > Analog can create "summary" files that preserve most of the information that > you want (see http://analog.cx/docs/faq.html#faq157 ) though you will lose > the links between different parts of the data - you can't use a HOSTEXCLUDE > on a cache file to exclude your own traffic, for instance - you have to use > the HOSTEXCLUDE when you are creating the cache file in the first place, so > you need to decide on what you want in your reports before you create the > cache files. Asking different questions of a cache file than the ones it was > designed to answer is an unreiable process. > > You can create the cache file at the same time as you create your .dat file. > When you want to create your monthly or yearly summary, have analog read the > cache files to create a new month.dat or year.dat file - ReportMagic won't > read the cache files directly. > > Aengus > > +------------------------------------------------------------------------ > | TO UNSUBSCRIBE from this list: > | http://lists.meer.net/mailman/listinfo/analog-help > | > | Analog Documentation: http://analog.cx/docs/Readme.html > | List archives: http://www.analog.cx/docs/mailing.html#listarchives > | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +------------------------------------------------------------------------ +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +------------------------------------------------------------------------

