Thanks very much Aengus. That explains the situation exactly. The animals-fr.htm figures threw me. However, we did change the contents of the framed URL recently which will explain the variation.
Thanks again Nerissa Murphy Web Communications Officer Moreland City Council, 90 Bell Street, Coburg 3058 Locked Bag 10, Moreland 3058 Phone: 9240 2424 Fax: 9240 1130 Email: [EMAIL PROTECTED] -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of [EMAIL PROTECTED] Sent: Tuesday, 18 September 2007 11:50 AM To: [email protected] Subject: analog-help Digest, Vol 37, Issue 14 Send analog-help mailing list submissions to [email protected] To subscribe or unsubscribe via the World Wide Web, visit http://lists.meer.net/mailman/listinfo/analog-help or, via email, send a message with subject or body 'help' to [EMAIL PROTECTED] You can reach the person managing the list at [EMAIL PROTECTED] When replying, please edit your Subject line so it is more specific than "Re: Contents of analog-help digest..." Today's Topics: 1. Re: Analyze CSV File (Aengus) 2. RE: Analyze CSV File (Raj Hungund) 3. Re: Analyze CSV File (Aengus) 4. RE: Analyze CSV File (Raj Hungund) 5. Re: Analyze CSV File (Aengus) 6. Re: Analyze CSV File (Aengus) 7. Statistics for framed pages (Nerissa Murphy) 8. Re: Statistics for framed pages (Aengus) ---------------------------------------------------------------------- Message: 1 Date: Mon, 17 Sep 2007 15:04:14 -0400 From: "Aengus" <[EMAIL PROTECTED]> Subject: Re: [analog-help] Analyze CSV File To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Raj Hungund <[EMAIL PROTECTED]> wrote: > Hey all, I was wondering if Analog can analyze CSV data. We are > getting log files for another type of service. > > The first line of the csv file are some field names: > REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER PRODUCT PROVIDER KEY TITLE > > Is there a way for Analog to decipher this information and put it into > a web type report? I don't see not. What happened when you created a custom logformat mapping the fields that are useful to you into fields that Analog recognises? Aengus ------------------------------ Message: 2 Date: Mon, 17 Sep 2007 12:08:49 -0700 From: "Raj Hungund" <[EMAIL PROTECTED]> Subject: RE: [analog-help] Analyze CSV File To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="US-ASCII" I haven't tried it yet...just wondering if it could be done =) Should I just research custom logformatting? -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Aengus Sent: Monday, September 17, 2007 12:04 PM To: Support for analog web log analyzer Subject: Re: [analog-help] Analyze CSV File Raj Hungund <[EMAIL PROTECTED]> wrote: > Hey all, I was wondering if Analog can analyze CSV data. We are > getting log files for another type of service. > > The first line of the csv file are some field names: > REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER PRODUCT PROVIDER KEY TITLE > > Is there a way for Analog to decipher this information and put it into > a web type report? I don't see not. What happened when you created a custom logformat mapping the fields that are useful to you into fields that Analog recognises? Aengus +----------------------------------------------------------------------- +- | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html List | archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +----------------------------------------------------------------------- +- ------------------------------ Message: 3 Date: Mon, 17 Sep 2007 15:26:24 -0400 From: "Aengus" <[EMAIL PROTECTED]> Subject: Re: [analog-help] Analyze CSV File To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Raj Hungund <[EMAIL PROTECTED]> wrote: > I haven't tried it yet...just wondering if it could be done =) > > Should I just research custom logformatting? You could post an example of the actual data. But just at a wild guess LOGFORMAT (%j %y:%m:d %h:%n:%j %u %r %f %j %B) might work (though I have no idea how your PLAY_DATE and PLAY_TIME fields are laid out, so they probably won't match, and Analog might spit out the referrer and Borwser fields because they aren't formatted properly). Logformats are documented at http://analog.cx/docs/logfmt.html Aengus ------------------------------ Message: 4 Date: Mon, 17 Sep 2007 12:48:52 -0700 From: "Raj Hungund" <[EMAIL PROTECTED]> Subject: RE: [analog-help] Analyze CSV File To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="US-ASCII" Here's the full string: REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER MAC_ADDRESS PRODUCT PROVIDER ASSET_KEY TITLE AUSTIN 1-Jul-07 0:00:23 XXXXXX XXXXXXX ProductName XXXX XXXXX Some Title Thanks! -----Original Message----- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Aengus Sent: Monday, September 17, 2007 12:26 PM To: Support for analog web log analyzer Subject: Re: [analog-help] Analyze CSV File Raj Hungund wrote: > I haven't tried it yet...just wondering if it could be done =) > > Should I just research custom logformatting? You could post an example of the actual data. But just at a wild guess LOGFORMAT (%j %y:%m:d %h:%n:%j %u %r %f %j %B) might work (though I have no idea how your PLAY_DATE and PLAY_TIME fields are laid out, so they probably won't match, and Analog might spit out the referrer and Borwser fields because they aren't formatted properly). Logformats are documented at http://analog.cx/docs/logfmt.html Aengus +----------------------------------------------------------------------- +- | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html List | archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +----------------------------------------------------------------------- +- ------------------------------ Message: 5 Date: Mon, 17 Sep 2007 16:35:47 -0400 From: "Aengus" <[EMAIL PROTECTED]> Subject: Re: [analog-help] Analyze CSV File To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Raj Hungund <[EMAIL PROTECTED]> wrote: > Here's the full string: > > REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER MAC_ADDRESS PRODUCT PROVIDER > ASSET_KEY TITLE AUSTIN 1-Jul-07 0:00:23 XXXXXX XXXXXXX ProductName > XXXX XXXXX Some Title Which fields do you actually care about? Do you care about the Region? Do you need both Account Number and MAC address? What's the different between Product and Title? If I throw away the Region field, and use the Account number as the User field, the Product as the Virtual Host field, and the Title field as the Request field, I get something like this: Region: %j Play_Date: %d-%M-%y Play_Time: %h:%n:%j Account Number: %u MAC Address: %j Product: %v Provider: %j Asset_Key: %j Product Name: %r Your data is Tab delimited, which can make for a cluttered LOGFORMAT string, like this: LOGFORMAT (%j\t%d-%M-%y\t%h:%n:%j\t%u\t%j\t%v\t%j\t%j\t%r) If you turn on the User Report (USER ON) and the Virtual Host Report (VHOST ON), and set the appropriate "floors", then you'll get something useful in the report. Add these commands USER ON VHOST ON VHOSTFLOOR 1r VHOSTSORTBY R REQFLOOR 1r Aengus > > Thanks! > > -----Original Message----- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of Aengus > Sent: Monday, September 17, 2007 12:26 PM > To: Support for analog web log analyzer > Subject: Re: [analog-help] Analyze CSV File > > Raj Hungund wrote: >> I haven't tried it yet...just wondering if it could be done =) >> >> Should I just research custom logformatting? > > You could post an example of the actual data. But just at a wild guess > > LOGFORMAT (%j %y:%m:d %h:%n:%j %u %r %f %j %B) > > might work (though I have no idea how your PLAY_DATE and PLAY_TIME > fields are laid out, so they probably won't match, and Analog might > spit out the referrer and Borwser fields because they aren't formatted > properly). > > Logformats are documented at http://analog.cx/docs/logfmt.html > > Aengus > > > +--------------------------------------------------------------------- > +-- > +- >> TO UNSUBSCRIBE from this list: >> http://lists.meer.net/mailman/listinfo/analog-help >> >> Analog Documentation: http://analog.cx/docs/Readme.html List >> archives: http://www.analog.cx/docs/mailing.html#listarchives >> Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +--------------------------------------------------------------------- > +-- > +- > > +--------------------------------------------------------------------- > +--- >> TO UNSUBSCRIBE from this list: >> http://lists.meer.net/mailman/listinfo/analog-help >> >> Analog Documentation: http://analog.cx/docs/Readme.html List >> archives: http://www.analog.cx/docs/mailing.html#listarchives >> Usenet version: news://news.gmane.org/gmane.comp.web.analog.general > +--------------------------------------------------------------------- > +--- ------------------------------ Message: 6 Date: Mon, 17 Sep 2007 16:51:37 -0400 From: "Aengus" <[EMAIL PROTECTED]> Subject: Re: [analog-help] Analyze CSV File To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Aengus <[EMAIL PROTECTED]> wrote: > Raj Hungund <[EMAIL PROTECTED]> wrote: >> Here's the full string: >> >> REGION PLAY_DATE PLAY_TIME ACCOUNT_NUMBER MAC_ADDRESS PRODUCT >> PROVIDER ASSET_KEY TITLE AUSTIN 1-Jul-07 0:00:23 XXXXXX XXXXXXX >> ProductName XXXX XXXXX Some Title > > Which fields do you actually care about? Do you care about the Region? > Do you need both Account Number and MAC address? What's the different > between Product and Title? > > If I throw away the Region field, and use the Account number as the > User field, the Product as the Virtual Host field, and the Title field > as the Request field, I get something like this: > > Region: %j You can report on the Regions as well by using the Browser report. Use %B instead of %j > Play_Date: %d-%M-%y > Play_Time: %h:%n:%j > Account Number: %u > MAC Address: %j > Product: %v > Provider: %j > Asset_Key: %j > Product Name: %r Add these lines to your analog.cfg: LOGFORMAT (REGION%j) LOGFORMAT (%B\t%d-%M-%y\t%h:%n:%j\t%u\t%j\t%v\t%j\t%j\t%r) LOGFILE cvs.log REQFLOOR 1r USER ON VHOST ON VHOSTFLOOR 1r VHOSTSORTBY requests (**** I had this wrong in the original message) FULLBROWSER ON FULLBROWFLOOR 1r FULLBROWSORTBY requests You can turn off any reports that aren't useful. Analog.cx/docs/hierreps.html Analog.cx/docs/timereps.html Analog.cx/docs/othreps.html Aengus ------------------------------ Message: 7 Date: Tue, 18 Sep 2007 08:03:54 +1000 From: "Nerissa Murphy" <[EMAIL PROTECTED]> Subject: [analog-help] Statistics for framed pages To: <[email protected]> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; charset="us-ascii" Hi there We currently have a framed website. I'd like to confirm if the number of accesses to framed pages in the statistics is in addition to the nested pages. The animals.htm example below would seem to indicate it is in addition to the framed page. I understand it's not so clear cut, but any information or explanatory note would be appreciated. Examples 708: : /services/wasteandrecycling-fr.htm <http://www.moreland.vic.gov.au/services/wasteandrecycling-fr.htm> (framed page) 736: /services/wasteandrecycling.htm <http://www.moreland.vic.gov.au/services/wasteandrecycling.htm> (nested page) 537: : /services/animals-fr.htm <http://www.moreland.vic.gov.au/services/animals-fr.htm> (framed page) 333: : /services/animals.htm <http://www.moreland.vic.gov.au/services/animals.htm> (nested page) Regards Nerissa Murphy Web Communications Officer Moreland City Council, 90 Bell Street, Coburg 3058 Locked Bag 10, Moreland 3058 Phone: 9240 2424 Fax: 9240 1130 Email: [EMAIL PROTECTED] Please consider the environment before printing this e-mail. ----------------------------------------------------------------- Any personal or sensitive information contained in this e-mail and attachments must be handled in accordance with the Information Privacy Act 2000 (Victoria), the Health Records Act 2001 and the Privacy Act 1988 (Commonwealth), as applicable. This e-mail, including all attachments, is confidential. If you are not the intended recipient, any use, disclosure or copying of this e-mail is unauthorised. If you are not the intended recipient of this e-mail, please immediately notify Moreland City Council [EMAIL PROTECTED] or telephone (03) 9240 1111 and then delete this e-mail. Any personal comments contained within this e-mail are those of the sender and do not necessarily represent the views of Moreland City Council. Moreland City Council has attempted to make this e-mail and any attachments free from viruses but cannot provide an assurance that this e-mail or any attachments are free of viruses and accepts no liability. ------------------------------------------------------------------ -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.meer.net/pipermail/analog-help/attachments/20070918/eaf5a68 0/attachment-0001.html ------------------------------ Message: 8 Date: Mon, 17 Sep 2007 21:45:58 -0400 From: "Aengus" <[EMAIL PROTECTED]> Subject: Re: [analog-help] Statistics for framed pages To: "Support for analog web log analyzer" <[email protected]> Message-ID: <[EMAIL PROTECTED]> Content-Type: text/plain; format=flowed; charset=iso-8859-1; reply-type=original On Monday, September 17, 2007 6:03 PM [EDT], Nerissa Murphy <[EMAIL PROTECTED]> wrote: > Hi there > > We currently have a framed website. I'd like to confirm if the number > of accesses to framed pages in the statistics is in addition to the > nested pages. The animals.htm example below would seem to indicate it > is in addition to the framed page. I understand it's not so clear cut, > but any information or explanatory note would be appreciated. Analog isn't aware of any particular relationship between any two objects on your website - it doesn't know anything at all about your website, it's only concerned about what is recorded in your logfiles. That's an important distinction, because if, for example, you have pages on your site that have never been visited, then they're not listed in your logfile, and Analog will never include them in any reports. In the same way, Analog has no way of knowing that a particluar page contains a FRAME statement, and wouldn't know what to do with the information anyway. > Examples > > 708: : /services/wasteandrecycling-fr.htm > <http://www.moreland.vic.gov.au/services/wasteandrecycling-fr.htm> > (framed page) > 736: /services/wasteandrecycling.htm > <http://www.moreland.vic.gov.au/services/wasteandrecycling.htm> > (nested page) The normal sequence of events when a user requests a page that has a FRAME statement is the browser requests the main (framing) page, and then requests the page or pages that are listed in the FRAME statements. So there wil be at least 2 requests recorded in your servers log files (in your case, you actually have 3 FRAME statements, the top and left frame, as well as the content frame, so there should be 4 entries in the log whenever a browser requests the framing page). Without aything more to go on, it would be reasonable to interpret these two lines as 708 requests for the framing page, which would usually lead to 708 requests for the framed page, and an additional 28 requests for that page directly - every request for the framing page should cause a request for the framed page, but it is also possible to call the page directly, without it's frame. > 537: : /services/animals-fr.htm > <http://www.moreland.vic.gov.au/services/animals-fr.htm> (framed > page) > 333: : /services/animals.htm > <http://www.moreland.vic.gov.au/services/animals.htm> (nested page) This example doesn't fit into that explanation, because you have more requests for the framing page than for the framed page - that shouldn't normally happen. The only obvious explanation is that the framing page was changed at some point, and that it used to frame a different page, so that the framing page has been called for a longer period of time than the currently listed framed page. There may be additional information in your logfiles that can provide greater insight. If you are logging the referrer field, you can run a report than only include the framing page, to see how many of the requests for the framed page were generated when the browser loaded the framing page first. REFINCLUDE http://www.moreland.vic.gov.au/services/wasteandrecycling-fr.htm should generate a Request Report that shows 708 requests for /services/wasteandrecycling.htm (and for the top and left frames, though they may already be cached in the browser, and may not be requested again). REFINCLUDE http://www.moreland.vic.gov.au/services/animals-fr.htm might give some indication of why that framing page was requested more often than the page that it is framing. Aengus ------------------------------ +----------------------------------------------------------------------- +- | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general | List archives: http://www.analog.cx/docs/mailing.html#listarchives +----------------------------------------------------------------------- +- End of analog-help Digest, Vol 37, Issue 14 ******************************************* Please consider the environment before printing this e-mail. ----------------------------------------------------------------- Any personal or sensitive information contained in this e-mail and attachments must be handled in accordance with the Information Privacy Act 2000 (Victoria), the Health Records Act 2001 and the Privacy Act 1988 (Commonwealth), as applicable. This e-mail, including all attachments, is confidential. If you are not the intended recipient, any use, disclosure or copying of this e-mail is unauthorised. If you are not the intended recipient of this e-mail, please immediately notify Moreland City Council [EMAIL PROTECTED] or telephone (03) 9240 1111 and then delete this e-mail. Any personal comments contained within this e-mail are those of the sender and do not necessarily represent the views of Moreland City Council. Moreland City Council has attempted to make this e-mail and any attachments free from viruses but cannot provide an assurance that this e-mail or any attachments are free of viruses and accepts no liability. ------------------------------------------------------------------ +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +------------------------------------------------------------------------
