[analog-help] Request Report SubFloor Configuration

2008-04-18 Thread Terry Chambers
My current Request Report list looks like this:


/www.blah.com/section/page.jsp
   /www.blah.com/section/page.jsp?id=59595tab=1
   /www.blah.com/section/page.jsp?id=59595tab=2
   /www.blah.com/section/page.jsp?id=59595tab=3


I'd like the report to ignore the tab value and treat it as if all the URLs
were:

/www.blah.com/section/page.jsp?id=59595

Is there any way to do that?

If it matters, this not the only type of URL in the report.

Second, is there a way to suppress reporting of the subfloor in all cases if
we wanted to?  I see commands that allow you to control them but I am not
sure how to just turn it off.

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Command Line processing question

2008-07-14 Thread Terry Chambers
My site's log files are multiple .gz files each day (about 30 of them).  I
want to create a command line to perform the analog process.  Herei s my
example:


/analog-6.0/analog -G +g/analog/configs/analog-daily-full.cfg logfile
/www_logs/2008/07/09/*.gz O /www_reports/daily/20080709.html


When I execute this, Analog complains that it cannot understand the log
format of the files.

When I embed the location of the LOGFILE and OUTFILE into the CFG file, it
works fine.

Is there a problem with my command line?  Is the problem in my config file
itself?

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Weekly and Monthly Reports

2008-08-08 Thread Terry Chambers
Our site produces about 1 GB of logs per day so I have them organized into
directories like this:

2008/08/01
2008/08/02
etc

In each directory are about 100 logs in .gz format

I can easily produce a report for a single day.

If I want to produce a report for a week, how would I go about specifying
all of the logs to process?  For example, if I wanted to process all the
logs in 2008/08/01 - 2008/08/08, how would I do that?

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Running multiple reports on the same server

2008-08-13 Thread Terry Chambers
We have a powerful Solaris server that has Analog installed on it (32GB of
RAM).  I have read the threads and it seem that Analog will only use 4GB of
RAM unless you recompile it and change the memory settings.

I am wondering what would happen if we ran Analog multiple times on the
server.  So far I have built configs and command lines for 5 different
reports that I'd like run daily but I am scheduling them at intervals to
prevent any issues.

Any thoughts / opinions?  Will multiple instances use the same 4GB of RAM or
will the O/S distribute it out evenly?

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Monthly Report

2008-09-03 Thread Terry Chambers
I've got my logs being dropped into directories such that each day of logs
have their own location.

e.g.

2008/09/01
2008/09/02

etc.

I currently run only daily and weekly reports.  I've used the command line
to specify 7 different log file paths and that works.

If I want to run a monthly report, will the command line accept 31 log file
paths?  Or will I need to write a script to either copy/move the log files
into fewer directories?

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Suppressing reporting of paramters on a URL

2008-09-26 Thread Terry Chambers
We have a web page that received almost 1 million hits yesterday.  It is a
JSP page that takes parameters to determine how to display the page.   The
most common combination had 3000 hits.  Our Request report is showing detail
right down to 10 users requesting a specific combination.  I cannot seem to
understand how the REQARGSFLOOR works.  The example is 0.1%b and I can't
seem to figure out what that means.

I would like to see it return on only hits that receive 1000+ hits or
suppress it entirely so that you only see the total number of hits for the
JSP.

Can you help me?

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Help with Log file format

2008-10-08 Thread Terry Chambers
Hello

My log file format is the following:

%vsid% - %Ses-client.ip% - %Req-vars.auth-user% [%SYSDATE%]
%Req-reqpb.clf-request% %Req-srvhdrs.clf-status%
%Req-srvhdrs.content-length% %Req-headers.host% %Req-headers.referer%
%Req-headers.user-agent%

Here is an example entry:

https-www-80 - 127.0.0.1 - - [06/Oct/2008:16:00:01 -0700] GET
/servlet/SG/update/ucv=1.1version=9.99language=enu HTTP/1.0 404 292 - -
Mozilla/1.22 (Windows; U; 32bit)



I tried the following two LOGFORMAT settings and an error was flagged at
GET.

LOGFORMAT (%S - %s - - [%d/%M/%Y:%h:%n:%j %j] %r %c %b %S %f %B
LOGFORMAT (%S - %s - - [%d/%M/%Y:%h:%n:%j %j] GET %r %c %b %S %f %B

Can you please help me to format my LOGFORMAT statement correctly?

Note - I tried the default settings and many log entries were processed but
many were not.  This is what led me to craft my own LOGFORMAT statement.

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Control over what is an error

2008-10-08 Thread Terry Chambers
Is it possible to control what Analog counts as a 'failure?  We would like
to count Status Code 302 as a success rather than a failure, in one of our
reports.  Is that possible?

I don't see anything about that in the documentation so I am guessing the
answer is no but wanted to check with the experts.

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] 64-bit compiling for Unix

2009-01-12 Thread Terry Chambers
We have Analog running on a Solaris server with 32GB of RAM.  Our log files
(over 5 GB zipped for one day of data) are now causing Analog to run out of
memory.  The reports ran fine when we had 3.5 GB of data but not now.

The only information I can find on recompiling for 64-bit is to add a single
line item to the Makefile.  Is it as simple as that?  Has anyone done it
successfully?

Thanks
Terry
+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Re: Reporting on elements in the request line

2009-11-10 Thread Terry Chambers
Aengus analo...@... writes:

 As far as I can tell, INTSEARCHENGINE will only take the first entry in the
.cfg file, if you specify the same
 Engine with multiple parameters. So you can see either the q, client or site
field in any one report, you
 can't get them all in the same report.
 
 And you'll probably need to add
   INTSEARCHQUERY ON
 to see anything
 
  Note that Analog does not do multivariate reports so you won't be
  able to get a report of site parameter by client, for example.
 
 Actually, in this case you _might_ be able to do something like that with some
FILEALIAS commands. 
 
 FILEALIAS /search?*client=**site=** /$4?$2
 
 would give you a Request Report that showed how many requests were made by
each client type to each site.
 
 Aengus
 

Hi Aengus - using the INTSEARCHENGINE and INTSEARCHQUERY options, the report
came through correctly.  Thanks!

Using the FILEALIAS also works to break down the data, which is also great!

If I wanted to have BOTH the Internal Search report and also break the Request
report down this way, is there an option to allow that?  I am guessing no since
the Internal Search report goes away if I add the Filealias line in.

Thanks for the suggestions!
Terry

+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+


[analog-help] Re: Reporting on elements in the request line

2009-11-11 Thread Terry Chambers
Jeremy Wadsack jeremy.wads...@... writes:

 
 
 On Tue, Nov 10, 2009 at 2:40 PM, Aengus
analo...@eircom.net wrote:
 
 FILEALIAS /search?*client=**site=** /$4?client=$2
 
 
 Also, note that depending on your backend code and how the URL's are created
you may need to use two FILEALIAS commands to catch all of this:
 FILEALIAS /search?*client=**site=** /$4?client=$2
 FILEALIAS /search?*site=**client=** /$2?client=$4You could check your
server logs and see if the parameters ever change order.--Jeremy Wadsack 
 


The parameters do change order and there can be any number of parameters in the
middle or before.

Also, for the Internal Search report, I want to report off of the q value so
it looks like I'll have to run two separate reports to get that data since the
FILEALIAS mangles things up for that.

Thanks for the assistance and guidance.

Terry

+
|  TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
|  Analog Documentation: http://analog.cx/docs/Readme.html
|  List archives:  http://www.analog.cx/docs/mailing.html#listarchives
|  Usenet version: news://news.gmane.org/gmane.comp.web.analog.general
+