was
requested by you, and that you were told to load that image by the analog.cx
page.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http
dynamic content not
being counted as a Page Request.
Sorry I can't give a cut and dried answer here - this is exactly the sort of
problem that Analog is really good at solving, once you know the right
questions to ask of your log files.
Hope that helps,
Aengus
.
(And I don't know whether there are any issues compiling Analog in Visual
Studio - I haven't tried it).
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog
don't want it anymore, just delete the Analog directory/folder.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
the problem? I don't understand what
you're trying to do, and what you expect to get, versus what you're actually
getting.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
.
(Tab delimited log files are almost impossible to debug - you have to
change the tabs to spaces in a sample line, and the \t to %w in the
LOGFORMAT to have any chance of figuring out what Analog doesn't like).
Aengus
At Friday, February 29, 2008 9:52 PM, The Wolf [EMAIL PROTECTED] wrote:
That's unfortunate. Still, I guess I can make a awk script to ignore
that part.
No need to do that - just specify %j in the LOGFORMAt - that's what I did!
Aengus
/index.html HTTP/1.1
200
LOGFORMAT (%S %u %j %v [%d/%M/%Y:%h:%n:%t %j] %j %r %j %c)
VHOSTINCLUDE server1
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog
, without indicating which entries belong to which server.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List
have Analog do the DNS lookups
by adding these entries to your analog.cfg file:
DNSFILE dnscache
DNS WRITE
http://analog.cx/docs/dns.html
http://analog.cx/docs/reports.html
Aengus
+
| TO UNSUBSCRIBE from this list
describe above - .jpg is usually a static file
type. But a useful sanity check would be to see what Analog shows as the number
of requests for the page that the .jpg file is embedded in. Is it more in line
with the 4297 number or the 100121 number?
Aengus
/index.cfm?content=include/event_calendar_site.cfm*
calendar.cfm$1
(I'm assuming that the http://bnn part isn't in your log file. If it
is, you can just put * before the /index.cfm part)
If you don't care about the additional parameters after the , you can
leave the $1 out.
Aengus
home page are.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs
story.cfm
and event_calendar_site.cfm requests will not be included with everything else
in the index.cfm count - they'll be seperate entries in the Request Report,
with their own Page count columns.
Aengus
+
| TO UNSUBSCRIBE
will tell
analog to ignore all the log entries except for the story and calendar
entries, and that should give you what you want.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo
;+Windows+NT+5.1;+.NET+CLR+1.1.4322)
200 0 0
I can interpret this one as:
LOGFORMAT (%Y-%m-%d %h:%n:%j %S %j %j - %j - %s %j %j %j)
LOGFORMAT (%Y-%m-%d %h:%n:%j %j %j %j %r - %j - %S %A %c %j)
Should I list both formats?
If you're using both logfiles, you'll need to list both logformats.
Aengus
typically aren't reported. If you're
talking about the description at the top of each report (for example Listing
the top 30 files by the number of failed requests, sorted by the number of
failed requests.) then, no, I don't remember that there's a way to suppress
that.
Aengus
://www.maxmind.com/download/geoip/api/
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http
.
I want to make clear that ,those who are interested in
Browser-report or OS-report should not follow this patch.
After thinking over every possible way I choose to
replace OS-report and Browser-report with GeoIP-report.
Aengus suggested to use DNS look-up for GeoIP
REFSORTBY ALPHABETICAL
http://analog.cx/docs/othreps.html#SORTBY
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
one who has the source, and he or she
doesn't seem to be interested in fixing it.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx
with the fact that only some of your
entries have a VHost entry:
LOGFORMAT (%S - - [%d/%M/%Y:%h:%n:%j %j] %j %r %j %c %b %j %f %j %B)
LOGFORMAT (%S - - [%d/%M/%Y:%h:%n:%j %j] %j %r %j %c %b %j %f %j %B %j %v)
Aengus
Hajj abujamal [EMAIL PROTECTED] wrote:
Salaam!
Aengus wrote:
(Can you give me one or 2 examples of IP addresses that cause QDNS
to choke in this way?)
20160835 38.118.71.121 *.upiasiaonline.com
18459349 193.225.86.51 *.cicero.itak.sztaki.hu
18459204 202.140.141.30 *.enetmall.com
actually part of the Browser and Referrer strings.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives
turned up, and how many times user 2, etc.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http
On 5/30/2008 7:13 AM, Sergiusz Pawlowicz wrote:
Hi, how can i setup analog to show me amount of data served monthly?
Turn on the Monthly Report (MONTHLY ON) and make sure that the Bytes
column is displayed (MONTHCOLS BR).
Aengus
the latest logfiles
into the process.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http
of Analog in a different directory
on the server, and see if that works - it won't even require a reboot of the
server :-).
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
(EMSC) website spikes in the immediate aftermath of a tremor,
and by using GEO-IP techniques to map the IP addresses, researchers can
locate the area where the earthquake occurred.
http://technology.newscientist.com/channel/tech/mg19826626.300-web-hits-used-to-pinpoint-earthquakes.html
Aengus
. There's a list from may 2007 at
http://www2.owen.vanderbilt.edu/mike.shor/diversions/analog/RobotInclude.txt
You might want to do a report with FILEINCLUDE /robots.txt, which should
give you a good indication of which search engines are hitting your site.
Aengus
be built-in to Analog. The
decisions that you might make today to do this analysis on your site
might be different for someone else, and might be different in a few
months time, as the list of search engines change.
Aengus
of information you're actually interested in.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http
that you posted.
What do you mean when you say that the output.html file generated is
not proper?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation
chart warnings occur because all of your sample lines
come from the same IP address, and request the same file, so there is only one
entry, therefore Analog doesn't generate a Pie Chart.
Aengus
+
| TO UNSUBSCRIBE from this list
/docs/othreps.html#CHARTDIR
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx
.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html
/logfile.html#datecodes
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs
with Solaris on a regular
basis, and 4G would be much more restrictive today that it was then, but is
there any chance that this might a Solaris issue?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net
.
/analog-6.0/analog -G +g/analog/configs/analog-daily-full.cfg
/www_logs/2008/07/09/*.gz +O/www_reports/daily/20080709.html
http://analog.cx/docs/syntax.html
http://analog.cx/docs/indx.html#clargs
Aengus
+
| TO UNSUBSCRIBE
: A
HREF=http://www.oursite.com;IMG
SRC=http://www.oursite.com/graph;/a
If I follow Stephen's recommendation, the report will only count
clicks on the graph, not just requests for an updated image?
Yes.
Aengus
the type of log file that
you're taking about, then you may be able to use Ananlog to coax some
information from the data in the log files, but it's not a natural fit, and
won't work out of the box.
If that's not what you mean by trasnfer.logs, can you expand on your question?
Aengus
make a small modification to the
configuration and then run a new report to see what the differences are. Analog
can easily crunch through a million lines of log files in under a minute, so
you can very quickly see the difference as you change configuration options.
Aengus
access logs. If you're
not dealing with standard web server log files, and don't have time to read the
documentation, then Analog isn't for you.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman
to analyis a couple of weeks worth of such logs in a single report.
If you need to do something like that, Analog can summarise teh
information in log files into a cache file that will allow it to
generate reports on very large amounts of data.
Aengus
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html
- network file access is usually oders of magnitude
slower than local access, and the overhead of unzipping the files is a lot less
than the delay in network access.
This is particularly true if you are likely to be running many different
reports, with changing parameters.
Aengus
, but they can be complex, and you can make mistakes if you're not
careful.
http://analog.cx/docs/cache.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation
are using the User Report already, you can also repurpose the Virtual
Host report in the same way. (You might be able to do something with the
Browser Report too).
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
making assumptions, you can start by
admitting that if you change your assumptions, you're going to get
different answers, even if you start with the same data.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
commands might
work, as it should cause the i records to be matched as junk before
they are parsed as real records.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog
can't use Wild cards to just specify a subest of logfiles to analyse,
you can tell Analog to ignore all requests that fall outsite a specific time
range using the FROM and TO commands.
http://analog.cx/docs/include.html#FROMTO
Aengus
can have multiple LOGFILE commands, or you can specify multiple
logfiles on the command line, if that's how you run Analog
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
code (Permanent Redirection), then
you'll need to look at the
User Redirection Report to see the local users.
REDIRUSER ON
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
Report - Local Requests
User Redirection Report - Remote Requests
Request Report - Database Usage
You can modify the .lng file in the lang folder
http://analog.cx/docs/output.html#LANGUAGE
Note that the default language is uk.lng.
Aengus
in the Request Report, then you'll have
to modify the Response Code to be 200.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
success by ignoring the Status Code altogether (marking it
as %j in the LOGFORMAT), but that depends on whether you are paying any
attention to requests other than 200s and 301s.
Aengus
+
| TO UNSUBSCRIBE from this list
Brian Clanton [EMAIL PROTECTED] wrote:
Is it possible to produce an html webpage for output AND create a
deliminted file that can be exported intp a spreadsheet?
One output per run.
The Analog README suggests it is either one or the other.
http://analog.cx/docs/faq.html#faq153
Aengus
get a list of all the Users (IP addresses or UserIDs) that
accessed a single page, but you can't get a single report that shows every
request made by every user.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
). There are
no configuration options for these buckets - you would have to change
the source code to change the bucket sizes.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog
.
They look more like the Floors to me (top 50 Users, by Requests, and all
Request with more than 1 request.
I don't know if there's any way to turn that off.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
entry in the filesize report, and
run Analog against just those lines. If the results don't make sense,
post the lines here and see if other people get the same results.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
- it's not even logged in most cases.
For those sites that care more about inbound than outbound bandwidth,
it's easy to modify the LOGFORMAT to report on it.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
at the same time in Analog.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs
testApp/1.0; Win32 testApp/1.0; (Windows NT 5.1)
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives
judgement about what metrics might
make sense for that particular website.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs
simple way that I can think to what you want to do
without modifying the CSS.
http://analog.cx/docs/output.html#LOGO
(Maybe you could do something with a dummy Virtual Host Report, and a
dummy logfile with a single link to your text file).
Aengus
. If
you use something else to define a page, then you need to tell Analog about it.
http://analog.cx/docs/include.html#PAGEINCLUDE
Aengus
- Original Message
From: Aengus [EMAIL PROTECTED]
To: Support for analog web log analyzer analog-help@lists.meer.net
Sent: Friday, August 29, 2008
/*
etc.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs/mailing.html
it by
looking at the details of some of the log entries that show high %T values.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs
, with it's high speed connection, would just spit out the
whole transaction faster than the client could accept it.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
the existing code as a 64-bit binary, then it'd
be a simple task for them. If it involves any significant code changes
to Analog, then there is very little history of such work being handled
on this list.
Aengus
Ulf Hofemeier [EMAIL PROTECTED] wrote:
Quoting Aengus [EMAIL PROTECTED]:
Ulf Hofemeier [EMAIL PROTECTED] wrote:
Hi folks:
I could use some help figuring out the correct syntax for a new
LogFormat line in my analog.cfg file after changing the LogFormat
settings for Apache a few weeks ago
\
\%{User-Agent}i\)
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx/docs
)
Are these lines in your .cfg file for a reason?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http
/%Y:%h:%n:%j] %j %r %j %c %b %f %B)
DEBUG ON
You should be able to delete the other 12 lines from your .cfg file, as they
don't appear to be doing anything useful (I'd be particularly concerned about
that LOGFILE line - are you counting access_log.-??.gz and log--??.gz?
Aengus
, though
it included links to specific versions of the various tools that may or
may not be still available, but I imagine that the current versions of
the various components would do the just just fine.
http://lists.meer.net/pipermail/analog-help/2007-January/020117.html
Aengus
the
argument is too long, and Analog ignores the end of it.
You want +gc:\analog\rgraph-analog.cfg, with a lower-case g.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog
the -G
turns off the default.cfg file, and you can use +g to turn on your other.cfg
file (you can have multiple +g commands).
http://analog.cx/docs/syntax.html#specialcfgs
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
anlgform.pl? What's the
HTTP Status code in your log file for that request?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs
LOGFORMAT string, rather than relying on Analog to do the translation
for you.
Try this LOGFORMAT
(%S %j %u [%d/%M/%Y:%h:%n:%j] %j %r %j %c %b %f %B%j %D)
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman
[%d/%M/%Y:%h:%n:%j] %j %r %j %c %b %f %B%j %D)
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives
, but give it a try.
Solo analogico genera output quando si esegue esso. Per avere analogico
eseguito automaticamente in un determinato periodo di tempo ogni giorno, è
possibile utilizzare il cron comando.
http://analog.cx/docs/faq.html#faq150
Aengus
not to use Analog? If Analog doesn't deliver on some of your
needs today, it's probably not going to change significantly at this point. On
the other hand, if you have a good idea what you want to get from your log
files, and Analog delivers on those needs, then it's going to keep delivering.
Aengus
indicates that it's a bit more usable at this point.
If I had the time (and a pressing need), I'd invest an afternoon in trying to
get it working, but I think I'll leave it on the to-do list for now :-)
Aengus
+
| TO UNSUBSCRIBE
there.
What am I doing wrong?
http://analog.cx/docs/faq.html#faq101
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
with my
LOGFORMAT statement? Why some of the reports didn't give meaningful
information?
Can you describe the problem that you are having with the reports in greater
detail?
Aengus
+
| TO UNSUBSCRIBE from this list
Leung, Michael [EMAIL PROTECTED] wrote:
Aengus,
The below is what we see for the Domain Report, but it is not what we
are expecting.
Listing domains, sorted by the amount of traffic.
reqs %bytes domain
655193 100% [unresolved numerical addresses]
Even it is entirely based on IP
, using Analogs built-in lookups
wouldn't be the best idea. For learning about DNS lookups, a sample from
the logfile of a few hundred lines would be a better idea. For DNS
lookups on anything larger than that, you really need to use one of the
the DNS helper apps.
Aengus
On 12/1/2008 6:55 PM, Leung, Michael wrote:
Based on my LOGFORMAT, my Referrer field shouldn't be empty. Right?
The sample logfile entry that you provided had a referrer field
(https://www.networksolutions.com/manage-it/private-registration-splash.jsp)
Aengus
to someone at
rcn.com.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation: http://analog.cx/docs/Readme.html
| List archives: http://www.analog.cx
- top 20 by requests, by page views,
by bandwidth, requests in the last 7 days, etc.
To see the top 20 requests, by bytes transferred, you'd use
REQFLOOR -20b
To see the top 20 requests, by page views, over the last 7 days, you'd use
REQFLOOR -20q
http://analog.cx/docs/othreps.html#FLOOR
Aengus
). Turn it on with
HOST ON
The full list of reports that Analog can produce is listed here:
http://analog.cx/docs/reports.html#repoth
The list of commands for turning these different reports on and off is here:
http://analog.cx/docs/output.html#replist
Aengus
Leung, Michael [EMAIL PROTECTED] wrote:
REQARGFLOOR 100%r
That should be
REQARGSFLOOR 100%r
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman/listinfo/analog-help
|
| Analog Documentation
/search?q=analog+6.0;
because Google is one of the searchengines listed in sample analog.cfg file:
SEARCHENGINE http://*google.*/* q,as_q,as_epq,as_oq
When I run Analog against this 1 line logfile, I get the Search and Internal
Search Reports.
Aengus
is it possible to get the report as Vista under the
OS report and how it can be done?
http://lists.meer.net/pipermail/analog-help/2008-October/021339.html
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman
have posted modified binaries that you can download
from their own websites. None of the binaries available from
www.analog.cx have this support.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net/mailman
Windows NT 6.0 Windows Vista will it work?
I don't think that's ever come up on the list - have you tried it? It
should only take a couple of seconds.
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net
of the patches mentioned earlier. You can download a copy of
the modified executable for Windows here:
http://www.xs4all.nl/~jfeelder/downloads/analog.exe
Aengus
+
| TO UNSUBSCRIBE from this list:
|http://lists.meer.net
) doesn’t match SUBSORTBY
(bytes)
I have commented out any sorts using bytes and cant see to work out why
this is occurring.
Have you tried adding SUBDIRSORTBY PAGES?
Aengus
+
| TO UNSUBSCRIBE from this list:
|http
On 1/7/2009 7:42 PM, Casual Account wrote:
Thanks Aengus
That sorted the problem. Does that command also apply to the browser
report? (ie when I added it I got a mismatch on bytes and pages
again, but could fix this by changing BROWREPSORTBY REQUESTS and
BROWSUMSORTBY REQUESTS to PAGES
601 - 700 of 741 matches
Mail list logo
