seems like a hack, is there a better way?
That's the way to do it. TYPEOUTPUTALIAS will not combine entries in
the report, just alias their output values.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the a
lative, rather than absolute periods.
So to get the previous month only, you would use this:
FROM -00-0101
TO -00-0131
This means 'from 0 years ago, 1 month ago, day 1, to 0 years ago, one
month ago, day 31.'
Analog is smart enough to know that day '31' may not exists, but t
27;t this filtered by the HOSTEXCLUDE? Other computers on the same
> subnet are being filtered out.
> Any ideas?
Try running a report with no HOSTEXCLUDE but a USEREXCLUDE that
excludes this user. I bet you'll find that the user is appearing the
the logs from a different IP number (o
ted a patch yet... :-) )
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Keith Fetterman ([EMAIL PROTECTED]):
> Jeremy,
> You hit it dead on. That specific IP address was mapped to a host name
> in the /etc/hosts file on the server. I commented out the entry in the
> hosts fil
n file you are
editing.
Finally, Windows supports redirection, so you can just do this to
achieve the same effect:
analog > ABSOLUTEPATH/report.dat
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is th
. It's much harder
to make it secure.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.isite.net/listgate/anal
ere do I need to put it?
Anywhere.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.isite.net/listgate/analog-help/uns
the second is) then try rebuilding
Analog with this definition:
CC="cc -D_FILE_OFFSET_BITS=64"
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
|
Do you have logfiles without any hosts in them? That's the only reason
I can think of for it to ignore it. But then, you wouldn't have an
organization report if that were the case.
What is the exact warning message it gives?
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Ste
a dynamic report.
"Think" doesn't make me very confident. :-) If you do come up with a
solution, make sure to open it to peer-review before releasing it so
that other eyes have a chance to discover any possible security holes
that yours might have missed
up to that.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Derek Sisson ([EMAIL PROTECTED]):
> I have analog 5.1 on win2k.
> how do I pretty up the report by formatting rows in the results
> tables? For example, my OS report shows OS family, then the members
> of that family indented.
Aengus ([EMAIL PROTECTED]):
> "Jeremy Wadsack" <[EMAIL PROTECTED]> wrote:
>> Be sure, as Aengus suggested, to check the list archives for
>> previous attempts at this.
> I already checked the archive, and the search tool doesn't return any hits
>
flagged as such, think
> of the simple magic that could be worked based on the relationships
> within the reports.
Applying classes or ids to all the elements could make CSS do amazing
things, yes.
--
Jeremy W
s (and no other) HOSTINCLUDE
statement:
HOSTINCLUDE *.rwa-net.co.uk
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lis
Are you running this from the command-line or from the form interface.
You can't use Report Magic and the form interface (Analog will only
write to STDOUT when in CGI mode).
--
Jeremy Wadsack
Wadsack-Allen Digital Group
De Angelis Daniele ([EMAIL PROTECTED]):
> Hi all
> i ha
an't send '-G' to
remove the default, but you can use the default to include those
commands that are common to all configurations (like BROWALIAS or
SEARCHENGINE, etc.)
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+-
isitors or users is questionable.
To do that you'll need to write your own custom LOGFORMAT (not
APACHELOGFORMAT) to read this line, assigning %u to the cookie field
rather than the user field. You should be able to get a jump start on
the LOGFORMAT by looking at the ones in the documentati
If you split it into files that are smaller than 2GB and still have
the problem, then it's not the 2GB file limit problem. As Andrew
suggested, take a look at 'top' while it's running and see if it's
thrashing the hard drive. It could just need more memory for
process
should be I think.
This looks like you are using Report Magic so the reportmagic-help
mailing list (http://www.reportmagic.org/lists.html) would be a better
venue.
The rounding of requests and pages is a known issue due to be fixed in
the next release.
--
Jeremy Wadsack
Wadsack-Allen D
nd (AFAIK) no one else has had any similar
problem with the current anlgform.exe build. You might try downloading
the file again. If that doesn't fix it, let me know and I'll rebuild
it.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
ee
http://www.analog.cx/docs/logfmt.html.
Then use the USERINCLUDE line to select which 'users' you want to
filter the report by. See http://www.analog.cx/docs/include.html.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+-
n %T and %A
Try this logformat:
DEFAULTLOGFORMAT "#%j"
DEFAULTLOGFORMAT (%Y-%m-%d %h:%n:%j %S %j %j %j %j %j %j %r %q %c %b %j %T %j %j %j %A
%u %f)
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Harshu Kanitkar ([EMAIL PROTECTED]):
> Hello,
> Thanks for your help. Acc
tware package that is more
powerful than Analog. Although recent reports have implied that
Webalizer might handle large files better in some situations.
So as not to advertise, I won't mention commercial packages on the
list, but contact
ng this into account? Or is there a way to tell Analog to
> skip corrupt lines without also skipping the entire logfile?
There are tools on the Helper Applications page that might help with
this. There probably isn't any way to write a LOGFORMAT t
or tip site? (much needed!).
Well, you could start with these...
http://www.analog.cx/docs/Readme.html
http://www.analog.cx/how-to/index.html
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mai
e 4.x, I believe. I don't remember the exact
reasons, but it has to do with someone looking at the page from the
view source and/or bookmarks.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the ana
This command should do the trick:
ARGSEXCLUDE /songtexte/song.php
See http://www.analog.cx/docs/args.html#ARGSINCLUDE for details --
--
Jeremy Wadsack
Wadsack-Allen Digital Group
sascha ([EMAIL PROTECTED]):
> oh, perhaps you are misunderstanding me...
> i don't want the argumen
Well, that's not what your second post said.
Anyway, as Stephen suggested, use FILEALIAS:
FILEALIAS /songtexte/song.php?id=*&* /songtexte/song.php?id=$1
See http://www.analog.cx/docs/alias.html for details.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
sascha ([EMAIL PROTECTED]
errors on
> stderr whenever I run analog ?
Because Analog isn't reading the entire log file. Possibly it's
because the log files are corrupt and Analog jumps out early.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
log.cx/docs/lowmem.html.
If that doesn't help, try adding more memory (it's cheap) or consider
breaking up reports (e.g. only offer monthly reports, or only look at
subsections of the data).
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+--
apidly becoming a FAQ. Maybe I'll
> actually add it to the FAQ list in the next version.)
Or add a solution! :-) You could add a *CHARTLEVEL command or
something that tells Analog to CHART a level other than the first on
r Applications
page that takes computer output and produces and XML file from it.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|htt
using, just edit it with a text
editor, change the setting to what it needs to be and wait for the
next run (if it's scheduled).
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list.
L, CSV, etc.).
But then, I'm biased about that. :-)
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.isite.
inks it's doing. It
may have not read the file you think it's reading or something. Also
were there any warning messages produced. You might try turning on all
warnings just in case.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
ere wouldn't
> be counted in the ref and refsite reports, but the request would
> count, unless excluded by some other command.
You want to use REFREPEXLUDE. REFEXCLUDE excludes the whole line from
all reports if the referrer matches. REFREPEXCLUDE only exclude the
line from the Referre
[EMAIL PROTECTED] ([EMAIL PROTECTED]):
> Hello,
> On Thu, 10 January 2002, "Jeremy Wadsack" wrote:
>> Otis Gospodnetic ([EMAIL PROTECTED]):
>>
>> > I am trying to figure out why Analog is reporting less requests than
>> > there really are.
>
.02%: 9/Jan/02 22:13:
>/templates/menu.jsp?section=2&id=r119623&lastSection=8
> I want one entry in the request report for nav-st-john-amb
> representing hits on these URLS and I do NOT want to use FILEALIAS.
> Can someone unburden me?
Unfortunately, it doesn't work
If you want to set the file alias, then use FILEALIAS. If you want to
only have the alias in the Request Report (and no other reports), then
use REQALIAS.
> I have also noticed that if I set one FILEINCLUDE or REQINCLUDE all
> other the other files are excluded by def
e that your logs don't have the data, in which case you
need to use the LOGFILE command to include more logs. See
http://www.analog.cx/docs/logfile.html for details.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
|
> Is there any way to remedy this?
Use the second argument to the log file command. See
http://www.analog.cx/docs/logfile.html.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list.
those
files pointed to the same thing. If you want to change the way it
looks in the Request Report, use REQALIAS, which doesn't affect the
link.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the ana
ts from
related links.
I don't know the specific, but I'm fairly certain there's a way of
creating a command prompt that will run Analog on the current week's
log files.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+--
but this will
affect all reports.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.isite.net/listgate/analog-help/u
eading
that logfile, understanding the LOGFORMAT command, and what the floor
and exclusion settings are for the browser reports.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsub
49
> [24/Dec/2001:00:25:01 -0600] 24.207.190.249 SSLv3 RC4-MD5 "GET
>/images/NewSite/ajplogo.gif HTTP/1.1" 1980
These log files don't contain status codes, so Analog can't process
them. You should edit your apache configuration to change the logfile
format. Apache comes with
cation if
you were so inclined to write it. :-)
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.isite.net/listgate/an
a lot more that could be done. It's not too hard to
recognize IP addresses, requrest-like things, browsers, referrers,
status codes (with enough lines), protocol, date and time, etc.
I don't think it's too hard a job as long as the heuristics are right
and there's enough data of
Ana Paula ([EMAIL PROTECTED]):
> What can I do for enable statistics to get users browsers details
> (like: netscape 5%, Internet Explorer 33%, etc) ???
> I'm using Analog 5.1-1 and Report Magic 2.12 .
Turn on the Browser Summary in your Analog config:
BROWSERSUM ON
--
umbers, especially near the bottom of reports.
The proper way to do this is with Analog cache files
(http://www.analog.cx/docs/cache.html). This is mentioned in the
documentation on COMPUTER output and in the faq:
http://www.analog.cx/docs/faq.html#faq157.
--
This is in the FAQ)
If you take out the error log, that may remove a lot of your corrupt
line messages.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| m
ll make requests like
/intranet/gcm/main/gcmprd1.ns4/va_AllSubCat1?OpenView&Expand=3
look this this in the reports
/intranet/gcm/main/gcmprd1.ns4/va_AllSubCat1.OpenView?Expand=3
You can probably use a REQALIAS to convert them back for the Request
Report
t prints
the number of the row for each user. That will give you a count of
users listed in the report (but not those excluded or below the
floor.)
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the an
er in the distribution. Start with the Readme.html file. Or you
can get them from the websites here:
http://www.analog.cx/docs/Readme.html. In particular, look at the
'Starting to use analog' page and select a start page for your
platform.
--
Jeremy Wadsack
Wadsack-
lly detect the format. If not, follow the directions in the
documentation (http://www.analog.cx/docs/logfmt.html) to build your
own LOGFORMAT string.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing
the browser. Browser
Summary is a summary of that data in the format we usually expect
(MSIE, Netscape, Opera, ... each broken down into version and
subversion).
[Stephen.. isn't this becoming a FAQ?]
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
Analog can't recombine or understand the lines if they are broken up.
It's possible that you could write some script to rebuild the files,
but it would need to know a lot about the data to do that.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+-
't have
bytes.
You can change the warnings with the WARNINGS command. See
http://www.analog.cx/docs/debug.html#warnings for details.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing li
filter items in each report. http://www.analog.cx/docs/include.html
Also, you might want to use the Browser Summary, rather than the
Browser Report.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help m
TINCLUDE, analog will include all lines from the log file in the
report. If you have excluded lines from that server, just add a
VHOSTINCLUDE line to get them back.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| Th
. This format command will work
for this line (make sure the command is all on one line):
APACHELOGFORMAT (%v %h %l %u %t \"%r\" %>s %b \"%{Referer}i\"
\"%{User-Agent}i\")
If you are specifying the log file from a different configuration file
or from the comman
and end-of-line there. Your
logformat has told Analog to expect at least one more field.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
ile line) use tabs to separate,
not spaces. Without quotes around the browser, space-delimited log
file lines would be useless.
Seconds, there's a username between the host and browser fields that
you are missing.
Third, you have a lot more fields that you are throwing out (%j) than
there
h the format to
the line.
This should help a lot in determining where the problems are.
But since this is the format that Apache is logging in, I don't see
any reason why Analog would not be able to parse that. I think your
problem is with other logfiles.
You can also use
SETTINGS ON
to hav
someone tell my which exclude I have to put in my configuration
Use the REQEXCLUDE command to remove items from the Request Report.
This is covered in http://www.analog.cx/docs/include.html.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+--
the Referrer Report and the sites will be summarized in
the Referring Sites Report. You can't tell how the user got to THAT
page unless you have that site's logs. You normally don't get referrer
data for bookmarks (what would the referrer be?) so this tells you
that the user clicked o
made by a single given user at a time, using
USERINCLUDE command.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.
.) I'm not quite sure, what you want, but I think it's
this:
USERALIAS REGEXPI:user=(.*?)\s*(;|$) $1
> I have a cookie called 'user' to record all users. Could you please let me
> know what else might have to be done or inform me of any mistakes I might be
Also check
ct them.
Are you telling Analog to write the pie charts all to the same folder?
Then it will overwrite the image files each time it runs and you will
be left with the last images created (likely one of the
subdirectories). If you are creating several reports with separate
images, you should put them
f logic, preprocessing the files before you have
Analog analyze them.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://list
OST(IN|EX)CLUDE affects what items are included in the
Redirected Host Report.
There are no basic data types of 'redirection' in Analog.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-h
bstatistik/
>>
>> Any Suggestions?
>>
> Does this happen if you use analog on its on without Report Magic? If not,
> it's probably a RM problem and should go to the reportmagic-help mailing
> list.
This was posted to both lists. I respon
idn't for the format. Your log
format is correct if most of the lines in your file are not corrupt.
One of your INCLUDE or EXCLUDE commands must be filtering all those
entries.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
make sure that analog.cfg and manconf.cfg did not
inadvertently get overwritten with logfile data. They should both look
like Analog configuration files.
> With SETTINGS ON, I just get all the settings listed, no warning
> messages, but no report either!
That's what SETTINGS ON is su
bytes, etc (depending on
columns selected) that the user has. If your log file does not have
users (your website does not require logins) then you will have no
data in the report and Analog won't generate it.
--
Jeremy Wadsack
Wadsack-Allen Di
wer about it.
Analog is already doing this. It's just a warning (not an error) in
case you expect the log files to not overlap. You can use the WARNINGS
command in your Analog configuration file to disable this message.
--
Jeremy Wadsac
125 0.35000 111.222.333.66
> I would like to see it as
> S Rr 400 0.35 111.222.333.*
> Or move it to even a higher level at 111.222.*
> Is there a way to specify this in the config file.
The Organisation Report does this in version 5 and later.
--
Jeremy Wa
when computer-readable output is generated.
No, they are calculated metrics, and can be easily determined from the
other values in the General Summary.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-h
> RMagic.
This has become a FAQ for Report Magic so it will be added in a
forthcoming version.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|
is with aliases. See
http://www.analog.cx/docs/alias.html for details on the ORGALIAS
command.
Report Magic will pass through whatever information Analog tells it.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
|
;t an option, please let me know so I can start writing the parsers
>for the other formats. :o)
Analog does not have any templating built into it, just the predefined
output formats. There is a tool on the Helper Applications page
(http://www.analog.cx/helpers/) called anaml that converts CRO to XML
p://www.mail-archive.com/analog-help@lists.isite.net/msg10466.html
and a vested interest in this discussion:
http://www.reportmagic.org/
If you choose to take this discussion off the list, can you please
include me in it?
Thanks,
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+-
t; Can analog now link an Organization name to the IP or is there a way
> to do this within Analog?
I answered this question when you posted it yesterday, Michael:
http://www.mail-archive.com/analog-help@lists.isite.net/msg11243.html
--
J
5.21
This is COMPUTER output format. You probably want HTML for your
browser to read it. Change your Analog configuration file to OUTPUT
HTML (or remove the OUTPUT COMPUTER line) or add that directive to
your form.
--
Jeremy Wadsack
Wad
.js
If you want to just remove those entries from the Request Report, then
use this:
REQEXCLUDE *.gif,*.jpg,*.css,*.js
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To
ant actual visitors, you can't really get that
number. See http://www.analog.cx/docs/webworks.html for reasons why.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe fro
rd-party tools on the Helper Applications page,
http://www.analog.cx/helpers/.;
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|h
n: Has anyone addressed this, or am I going to have to start from
> scratch?
If you are certain that the crawler is not behaving properly, can you
contact me off the list with more information about your site, so I
can work out any bugs that may be in the software?
Thanks,
--
Je
at all? I am using IIS5 and W3C logs. Thanks!
It's only affecting reports in that the byte columns, if you have any,
may not represent bytes for all requests in the request column. It's a
warning to let you know that the values may not be consistent, but it
still lists counts all reque
27;t be listed as a domain or organization.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing list. To unsubscribe from this
| mailing list, go to
|http://lists.isite.net/listgate/analog-he
from the Request Report and Browser Summary,
stay with the EXCLUDEs you have and accept the fact that the General
Summary (and all other reports) are including that traffic.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
ce with two
> different *INCLUDE values?
You can't. You can hijack another variable, such as the virtual host
one, if you don't need it, and use the Virtual Host Report to track
the other field. Perhaps something like this in your LOGFORMAT:
%jidl_visitor=%u;%jidl_visit=%v;%j
Als
Isn't that what you want to do? Count the total number of unique
cookies for the period or log files?
--
Jeremy Wadsack
Wadsack-Allen Digital Group
[EMAIL PROTECTED] ([EMAIL PROTECTED]):
> I thought something like this would be the solution - but I can't seem to
> get
e "sed" to change all the "300" status codes
> into 200s, then run the appropriate Analog reports.
> Any thoughts on this?
http://www.analog.cx/docs/faq.html#faq181
If you are ok with the potential double counting on directories, then
your sed approach is prob
Did you read the FAQ item that I linked to? That's the double counting
I'm talking about.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Michael Rabe ([EMAIL PROTECTED]):
> Thanks for the feedback - could you elaborate on the "double counting"?
> What is tha
rrupt.)
I had assumed you had already done this, as you would have needed to
in your original format anyway.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
[EMAIL PROTECTED] ([EMAIL PROTECTED]):
> Sorry, I wasn't clear. It gives the total number of _all_ cookies - what I
> need is the
7;-2 days'` \
/log/http/iobox.com/access.log-`date +%Y-%m-%d -d '-3 days'` \
/log/http/iobox.com/access.log-`date +%Y-%m-%d -d '-4 days'` \
/log/http/iobox.com/access.log-`date +%Y-%m-%d -d '-5 days'
Chris,
This would appear to be an error in your shell script. As you didn't
include the script I can't give you any suggestions on it but it
appears you have a '[' where bash does not want it.
--
Jeremy Wadsack
Wadsack-Allen Digital Group
Chris McQuade ([EMAIL PROTECTE
ne.
You have two fields marked as %v. The first looks likely to be
correct. The second I would guess should be a referrer (%f.)
--
Jeremy Wadsack
Wadsack-Allen Digital Group
+
| This is the analog-help mailing l
10Mb-100Mb: ...
> Is it possible to change size floors? I can't see
> it at http://www.analog.cx/docs/Readme.html...
What would such a FLOOR command effect? The histogram shows the
distribution of files by size. I'm not sure why you would not want to
include all buckets
701 - 800 of 1338 matches
Mail list logo
