qmailanalog operation
Hi all! I have just installed the qmailanalog 0.70 binary for openbsd. I've noticed that there doesn't appear to be alot of information on qmailanalog. atm I'm having problems with getting started.I use multilog on my qmail system. Would someone be kind enough to offer some starting off instructions to see results with this program? (: Many Thanks. Gareth.
Re: qmailanalog operation
Hello Gareth. Hi all! I have just installed the qmailanalog 0.70 binary for openbsd. I've noticed that there doesn't appear to be alot of information on qmailanalog. atm I'm having problems with getting started.I use multilog on my qmail system. Would someone be kind enough to offer some starting off instructions to see results with this program? (: Many Thanks. Gareth. Try this (call it mylog (for example) and put it in /usr/local/bin. Don`t forget to change the e-mail address. - #!/bin/sh PATH=/usr/local/bin/qmailanalog:/usr/local/bin:$PATH export PATH umask 077 TMP_FILE=/var/log/qmail/qmailanalog.tmp EXT_FILE=/var/log/qmail/qmailanalog.ext OUT_FILE=/var/log/qmail/qmailanalog.out LOG_FILE=/var/log/qmail/* rm -f $TMP_FILE $OUT_FILE cat MAIL_HEADER $OUT_FILE From: Postmaster@domain To: whoever@domain Subject: `hostname` qmail statistics MAIL_HEADER touch $EXT_FILE cat $EXT_FILE $LOG_FILE | matchup $TMP_FILE 5$EXT_FILE.new mv $EXT_FILE.new $EXT_FILE zoverall $TMP_FILE $OUT_FILE echo --- $OUT_FILE zfailures $TMP_FILE $OUT_FILE echo --- $OUT_FILE zdeferrals $TMP_FILE $OUT_FILE echo --- $OUT_FILE #zddist $TMP_FILE $OUT_FILE #Echo --- $OUT_FILE #zrxdelay $TMP_FILE $OUT_FILE echo --- $OUT_FILE zrecipients $TMP_FILE $OUT_FILE echo --- $OUT_FILE #zsuccesses $TMP_FILE $OUT_FILE #echo --- $OUT_FILE #zsenders $TMP_FILE $OUT_FILE #echo --- $OUT_FILE zrhosts $TMP_FILE $OUT_FILE #echo --- $OUT_FILE #zsendmail $TMP_FILE $OUT_FILE #echo --- $OUT_FILE #zsuids $TMP_FILE $OUT_FILE /var/qmail/bin/qmail-inject $OUT_FILE rm -f $TMP_FILE $OUT_FILE --- unrem the other ones if you like but it will be big. I just use the zoverall, zfailures, zdeferrals, zrecipients and zrhosts. Then :- type crontab -e and add this :- 01 1 * * */usr/local/bin/mylog esc : wq (normal vi stuff). To test you can just invoke it at any time by doing /usr/local/bin/mylog. Have fun. Oh...no times as I haven`t patched and added tai64nfrac. Regards...Martin
Re: qmailanalog operation
On Thu, Aug 09, 2001 at 10:54:25PM -0400, Martin wrote:
Hello Gareth.
K Hi all!
I have just installed the qmailanalog 0.70 binary for openbsd.
I've noticed that there doesn't appear to be alot of information on
qmailanalog. atm I'm having problems with getting started.I use
multilog on my qmail system. Would someone be kind enough to offer
some
starting off instructions to see results with this program? (:
I use:
To list general details:
awk '{$1=;$2=;$3=;$4=;$5=;print}' /var/log/maillog | cat |
/usr/local/qmailanalog/bin/matchup | /usr/local/qmailanalog/bin/zoverall
To list the details of all the users ont he system:
awk '{$1=;$2=;$3=;$4=;$5=;print}' /var/log/maillog | cat |
/usr/local/qmailanalog/bin/matchup | /usr/local/qmailanalog/bin/zrecipients
To list all the people who have sent emails to our customers:
awk '{$1=;$2=;$3=;$4=;$5=;print}' /var/log/maillog | cat |
/usr/local/qmailanalog/bin/matchup | /usr/local/qmailanalog/bin/zsenders
Ross
og/qmail/*
rm -f $TMP_FILE $OUT_FILE
cat MAIL_HEADER $OUT_FILE
From: Postmaster@domain
To: whoever@domain
Subject: `hostname` qmail statistics
MAIL_HEADER
touch $EXT_FILE
cat $EXT_FILE $LOG_FILE | matchup $TMP_FILE 5$EXT_FILE.new
mv $EXT_FILE.new $EXT_FILE
zoverall $TMP_FILE $OUT_FILE
echo --- $OUT_FILE
zfailures $TMP_FILE $OUT_FILE
echo --- $OUT_FILE
zdeferrals $TMP_FILE $OUT_FILE
echo --- $OUT_FILE
#zddist $TMP_FILE $OUT_FILE
#Echo --- $OUT_FILE
#zrxdelay $TMP_FILE $OUT_FILE
echo --- $OUT_FILE
zrecipients $TMP_FILE $OUT_FILE
echo --- $OUT_FILE
#zsuccesses $TMP_FILE $OUT_FILE
#echo --- $OUT_FILE
#zsenders $TMP_FILE $OUT_FILE
#echo --- $OUT_FILE
zrhosts $TMP_FILE $OUT_FILE
#echo --- $OUT_FILE
#zsendmail $TMP_FILE $OUT_FILE
#echo --- $OUT_FILE
#zsuids $TMP_FILE $OUT_FILE
/var/qmail/bin/qmail-inject $OUT_FILE
rm -f $TMP_FILE $OUT_FILE
---
unrem the other ones if you like but it will be big. I just use the
zoverall, zfailures, zdeferrals, zrecipients and zrhosts.
Then :-
type crontab -e and add this :-
01 1 * * */usr/local/bin/mylog
esc : wq (normal vi stuff).
To test you can just invoke it at any time by doing /usr/local/bin/mylog.
Have fun.
Oh...no times as I haven`t patched and added tai64nfrac.
Regards...Martin
--
_
Ross Cooney
Virus Scanner: http://www.antivirus.ie/index.mv?free_scan=1
Perl Tutorial: http://www.cyber-sentry.com/perl/tut.mv?art=1
qmailanalog awk: division by zero
Hello. I`ve set up qmailanalog to send the success, failures and deferrals to my by e-mail. It does this quite well but The timings ddelay, average ddelay, xdelay all show 0.00 which is obviously not correct as there are 1281 total delivery attempts, 698 success, 197 failures 386 deferrals. Further, get a message sent to me saying :- awk: division by zero input record number 2674, file source line number 60 Can someone give me a hint so I can start tracking this error down. Regards...Martin
Re: qmailanalog awk: division by zero
At 16:45 05.08.2001 -0400, martin wrote: Can someone give me a hint so I can start tracking this error down. you didn't convert the timestamps into fractional seconds look at qmail.org for a programm called tai64nfrac that converts the timestamps -- --/-/-- Lukas Beeler [EMAIL PROTECTED] ---\-\-- \ \ My HomePage: URL:http://www.projectdream.org / /
Re: qmailanalog awk: division by zero
At 10:50 PM 8/5/2001 +0200, you wrote: At 16:45 05.08.2001 -0400, martin wrote: Can someone give me a hint so I can start tracking this error down. you didn't convert the timestamps into fractional seconds look at qmail.org for a programm called tai64nfrac that converts the timestamps -- --/-/-- Lukas Beeler [EMAIL PROTECTED] ---\-\-- \ \ My HomePage: URL:http://www.projectdream.org / / Hello Lukas..thanks. The www.qmail.org site is still down as is www.faqts.com I`ve found another tai64nfrac and will look into trying it tonight or tomorrow. Thanks again. Regards...Martin
Re: qmailanalog
* Charles Cazabon [EMAIL PROTECTED] tai64n timestamps aren't supposed to be human readable. They're supposed to be easily parsable by programs. That's the whole point of tai64nlocal -- you log with tai64n timestamps, and if you want to read the log with human-readable timestamps, you do: tai64nlocal log | pager_of_choice If you use GNU less, you can convert the timestamp automatically by using the LESSOPEN environment variable. I have a short write-up on how to do this at http://www.orakel.ntnu.no/~kjetilod/tips/ -- Kjetil
Re: qmailanalog usage
Charles Cazabon wrote: Mark Douglas [EMAIL PROTECTED] wrote: I'm trying to figure out how I should get the stats I want out of qmailanalog, along with some other things I'd like to do. My main issue is, if I wanted to do a daily log rotation, would it be feasible to do the following (using multilog): Set my logfile size to 100MB; at end of day, have a cron job run that copies the current file to another, dated file; echo /var/log/qmail/current to empty out the log file and start fresh. I realize it's not pretty, but the real issue is, would it cause problems? Yes -- each message has multiple log lines associated with it. You'll likely get some messages which cross over your arbitrary per-night boundaries. qmail won't be able to include those messages in its analysis if you just analyze one log at a time. However, it's probably going to have a negligible impact on the overall statistics. I posted a shell script to this list last week which does exactly what you want, suitable for use as a nightly cron job. And because it uses qlogselect from Bruce Guenter's qlogtools package, you don't need to rotate the scripts nightly to split the statistics up per-day -- qlogselect will automatically extract the log entries for a time period you specify. The script filters it down to one day. Charles -- Hi Charles, This qlogselect app from qlogtools doesn't appear to be in the latest release of qlogtools. I recently downloaded the src code from http://untroubled.org/qlogtools/ and found that there was a man page for qlogselect but nothing else. When I compiled that package I ended up with no qlogselect app, and no mention of it in the Makefile either. Is it supposed to be part of that package or do I need to get it from elsewhere? Brett
Re: qmailanalog usage
Mark Douglas wrote: I'm trying to figure out how I should get the stats I want out of qmailanalog, along with some other things I'd like to do. My main issue is, if I wanted to do a daily log rotation, would it be feasible to do the following (using multilog): Set my logfile size to 100MB; at end of day, have a cron job run that copies the current file to another, dated file; echo /var/log/qmail/current to empty out the log file and start fresh. I realize it's not pretty, but the real issue is, would it cause problems? Thanks, Mark Douglas - Architecture Sympatico-Lycos Inc. All your base are belong to us! Make your time! There is a patch written by William Baxter for multilog that causes it to rotate logs ASAP upon receiving SIGHUP. You can find it at http://www.superscript.com/patches/multilog.c.hup Mike
Re: qmailanalog usage
Brett Leeder [EMAIL PROTECTED] wrote: Hi Charles, This qlogselect app from qlogtools doesn't appear to be in the latest release of qlogtools. Someone else noticed that last week. All I have around is an i386 RPM of qlogtools-3.0-1; if that will do, you can grab it at http://www.qcc.sk.ca/~charlesc/software/rpms/qlogtools-3.0-1.i386.rpm . In the meantime, post a note to the author on his bgware mailing list. See untroubled.org for the subscription address. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ ---
qmailanalog usage
Title: qmailanalog usage I'm trying to figure out how I should get the stats I want out of qmailanalog, along with some other things I'd like to do. My main issue is, if I wanted to do a daily log rotation, would it be feasible to do the following (using multilog): Set my logfile size to 100MB; at end of day, have a cron job run that copies the current file to another, dated file; echo /var/log/qmail/current to empty out the log file and start fresh. I realize it's not pretty, but the real issue is, would it cause problems? Thanks, Mark Douglas - Architecture Sympatico-Lycos Inc. All your base are belong to us! Make your time!
Re: qmailanalog usage
Mark Douglas [EMAIL PROTECTED] wrote: I'm trying to figure out how I should get the stats I want out of qmailanalog, along with some other things I'd like to do. My main issue is, if I wanted to do a daily log rotation, would it be feasible to do the following (using multilog): Set my logfile size to 100MB; at end of day, have a cron job run that copies the current file to another, dated file; echo /var/log/qmail/current to empty out the log file and start fresh. I realize it's not pretty, but the real issue is, would it cause problems? Yes -- each message has multiple log lines associated with it. You'll likely get some messages which cross over your arbitrary per-night boundaries. qmail won't be able to include those messages in its analysis if you just analyze one log at a time. However, it's probably going to have a negligible impact on the overall statistics. I posted a shell script to this list last week which does exactly what you want, suitable for use as a nightly cron job. And because it uses qlogselect from Bruce Guenter's qlogtools package, you don't need to rotate the scripts nightly to split the statistics up per-day -- qlogselect will automatically extract the log entries for a time period you specify. The script filters it down to one day. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ ---
Re: qmailanalog usage
On Mon, Jun 25, 2001 at 06:56:47PM -0600, Charles Cazabon wrote: [snip] Yes -- each message has multiple log lines associated with it. You'll likely get some messages which cross over your arbitrary per-night boundaries. qmail won't be able to include those messages in its analysis if you just analyze one log at a time. That's why qmailanalog wants to write to an fd (I think 5) and read from another (I think 6). It saves state of all uncompleted messages to this fd, and expects this saved state to be passed to it on this other fd. I probably have the fd numbers wrong, but the drift is that qmailanalog can do this just fine without losing *any* messages. Greetz, Peter -- Against Free Sex! http://www.dataloss.nl/Megahard_en.html
Re: qmailanalog usage
Why not let logrotated handle your log rotation, daily if you so desire, and call qmailanalog from a postrotate block on maillog.2? We have a similar setup here, but we're rotating weekly. There's a little perl script that calls qmailanalog and sends its output to a dated file (mail-report-mm-dd-ccyy.txt). About an hour later, another script comes along and adds a pointer to the new file to the reports index. It's only been in place for a few weeks, but it seems to be working fine. That actually reminds me of another question I've been thinking about. Now that I have these nifty statistics, I'd like to know how to interpret them. Sure, I know what 'delivery attempts' means, but what's a good number for that? How high is too high when it comes to average qtime? Is there a document somewhere that outlines that? Perhaps it's not even relevant - after all, the qmailanalog report seems to say more about the servers I'm sending to than my server. cheers, Todd At 08:23 PM 6/25/01, Mark Douglas wrote: I'm trying to figure out how I should get the stats I want out of qmailanalog, along with some other things I'd like to do. My main issue is, if I wanted to do a daily log rotation, would it be feasible to do the following (using multilog): Set my logfile size to 100MB; at end of day, have a cron job run that copies the current file to another, dated file; echo /var/log/qmail/current to empty out the log file and start fresh. I realize it's not pretty, but the real issue is, would it cause problems? Thanks, Mark Douglas - Architecture Sympatico-Lycos Inc. All your base are belong to us! Make your time!
SV: qmailanalog
-Pa°L -Opprinnelig melding- Fra: Henning Brauer [mailto:[EMAIL PROTECTED]] Sendt: 21. juni 2001 12:05 Til: Qmail Mailing List Emne: Re: qmailanalog On Wed, Jun 20, 2001 at 08:22:46PM -0600, Charles Cazabon wrote: This script may have bash-specific constructions, s_year=`date -d '1 day ago' +%Y` s_month=`date -d '1 day ago' +%m` s_day=`date -d '1 day ago' +%d` This works only with GNU date - the original date doesn't have -d. Your script is nice, though. for ana in zoverall zddist zdeferrals zfailures zrhosts zsuids zrxdelay; do Well, for mailservers beeing somehow busy I'd _really_ avoid at least zrhosts and zrxdelay - these lists become ___very___ long. If you aren't running a virtual user setup I'd also avoid zsuids. I found qmail-mrtg (the version that doesn't use qmail-analog) very helpful. Greetings Henning -- * Henning Brauer, [EMAIL PROTECTED], http://www.bsws.de * * Roedingsmarkt 14, 20459 Hamburg, Germany * Unix is very simple, but it takes a genius to understand the simplicity. (Dennis Ritchie)
qmailanalog
I want to know how many messages were sent/failed etc. for a given period of time (say the last three days). I have done the following in both /var/log/qmail/qmail-send and /var/log/qmail/qmail-smtpd (I'll admit my ignorance and say that I don't know the difference between the two. Is qmail-send local deliveries and qmail-smtpd remote deliveries?): 1) Ran matchup on /var/log/qmail/qmail-send(smtpd)/current 2) Converted the matchedup version of current into human readable format using tai64nlocal 3) Pulled out dates for which I want to see log results from the file created above 4) Convert the data above to tai64 format using tai64n 5) Ran this data through zoverall to see qmailanalog results Regardless of whether I run it against /var/log/qmail/qmail-send or /var/log/qmail/qmail-smtpd I get the following: Completed messages: 0 Total delivery attempts: 0 Am I anywhere near doing this right? Here are my actual commands 1) cat /var/log/qmail/qmail-smtpd/current | /usr/local/qmailanalog/bin/matchup /var/log/qmail/qmail-smtpd/matchedup 2) cat /var/log/qmail/qmail-smtpd/matchedup | /usr/local/bin/tai64nlocal human_readable_current 3) vi human_readable_current (remove all unneeded data) 4) cat /var/log/qmail/qmail-send/human_readable_current | /usr/local/bin/tai64n tai64_current 5) cat ./tai64_current | /usr/local/qmailanalog/bin/zoverall overall_log
Re: qmailanalog
Drew Hawn [EMAIL PROTECTED] wrote: I want to know how many messages were sent/failed etc. for a given period of time (say the last three days). I have done the following in both /var/log/qmail/qmail-send and /var/log/qmail/qmail-smtpd (I'll admit my ignorance and say that I don't know the difference between the two. Is qmail-send local deliveries and qmail-smtpd remote deliveries?): No. qmail-smtpd is incoming mail via SMTP. qmail-send is all deliveries, local and remote. 1) Ran matchup on /var/log/qmail/qmail-send(smtpd)/current 2) Converted the matchedup version of current into human readable format using tai64nlocal 3) Pulled out dates for which I want to see log results from the file created above 4) Convert the data above to tai64 format using tai64n 5) Ran this data through zoverall to see qmailanalog results Regardless of whether I run it against /var/log/qmail/qmail-send or /var/log/qmail/qmail-smtpd I get the following: Completed messages: 0 Total delivery attempts: 0 Am I anywhere near doing this right? No. Instead of converting the tai64n timestamps to human-readable, you need to convert them to the fractional seconds (tai) that qmail-analog expects. You can do this with tai64n2tai, included in Bruce Guenter's qlogtools package if I remember correctly. His software is at untroubled.org . Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
RE: qmailanalog
Thanks for the info Charles, but I'm confused. How do most of you folks pull out information from your logs? Log files generated by qmail are unreadable/unusable in the current (multilog) format. In order for them to make sense to me, and in order to sift them for specific dates I have to convert them to human readable format. I can do this with tai64nlocal. Once I have removed data that is not pertinent I then have to change them back into multilog format using tai64n, and then convert them into the older TAI64 format that qmailanalog understands, then run them through the qmailanalog scripts. Wow, that's a convoluted process using tools that until now had worked together to provide a graceful solution to my email needs. At the sake of being redundant, how do ya'll do it? -Original Message- From: Charles Cazabon [mailto:[EMAIL PROTECTED]] Sent: Wednesday, June 20, 2001 10:54 AM To: Qmail Mailing List Subject: Re: qmailanalog Drew Hawn [EMAIL PROTECTED] wrote: I want to know how many messages were sent/failed etc. for a given period of time (say the last three days). I have done the following in both /var/log/qmail/qmail-send and /var/log/qmail/qmail-smtpd (I'll admit my ignorance and say that I don't know the difference between the two. Is qmail-send local deliveries and qmail-smtpd remote deliveries?): No. qmail-smtpd is incoming mail via SMTP. qmail-send is all deliveries, local and remote. 1) Ran matchup on /var/log/qmail/qmail-send(smtpd)/current 2) Converted the matchedup version of current into human readable format using tai64nlocal 3) Pulled out dates for which I want to see log results from the file created above 4) Convert the data above to tai64 format using tai64n 5) Ran this data through zoverall to see qmailanalog results Regardless of whether I run it against /var/log/qmail/qmail-send or /var/log/qmail/qmail-smtpd I get the following: Completed messages: 0 Total delivery attempts: 0 Am I anywhere near doing this right? No. Instead of converting the tai64n timestamps to human-readable, you need to convert them to the fractional seconds (tai) that qmail-analog expects. You can do this with tai64n2tai, included in Bruce Guenter's qlogtools package if I remember correctly. His software is at untroubled.org . Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: qmailanalog
Drew Hawn [EMAIL PROTECTED] wrote: Thanks for the info Charles, but I'm confused. How do most of you folks pull out information from your logs? With qmail-analog, tai64nlocal, and less, in my case. Most people here probably use something similar. Log files generated by qmail are unreadable/unusable in the current (multilog) format. tai64n timestamps aren't supposed to be human readable. They're supposed to be easily parsable by programs. That's the whole point of tai64nlocal -- you log with tai64n timestamps, and if you want to read the log with human-readable timestamps, you do: tai64nlocal log | pager_of_choice Don't run the logs through tai64nlocal before they hit the disk. In order for them to make sense to me, and in order to sift them for specific dates I have to convert them to human readable format. No, it's much simpler than that. A program to filter a log with tai64nlocal timestamps for particular dates is trivial; Bruce's qlogtools probably includes one (though I haven't checked). After you've filtered them, you run it through tai64nlocal before reading it. Once I have removed data that is not pertinent I then have to change them back into multilog format using tai64n, and then convert them into the older TAI64 format that qmailanalog understands, then run them through the qmailanalog scripts. Don't remove any data. What isn't pertinent? qmail-analog needs all of the various data that qmail-send logs to be able to accurately summarize it. Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
RE: qmailanalog
Please tell me what I'm doing wrong! :) Somebody has to be doing this properly, and it's sure not me. What I want is simple enough, I want to know how many messages were sent/received, etc. June 18th. That information is contained within my current file, but I can find no way to report on this data using qmailanalog, tai64n, tai64nlocal, tai64n2tai, etc. I have a current log file that contains log entries that span approximately 1 week. I can successfully use qmailanalog to view information about the messages that were sent and logged into my current file. This gives me information beginning when the log file was created and ending at the last entry of the log file, but I don't want a report that spans the entire week, I want one for a particular day. It seems logical that some magic combination of the following should give me the information that I need. (BTW, I never actually change the data in my current file, I always write out to another file when converting this data). Convert my current file to a human-readable format, grep out lines with the information I want into another file, convert that information back into tai64n format, convert that into tai format, run matchup on the file and then run it through the qmailanalog scripts to report on the dates I want information on. This does not work. If I convert tai64n files into human-readable ones, then convert that file back into tai64n files I get bad data: @40003b3118d1244c4a2c 2001-05-31 09:52:32.237949500 status: Notice that tai64n did convert the date, but also left the human-readable date in the file. For Charles sake, I don't want to simply look at the log files. I want a qmailanalog-style report on a subset of the information contained within my current file. -Original Message- From: Charles Cazabon [mailto:[EMAIL PROTECTED]] Sent: Wednesday, June 20, 2001 12:39 PM To: Qmail Mailing List Subject: Re: qmailanalog Drew Hawn [EMAIL PROTECTED] wrote: Thanks for the info Charles, but I'm confused. How do most of you folks pull out information from your logs? With qmail-analog, tai64nlocal, and less, in my case. Most people here probably use something similar. Log files generated by qmail are unreadable/unusable in the current (multilog) format. tai64n timestamps aren't supposed to be human readable. They're supposed to be easily parsable by programs. That's the whole point of tai64nlocal -- you log with tai64n timestamps, and if you want to read the log with human-readable timestamps, you do: tai64nlocal log | pager_of_choice Don't run the logs through tai64nlocal before they hit the disk. In order for them to make sense to me, and in order to sift them for specific dates I have to convert them to human readable format. No, it's much simpler than that. A program to filter a log with tai64nlocal timestamps for particular dates is trivial; Bruce's qlogtools probably includes one (though I haven't checked). After you've filtered them, you run it through tai64nlocal before reading it. Once I have removed data that is not pertinent I then have to change them back into multilog format using tai64n, and then convert them into the older TAI64 format that qmailanalog understands, then run them through the qmailanalog scripts. Don't remove any data. What isn't pertinent? qmail-analog needs all of the various data that qmail-send logs to be able to accurately summarize it. Charles -- -- - Charles Cazabon [EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. -- -
Qmailanalog matchup error
Title: Qmailanalog matchup error I am trying to run matchup. I have cleaned the maillog as documented and generated a file to parse through matchup. Running matchup results in output like below . Any help you TIA! /usr/local/qmailanalog/bin/matchup: [EMAIL PROTECTED]: No such file or directory /usr/local/qmailanalog/bin/matchup: 990959401.508748: command not found /usr/local/qmailanalog/bin/matchup: 990959401.510608: command not found /usr/local/qmailanalog/bin/matchup: 990959401.555309: command not found /usr/local/qmailanalog/bin/matchup: 990959401.558207: command not found /usr/local/qmailanalog/bin/matchup: 990959401.559713: command not found /usr/local/qmailanalog/bin/matchup: 990959420.577015: command not found /usr/local/qmailanalog/bin/matchup: 990959420.578531: command not found /usr/local/qmailanalog/bin/matchup: syntax error near unexpected token `Sorry,_I_couldn't_find_any_host_by_that_name._(#' /usr/local/qmailanalog/bin/matchup: /usr/local/qmailanalog/bin/matchup: line 735: ` 990967436.502499 delivery 1604: deferral: Sorry,_I_couldn't_find_any_host_by_that_name._(#4.1.2)/' Broken pipe John Scarborough TwinEngines Inc. 404.522.4262 http://www.twinengines.com [EMAIL PROTECTED] mailto:[EMAIL PROTECTED]
Re: Qmailanalog matchup error [Virus Checked]
Sounds like a path PATH issue You have have ...\qmailanalog\bin in your path John Scarborough [EMAIL PROTECTED] on 05/29/2001 02:23:15 PM To: [EMAIL PROTECTED] cc:(bcc: Jeff D Sweeten/ASC/US/AON) Subject: Qmailanalog matchup error [Virus Checked] I am trying to run matchup. I have cleaned the maillog as documented and generated a file to parse through matchup. Running matchup results in output like below . Any help you TIA! /usr/local/qmailanalog/bin/matchup: [EMAIL PROTECTED]: No such file or directory /usr/local/qmailanalog/bin/matchup: 990959401.508748: command not found /usr/local/qmailanalog/bin/matchup: 990959401.510608: command not found /usr/local/qmailanalog/bin/matchup: 990959401.555309: command not found /usr/local/qmailanalog/bin/matchup: 990959401.558207: command not found /usr/local/qmailanalog/bin/matchup: 990959401.559713: command not found /usr/local/qmailanalog/bin/matchup: 990959420.577015: command not found /usr/local/qmailanalog/bin/matchup: 990959420.578531: command not found /usr/local/qmailanalog/bin/matchup: syntax error near unexpected token `Sorry,_I_couldn't_find_any_host_by_that_name._(#' /usr/local/qmailanalog/bin/matchup: /usr/local/qmailanalog/bin/matchup: line 735: ` 990967436.502499 delivery 1604: deferral: Sorry,_I_couldn't_find_any_host_by_that_name._(#4.1.2)/' Broken pipe John Scarborough TwinEngines Inc. 404.522.4262 http://www.twinengines.com [EMAIL PROTECTED] mailto:[EMAIL PROTECTED] Title: Qmailanalog matchup error I am trying to run matchup. I have cleaned the maillog as documented and generated a file to parse through matchup. Running matchup results in output like below . Any help you TIA! /usr/local/qmailanalog/bin/matchup: [EMAIL PROTECTED]: No such file or directory /usr/local/qmailanalog/bin/matchup: 990959401.508748: command not found /usr/local/qmailanalog/bin/matchup: 990959401.510608: command not found /usr/local/qmailanalog/bin/matchup: 990959401.555309: command not found /usr/local/qmailanalog/bin/matchup: 990959401.558207: command not found /usr/local/qmailanalog/bin/matchup: 990959401.559713: command not found /usr/local/qmailanalog/bin/matchup: 990959420.577015: command not found /usr/local/qmailanalog/bin/matchup: 990959420.578531: command not found /usr/local/qmailanalog/bin/matchup: syntax error near unexpected token `Sorry,_I_couldn't_find_any_host_by_that_name._(#' /usr/local/qmailanalog/bin/matchup: /usr/local/qmailanalog/bin/matchup: line 735: ` 990967436.502499 delivery 1604: deferral: Sorry,_I_couldn't_find_any_host_by_that_name._(#4.1.2)/' Broken pipe John Scarborough TwinEngines Inc. 404.522.4262 http://www.twinengines.com [EMAIL PROTECTED] mailto:[EMAIL PROTECTED]
QMAILANALOG
Hi, I am trying to use qmailanalog for my analysisI use supervise on qmail and log my files thru multilog...in a separate directory. On running the following command: tai64nfrac /mail/log/deliver/current | \ /usr/local/qmailanalog/bin/matchup | /var/qmailanalog/bin/z* /mail/log/deliver/log-z*But when I pipe it through any of the z* commands, I get nothing exceptthe column headers from the z* command itself. What am I doing wrong? I tried the same with tai64n2tai and tai64nlocal but I get nothing but the column headers from the z* command itself. Can some pls throw some light on this. Raghu
Re: QMAILANALOG
qmailu wrote: I am trying to use qmailanalog for my analysis... But when I pipe it through any of the z* commands, I get nothing except the column headers from the z* command itself. What am I doing wrong? I tried the same with tai64n2tai and tai64nlocal but I get nothing but the column headers from the z* command itself. Can some pls throw some light on this. You need to run the logs through tai64nfrac before qmailanalog will analyze them properly. This script is (presumably) available at http://www.qmail.org/top.html. ---Kris Kelley
Re: qmailanalog + tai64
On Mon, Apr 02, 2001 at 03:50:46PM +0159, Martin Renner wrote: Hi. I am using tai64nfrac to feed my qmail-logs into matchup. Is there also a small utility to convert the timestamps from matchup back into a human-readable format? Like, for instance: # echo "@40003ac8925a06b75e34" | tai64nlocal 2001-04-02 15:53:04.112680500 # echo "@40003ac8925a06b75e34" | tai64nfrac 986223184.112680500 # echo "986221654.952383500" | ./tailocal 2001-04-02 15:27:34.952383500 ? Martin -- Jose Celestino [EMAIL PROTECTED] -- "Every morning I read the obituaries; if my name's not there, I go to work."
Re: qmailanalog + tai64
Hi. # echo "986221654.952383500" | ./tailocal 2001-04-02 15:27:34.952383500 And where can I find this tailocal? I just have tai64nlocal. Is it part of a previous version of ucspi-tcp? BTW: The input format is something like d d 986225876.348359500 986225876.369300500 986225876.381710500 bla bla bla Martin
qmailanalog receipients analizyes
Hello. Does zsenders's output includes also addresses from which mail is still in queue ?? I ask because I looked into matchup's output and there was the address included, but zsender's output didn't ... Bartek M.
Re: How to use qmailanalog?
On Mon, 12 Mar 2001 ling@mail.hnytnet.com wrote: What should I do next? How to use other command in qmailanalog to analog the outout file? Pipe the output through any of the z* commands provided by the qmailanalog package. Each one is a shell script that you can read for information on what it does. -- Todd A. Jacobs CodeGnome Consulting, LTD
How to use qmailanalog?
Hi! I've installed qmailanalog,and I used "matchup" program to generate output file "out.1". What should I do next? How to use other command in qmailanalog to analog the outout file? Are there any examples? Thanks
Problems with qmailanalog
I'm running this following command: tai64nfrac /var/log/qmail/smtpd/current | \ /usr/local/qmailanalog/bin/matchup And getting output like the following: ? 983523225.508134500 tcpserver: status: 0/20 ? 983523463.720841500 tcpserver: status: 1/20 ? 983523463.721270500 tcpserver: pid 17201 from 128.138.192.83 ? 983523463.799878500 tcpserver: ok 17201 \ cyrix.codegnome.org:63.195.51.16:25 \ openbsd.cs.colorado.edu:128.138.192.83::37694 ? 983523465.498049500 tcpserver: end 17201 status 0 ? 983523465.498068500 tcpserver: status: 0/20 ? 983523504.614741500 tcpserver: status: 1/20 ? 983523504.615165500 tcpserver: pid 17213 from 209.226.175.40 ? 983523530.649234500 tcpserver: ok 17213 \ cyrix.codegnome.org:63.195.51.16:25 \ tomts7.bellnexxia.net:209.226.175.40::50922 ? 983523531.142105500 tcpserver: end 17213 status 0 ? 983523531.142123500 tcpserver: status: 0/20 But when I pipe it through any of the z* commands, I get nothing except the column headers from the z* command itself. What am I doing wrong? -- Todd A. Jacobs CodeGnome Consulting, LTD
Re: Problems with qmailanalog
Todd A. Jacobs [EMAIL PROTECTED] wrote: I'm running this following command: tai64nfrac /var/log/qmail/smtpd/current | \ /usr/local/qmailanalog/bin/matchup And getting output like the following: ? 983523225.508134500 tcpserver: status: 0/20 [...] But when I pipe it through any of the z* commands, I get nothing except the column headers from the z* command itself. What am I doing wrong? Does the log contain some leading garbage on each line? Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: Problems with qmailanalog
"Todd A. Jacobs" [EMAIL PROTECTED] wrote: I'm running this following command: tai64nfrac /var/log/qmail/smtpd/current | \ /usr/local/qmailanalog/bin/matchup But when I pipe it through any of the z* commands, I get nothing except the column headers from the z* command itself. What am I doing wrong? You're trying to analyze tcpserver's logs, not qmail-send's logs. -Dave
Re: Problems with qmailanalog
On Fri, 2 Mar 2001, Dave Sill wrote: You're trying to analyze tcpserver's logs, not qmail-send's logs. You're right. I changed /var/log/qmail/smtpd/current to /var/log/qmail/current and it works fine. Thanks. -- Todd A. Jacobs CodeGnome Consulting, LTD
qmailanalog
I am using qmail with the svscan method of supervising the processes. I would also like to use qmailanalog to do some stats/analysis. Under the old "inetd" method of process management. The qmail logs were under /var/log/qmail, now they are stored under /var/service/qmail/log/main. This is not a problem per se, but The timestamps under the old method were in the following form: 901967408.116537 now they are in the form: @40003a76ca281592e16c Is there some preprocessor that I am should run this through? or maybe some type of awk statement? Or should I be looking in a totally different place for my logs? Steve Woolley [EMAIL PROTECTED]
Re: qmailanalog
Steve Woolley wrote: I am using qmail with the svscan method of supervising the processes. I would also like to use qmailanalog to do some stats/analysis. Under the old "inetd" method of process management. The qmail logs were under /var/log/qmail, now they are stored under /var/service/qmail/log/main. This is not a problem per se, but The timestamps under the old method were in the following form: 901967408.116537 now they are in the form: @40003a76ca281592e16c This is tai64 international format. Is there some preprocessor that I am should run this through? or maybe some type of awk statement? Or should I be looking in a totally different place for my logs? Tai64nlocal works for me. Mike
Re: qmailanalog
* Mike Jackson [EMAIL PROTECTED] [010202 11:58]: Is there some preprocessor that I am should run this through? or maybe some type of awk statement? Or should I be looking in a totally different place for my logs? Tai64nlocal works for me. Maybe for you, but not for qmailanalog. It still expects the older TAI format. Bruce Guenter, among others, has a tai64n2tai program in his qlogtools that will act as a filter. Piping your logs through this before sending them to qmailanalog will get you what you want. http://em.ca/~bruceg/qlogtools/current/ /pg -- Peter Green : Gospel Communications Network, SysAdmin : [EMAIL PROTECTED] --- "MSDOS didn't get as bad as it is overnight -- it took over ten years of careful development." (By [EMAIL PROTECTED])
Re: qmailanalog
I apologize but I am unfamiliar with what you mean by Tai64nlocal Is this a command line option for multilog or something else? - Original Message - From: "Mike Jackson" [EMAIL PROTECTED] To: "Steve Woolley" [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Sent: Friday, February 02, 2001 11:53 AM Subject: Re: qmailanalog Steve Woolley wrote: I am using qmail with the svscan method of supervising the processes. I would also like to use qmailanalog to do some stats/analysis. Under the old "inetd" method of process management. The qmail logs were under /var/log/qmail, now they are stored under /var/service/qmail/log/main. This is not a problem per se, but The timestamps under the old method were in the following form: 901967408.116537 now they are in the form: @40003a76ca281592e16c This is tai64 international format. Is there some preprocessor that I am should run this through? or maybe some type of awk statement? Or should I be looking in a totally different place for my logs? Tai64nlocal works for me. Mike
Re: qmailanalog
Steve Woolley wrote: Hi Steve, I am using qmail with the svscan method of supervising the processes. I would also like to use qmailanalog to do some stats/analysis. Under the old "inetd" method of process management. The qmail logs were under /var/log/qmail, now they are stored under /var/service/qmail/log/main. This is not a problem per se, but The timestamps under the old method were in the following form: 901967408.116537 now they are in the form: @40003a76ca281592e16c Its seens that you was using syslog and now you are using multilog. I have a very simple script to convert multilog to syslog format to use MRTG (multilog format) and qmailanalog (syslog format) at same time. If this is your problem i can send to you. Marcio Is there some preprocessor that I am should run this through? or maybe some type of awk statement? Or should I be looking in a totally different place for my logs? Steve Woolley [EMAIL PROTECTED]
Documentation of qmailanalog
Hi there, I am searching for the Documentation of qmailanalog from last one day on net. but unable to find it.Please suggest me where i can get that or if somebody has with him pl. mail me. Thanks, Piyush Jain. [EMAIL PROTECTED]
qmailanalog scripts
Hi, did anyone make the attemt to get the output of qmailanalog in a webpage. I think of kind of report-page where you get a short monthly summary for each local/virtual domain (how many messages, how many Megs, etc.) If there is nothing like this around, would anyone else be interested in such a script or is it just me? bye /ch
Re: qmailanalog scripts
hi i write one http://www.enderunix.org/isoqlog it suppliess your request On Tue, 16 Jan 2001, Clemens Hermann wrote: Hi, did anyone make the attemt to get the output of qmailanalog in a webpage. I think of kind of report-page where you get a short monthly summary for each local/virtual domain (how many messages, how many Megs, etc.) If there is nothing like this around, would anyone else be interested in such a script or is it just me? bye /ch
Re: Documentation of qmailanalog
Try the docs that come with qmailanalog. /usr/local/qmailanalog/doc/MATCHUP On Tue, 16 Jan 2001 [EMAIL PROTECTED] wrote: Hi there, I am searching for the Documentation of qmailanalog from last one day on net. but unable to find it.Please suggest me where i can get that or if somebody has with him pl. mail me. Thanks, Piyush Jain. [EMAIL PROTECTED]
Re: qmailanalog scripts
What's the point? If you have root on the machine you can view it from the terminal session. Just output the results of the various reports that qmailanalog has to a file that is available on your web server. On Tue, 16 Jan 2001, Clemens Hermann wrote: Hi, did anyone make the attemt to get the output of qmailanalog in a webpage. I think of kind of report-page where you get a short monthly summary for each local/virtual domain (how many messages, how many Megs, etc.) If there is nothing like this around, would anyone else be interested in such a script or is it just me? bye /ch
qmailanalog + qmailmrtg
Did anyone compile qmail-mrtg-1.0 from Sean ? where can i get the /var/log/qmail/qmail-send/current - how can i generate this file so the qmail-mrtg program can read it ? I used Sean Truman qmailmrtg script and seems like in qmail-mrtg.c had some problem in strncmp should be strcmp. Thanks in Advance
Re: qmailanalog + qmailmrtg
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Did anyone compile qmail-mrtg-1.0 from Sean ? where can i get the /var/log/qmail/qmail-send/current - how can i generate this file so the qmail-mrtg program can read it ? I used Sean Truman qmailmrtg script and seems like in qmail-mrtg.c had some problem in strncmp should be strcmp. you need to use mutlilog from daemontools. ftp://ftp.innominate.org/pub/pape/djb/daemontools-0.70-man.tar.gz it will be able to generate those log files for qmail-mrtg to use. Thanks in Advance Welcome. -BEGIN PGP SIGNATURE- Version: PGPfreeware 6.5.8 for non-commercial use http://www.pgp.com iQA/AwUBOiLICRtjWrXF4WJqEQIJaACgzdBLyYzhdsTMJA/GfzubwfJmMakAoN3s y5gzZBYgXEWzdUXIiM5V0moU =HWIa -END PGP SIGNATURE-
Qmailanalog ...
Can you help me with use qmail analog ??? I have installed qmailanalog and have log file without time stamps... I think that i use incorrect syntaxes... Daniel POGA Tech. Support TatraSoft Group s.r.o Sibrska 4 83102 Bratislava tel: +421-7-55574033 fax: +421-7-55566385 [EMAIL PROTECTED]
Re: Qmailanalog ...
Daniel POGAC wrote: Can you help me with use qmail analog ??? I have installed qmailanalog and have log file without time stamps... I think that i use incorrect syntaxes... I'm using the following very simple Script for general Mail Statistics: root@foxdev1:/usr/local/samba/lib cat /usr/bin/mailstat #! /bin/sh /usr/local/bin/tai64nfrac /var/log/qmail/qmail-send/current /var/log/maillog /usr/local/qmailanalog/bin/matchup /var/log/maillog /var/log/maillog.matchup /usr/local/qmailanalog/bin/zoverall /var/log/maillog.matchup rm -rf /var/log/maillog* -- --^..^-- michael maier - system development administrator flatfox ag, hanauer landstrasse 196a d-60314 frankfurt am main fon+49.(0)69.50 95 98-308 fax+49.(0)69.50 95 98-101 email [EMAIL PROTECTED] urlhttp://www.flatfox.com - m a k e m y d a y
Possible bug in qmailanalog matchup program?
All- I am attempting to process about 500 MB of qmail log files but continue to run into the following bug when running the matchup program: matchup: fatal: unable to write fd 5: file descriptor not open I have isolated the problem to the matchup program by running the following sequence of commands: # cat /var/log/qmail/*.s /var/log/qmail/current biglog.txt # cat biglog.txt | /usr/local/qmailanalog/bin/tai64nfrac big64nfrac.txt # cat big64nfrac.txt | /usr/local/qmailanalog/bin/matchup bigmatchup.txt I get the above error on the last line of this sequence of commands. I also get the same error if I string all of these commands together into a single line such as: # cat /var/log/qmail/*.s /var/log/qmail/current | /usr/local/qmailanalog/bin/tai64nfrac | /usr/local/qmailanalog/bin/matchup bigmatchup.txt Without being able to process all the data, I am afraid that I cannot extract the information I desire using the other qmailanalog tools. Thanks for the help. James
Re: Possible bug in qmailanalog matchup program?
On Wed, Nov 08, 2000 at 12:21:16PM -0500, James Morgenstein wrote: [snip] matchup: fatal: unable to write fd 5: file descriptor not open You obviously did not read the docs. Greetz, Peter -- dataloss networks '/ignore-ance is bliss' - me 'Het leven is een stuiterbal, maar de mijne plakt aan t plafond!' - me
Re: Possible bug in qmailanalog matchup program?
On Wed, Nov 08, 2000 at 12:21:16PM -0500, James Morgenstein wrote: I am attempting to process about 500 MB of qmail log files but continue to run into the following bug when running the matchup program: matchup: fatal: unable to write fd 5: file descriptor not open man matchup It's not a bug. -- Ben Beuchler [EMAIL PROTECTED] MAILER-DAEMON (612) 321-9290 x101 Bitstream Underground www.bitstream.net
Re: Possible bug in qmailanalog matchup program?
On Wed, Nov 08, 2000 at 12:21:16PM -0500, James Morgenstein wrote: All- I am attempting to process about 500 MB of qmail log files but continue to run into the following bug when running the matchup program: matchup: fatal: unable to write fd 5: file descriptor not open I have isolated the problem to the matchup program by running the following sequence of commands: # cat /var/log/qmail/*.s /var/log/qmail/current biglog.txt # cat biglog.txt | /usr/local/qmailanalog/bin/tai64nfrac big64nfrac.txt # cat big64nfrac.txt | /usr/local/qmailanalog/bin/matchup bigmatchup.txt How does this correspond to what the man page for matchup says: matchup exits after it sees end of file. It prints pend ing messages and deliveries on descriptor 5, in a format suitable for input to a future invocation of matchup: log.1 matchup out.1 5pending.2 cat pending.2 log.2 | matchup out.2 5pending.3 cat pending.3 log.3 | matchup out.3 5pending.4 Mate
qmailanalog - Help...
Hello, I am trying to setup qmailanalog - first of all my log files look like this 'Oct 30 10:32:08 flashburn qmail: 972919928.511859 new msg 103249' so I assume that I need to strip the 'Oct 30 10:32:08 flashburn qmail:' how do I do that??? Also, once that's streaming in good, what do I need to run??? any help would be appreciated!!! Thanks!!! Jesse
Re: qmailanalog - Help...
Hello, I am trying to setup qmailanalog - first of all my log files look
like this 'Oct 30 10:32:08 flashburn qmail: 972919928.511859 new msg
103249' so
I assume that I need to strip the 'Oct 30 10:32:08 flashburn qmail:' how
do I do
that??? Also, once that's streaming in good, what do I need to run???
any
help would be appreciated!!! Thanks!!!
First of all you can read the documentation, it explains how to use matchup.
Assuming your qmailanalog is in /usr/local/qmailanalog, check out
/usr/local/qmailanalog/doc/MATCHUP.
This is from MATCHUP:
=[begin]=
To remove the "Aug 1 05:30:08 host qmail:" added by syslogd, feed your
logs through
awk '{$1="";$2="";$3="";$4="";$5="";print}'
Note that the syslog mechanism is inherently unreliable: it does not
guarantee that all messages will be logged. For reliable logs, try the
logging utilities in the daemontools package.
=[end]=
Enjoy.
example:
cat /var/log/maillog | awk '{$1="";$2="";$3="";$4="";$5="";print}'
/tmp/maillog.new
cat /tmp/maillog.new | /usr/local/qmailanalog/bin/matchup
/tmp/maillog.matchup
cat /tmp/maillog.matchup | /usr/local/qmailanalog/bin/zoverall
--
Alex Khanin, Systems Administrator
TMP Worldwide, Inc | Directional Marketing -%- Interactive
relationalMail(tm) | 205 Hudson Street 7th Floor NYC 10013
P. 646.613.2074 | F. 646.613.0648 | www.relationalMail.com
Re: problems with qmailanalog utils
Jens, You need to find "tai64nfrac" and run it on the logs produced by multilog in order to convert the tai64 time stamps to the fractional ones expected by zoverall. Henry hi brett, thanks for your hint with multilog. now it works ! and, yes, i know lwq and it's great ! ps: zoverall always throws a "division by zero error". did you notice and fix it ? OK Start by looking at Life With Qmail and setting up your logging using multilog. Also, you may want to look at using qmail-mrtg as well since it provides nice pretty graphs that show change in time quite well or where specific problems/bottlenecks occur. When using in parallel with mrtg graphs from routers and gateways, it can make management much easier... regards, jens --- instant networks - netzwerkmanagment internetfullservices http://www.instant-networks.de begin:vcard n:Baragar;Henry tel;cell:416-453-5626 tel;work:416-453-5626 x-mozilla-html:TRUE url:www.instantiated.on.ca org:Instantiated Software Inc. adr:;;130 Banff Road;Toronto;Ontario;M4P 2P5;Canada version:2.1 email;internet:[EMAIL PROTECTED] title:Principal fn:Henry Baragar end:vcard S/MIME Cryptographic Signature
Re: statistics with qmailanalog
On Fri, Sep 15, 2000 at 04:51:35PM -0700, James Stevens wrote: Hrmm, I am having the same problem I have a bunch of '@#' files... I know the numbers are the microsecounds and thats all fine and dandy but qmail does not seem to be crunching these into a permanet log file.. Hrmmm, am I mising something here? Neither cyclog nor multilog crunchges anyting to a "permanent log file". That is the point. Not to fill your log partition these are rotated in a way that when the size limit is reached, a new file is used, and when the limit of number of log files is reached, the oldest file is deleted. You need to take care of the log files before they gets deleted if you want to preserve the statistics. /magnus -- http://x42.com/
Re: problems with qmailanalog utils
hi brett, thanks for your hint with multilog. now it works ! and, yes, i know lwq and it's great ! ps: zoverall always throws a "division by zero error". did you notice and fix it ? OK Start by looking at Life With Qmail and setting up your logging using multilog. Also, you may want to look at using qmail-mrtg as well since it provides nice pretty graphs that show change in time quite well or where specific problems/bottlenecks occur. When using in parallel with mrtg graphs from routers and gateways, it can make management much easier... regards, jens --- instant networks - netzwerkmanagment internetfullservices http://www.instant-networks.de
Re: statistics with qmailanalog
Hrmm, I am having the same problem I have a bunch of '@#' files... I know the numbers are the microsecounds and thats all fine and dandy but qmail does not seem to be crunching these into a permanet log file.. Hrmmm, am I mising something here? --JT - Original Message - From: "Gesner JEAN" [EMAIL PROTECTED] To: [EMAIL PROTECTED] Cc: [EMAIL PROTECTED] Sent: Wednesday, September 06, 2000 9:11 AM Subject: statistics with qmailanalog Hello, Formely i used NT,now I have my server Linux Redhat 6.1 using already qmail, but Iwould like to make now statistics for mails outgoing, entering and numbers it connection per month of my utilisateurs.De this fact, I have downloaded qmailanalog, at which I estimate who can make it.The problem, it is that I have difficulties in test the correct operation of qmailanalog.One time downloaded qmailanalog on my server, I desarchive it then I made: 1- make 2- make setup I should have something as follows: 849347513.939860 running 849347523.531129 new msg 1923 849347523.532347 info msg 19326:bytes 266... and in my configuration, after having launched make setup, I found things about like that: @000984500.0 @000984570.0 @956400.0 After these two there, I blocked myself, and I visited by evil of site inorder to find a solution, in vain.Of this, I request your assistance of means so that I would make not only the installation but to test to see, how functioning statistics. I thank you. _ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com. Share information about yourself, create your own public profile at http://profiles.msn.com.
problems with qmailanalog utils
hi, i have a big problem with qmailanalog, because i never get an output. i have one mail-logfile in /var/log/mail. i piped this thru matchup and i.e. thru zoverall, but i never get an output. zoverall i.e. says "completed messages:0" although my system logs hundreds of mail a day. any idea where to start my investigations ??? -- jens --- instant networks - netzwerkmanagment internetfullservices http://www.instant-networks.de
problems with qmailanalog utils
hi, i have a big problem with qmailanalog, because i never get an output. i have one mail-logfile in /var/log/mail. i piped this thru matchup and i.e. thru zoverall, but i never get an output. zoverall i.e. says "completed messages:0" although my system logs hundreds of mails a day. any idea where to start my investigations ??? -- jens --- instant networks - netzwerkmanagment internetfullservices http://www.instant-networks.de
RE: problems with qmailanalog utils
OK Start by looking at Life With Qmail and setting up your logging using multilog. Also, you may want to look at using qmail-mrtg as well since it provides nice pretty graphs that show change in time quite well or where specific problems/bottlenecks occur. When using in parallel with mrtg graphs from routers and gateways, it can make management much easier... /BR -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On Behalf Of Jens Georg Sent: Saturday, 16 September 2000 11:40 AM To: qmail mailinglist Subject: problems with qmailanalog utils hi, i have a big problem with qmailanalog, because i never get an output. i have one mail-logfile in /var/log/mail. i piped this thru matchup and i.e. thru zoverall, but i never get an output. zoverall i.e. says "completed messages:0" although my system logs hundreds of mails a day. any idea where to start my investigations ??? -- jens --- instant networks - netzwerkmanagment internetfullservices http://www.instant-networks.de
qmailanalog compiling problem
Ok, I thought I'd take a gander at the qmailanalog utility from DJB's website. Downloaded it and de-tar'd/gunzip'd it. Read the README and INSTALL files. Ran "make" and get the following error message. ---Error Message start--- [root@black qmailanalog-0.70]# make ./compile error.c In file included from /usr/include/errno.h:36, from error.c:1: /usr/include/bits/errno.h:25: linux/errno.h: No such file or directory make: *** [error.o] Error 1 ---Error Message stop--- I beleive I've got all the development stuff installed but this looks like a missing library or some such type file. I have "/usr/include/errno.h" and "/usr/include/error.h" files on the system. I've looked through the files in the package and checked the mailing list archive but can't seem to locate any advice on this one on my own. Anyone know what will fix this? I've looked around and don't Stephen Berg //-USAF Instructor -/- Reluctant NT User -/- Web Designer-// //- Home = [EMAIL PROTECTED] -// //- Work = [EMAIL PROTECTED] -// //- http://iceberg.3c0x1.com/ -/- http://www.3c0x1.com -//
Re: qmailanalog compiling problem
On Thu, Sep 14, 2000 at 06:23:41PM -0500, Stephen Berg wrote: /usr/include/bits/errno.h:25: linux/errno.h: No such file or directory I believe errno.h is part of the kernel source tree. I'm going to guess that you are using RedHat and did not install the kernel-devel package, which includes all the kernel header files... Do that and you should be good to go. Ben -- Ben Beuchler [EMAIL PROTECTED] MAILER-DAEMON (612) 321-9290 x101 Bitstream Underground www.bitstream.net
Re: qmailanalog compiling problem
Ok, take a look here and see if I'm missing something. I'm pretty sure I got all the packages necessary to do this sort of thing. [root@black qmailanalog-0.70]# rpm -qa | grep -i kernel kernel-utils-2.2.14-5.0 kernelcfg-0.5-5 kernel-pcmcia-cs-2.2.14-5.0 kernel-ibcs-2.2.16-3 kernel-2.2.16-3 kernel-2.2.14-5.0 kernel-pcmcia-cs-2.2.16-3 kernel-headers-2.2.16-3 kernel-source-2.2.16-3 I'm running RedHat 6.2. On Thu, 14 Sep 2000 18:30:14 -0500, Ben Beuchler wrote: I believe errno.h is part of the kernel source tree. I'm going to guess that you are using RedHat and did not install the kernel-devel package, which includes all the kernel header files... Do that and you should be good to go. Stephen Berg //-USAF Instructor -/- Reluctant NT User -/- Web Designer-// //- Home = [EMAIL PROTECTED] -// //- Work = [EMAIL PROTECTED] -// //- http://iceberg.3c0x1.com/ -/- http://www.3c0x1.com -//
Re: qmailanalog compiling problem
also sprach sberg: Ok, take a look here and see if I'm missing something. I'm pretty sure I got all the packages necessary to do this sort of thing. [root@black qmailanalog-0.70]# rpm -qa | grep -i kernel kernel-utils-2.2.14-5.0 kernelcfg-0.5-5 kernel-pcmcia-cs-2.2.14-5.0 kernel-ibcs-2.2.16-3 kernel-2.2.16-3 kernel-2.2.14-5.0 kernel-pcmcia-cs-2.2.16-3 kernel-headers-2.2.16-3 kernel-source-2.2.16-3 If you installed kernel-headers before kernel-source (which makes sense, since kernel-headers is a prereq for kernel-source), you broke the symlinks. Do a ``rpm -Uhv --force kernel-headers-2.2.16-3.i386.rpm'' and the symlinks magically reappear. This is a (RedHat) bug, not a feature. /pg -- Peter Green : Gospel Communications Network, SysAdmin : [EMAIL PROTECTED] --- I'm an idiot.. At least this [bug] took about 5 minutes to find.. Disquieting ... (Gonzalo Tornaria in response to Linus Torvalds's mailing about a kernel bug.)
Re: qmailanalog compiling problem
On Thu, Sep 14, 2000 at 06:42:20PM -0500, Stephen Berg wrote: I believe errno.h is part of the kernel source tree. I'm going to guess that you are using RedHat and did not install the kernel-devel package, which includes all the kernel header files... [foo@sol pelle]$ rpm -qf /usr/include/sys/errno.h [and other places] glibc-devel-2.1.2-11 [foo@sol pelle]$ rpm -qf /usr/lib/bcc/include/errno.h dev86-0.14.9-1 -Johan -- Johan Almqvist
Re: qmailanalog compiling problem
On Thu, 14 Sep 2000 19:47:40 -0400, Peter Green wrote: If you installed kernel-headers before kernel-source (which makes sense, since kernel-headers is a prereq for kernel-source), you broke the symlinks. Do a ``rpm -Uhv --force kernel-headers-2.2.16-3.i386.rpm'' and the symlinks magically reappear. Way cool, that did the trick. Thanks much. Problem solved. This is a (RedHat) bug, not a feature. I was always told a feature was a bug with seniority. :-) Stephen Berg //-USAF Instructor -/- Reluctant NT User -/- Web Designer-// //- Home = [EMAIL PROTECTED] -// //- Work = [EMAIL PROTECTED] -// //- http://iceberg.3c0x1.com/ -/- http://www.3c0x1.com -//
statistics with qmailanalog
Hello, Formely i used NT,now I have my server Linux Redhat 6.1 using already qmail, but Iwould like to make now statistics for mails outgoing, entering and numbers it connection per month of my utilisateurs.De this fact, I have downloaded qmailanalog, at which I estimate who can make it.The problem, it is that I have difficulties in test the correct operation of qmailanalog.One time downloaded qmailanalog on my server, I desarchive it then I made: 1- make 2- make setup I should have something as follows: 849347513.939860 running 849347523.531129 new msg 1923 849347523.532347 info msg 19326:bytes 266... and in my configuration, after having launched make setup, I found things about like that: @000984500.0 @000984570.0 @956400.0 After these two there, I blocked myself, and I visited by evil of site inorder to find a solution, in vain.Of this, I request your assistance of means so that I would make not only the installation but to test to see, how functioning statistics. I thank you. _ Get Your Private, Free E-mail from MSN Hotmail at http://www.hotmail.com. Share information about yourself, create your own public profile at http://profiles.msn.com.
usage of qmailanalog
hi, can somebody please tell me how to analyse /var/log/mail using the qmailanalog utils ? i followed the manpages, but output is always empty. -- regards, jens --- department computer science, university of dortmund linux ... life's too short for reboots! begin:vcard n:Georg;Jens x-mozilla-html:FALSE org:University of Dortmund, Germany;computer science adr:;; version:2.1 email;internet:[EMAIL PROTECTED] x-mozilla-cpt:;0 fn:Jens Georg end:vcard
Re: qmailanalog report
I think it's time problem!! Because I change my
system time .
Now it's ok !
Thanks your care , PipE
.
# Here is my script and the attachment
is my log file #
#!/bin/sh
cd /usr/local/qmailanalog/bin
cat /var/log/maillog | grep -v
imaplogin | awk
'{$1=;$2=;$3=;$4=;$5=;print}'
| \
./matchup |
./zoverall
At 11:17 25/8/00
+0800, you wrote:Follow From this mail that mean u use qmailanalog
for analyze your log file So can i know command line that u use i
try to use so many time But i no have output like you Brgs
I use qmailanalog
recently. But I don't understand why the xdelay is
minus.Is that right ? If it is
right , what the real mean by that.Appreciate any help . here is my analog #Completed messages:
104Recipients for completed messages: 133Total delivery
attempts for completed messages: 195Average delivery attempts
per completed message: 1.875Bytes in completed messages:
45428841Bytes weighted by success: 45960852Average message
qtime (s): 1157.42Total delivery
attempts: 419 success: 105 failure: 28
deferral: 286Total ddelay (s): 61899.111729Average ddelay
per success (s): 589.515350Total xdelay (s):
-28801.783392Average xdelay per delivery attempt (s):
-68.739340Time span (days): 2.54319Average concurrency:
-0.131077=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=
PipE System EngineerSamart Infonet Co.ltd99/12
Software Park, 30th Floor Chaengwattana Rd., Klong Gluar, Pak-kred
Nonthaburi 11120[EMAIL PROTECTED]icq uin #
10831office phone : (662) 502-6388 fax : (662)
502-6382=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=
Re: qmailanalog report
# Here is my script and the attachment is my
log file #
#!/bin/sh
cd /usr/local/qmailanalog/bin
cat /var/log/maillog | grep -v
imaplogin | awk
'{$1=;$2=;$3=;$4=;$5=;print}'
| \
./matchup | ./zoverall
At 11:17 25/8/00
+0800, you wrote:Follow From this mail that mean u use qmailanalog for
analyze your log file So can i know command line that u use i try to
use so many time But i no have output like you Brgs
I use qmailanalog recently.
But I don't understand why the xdelay is
minus.Is that right ? If it is right
, what the real mean by that.Appreciate any
help . here is my analog
#Completed messages:
104Recipients for completed messages: 133Total delivery attempts
for completed messages: 195Average delivery attempts per completed
message: 1.875Bytes in completed messages: 45428841Bytes
weighted by success: 45960852Average message qtime (s):
1157.42Total delivery attempts:
419 success: 105 failure: 28 deferral:
286Total ddelay (s): 61899.111729Average ddelay per success (s):
589.515350Total xdelay (s): -28801.783392Average xdelay per
delivery attempt (s): -68.739340Time span (days): 2.54319Average
concurrency: -0.131077=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=
PipE System EngineerSamart Infonet Co.ltd99/12 Software
Park, 30th Floor Chaengwattana Rd., Klong Gluar, Pak-kred Nonthaburi
11120[EMAIL PROTECTED]icq
uin # 10831office phone : (662) 502-6388 fax : (662)
502-6382=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=--=
maillog
qmailanalog ideas?
I'm trying to set up some quick scripts using qmailanalog. I would like to generate a report every morning on the previous 24 hours. The new multilog does not rotate based on time but rather on size, so that's a bit awkward. Has anyone arrived at a simple way to dig all the log entries covering a specified period of time from a multilog directory? Gracias, Ben -- Ben Beuchler [EMAIL PROTECTED] MAILER-DAEMON (612) 321-9290 x101 Bitstream Underground www.bitstream.net
Re: qmailanalog ideas?
Put such a stats collection utility in a pipeline in your qmail init script. Such an arrangement avoids the need to deal with multilog rotation. You may wish to write such as utility in C/C++ for efficiency if your servers are busy. Regards, Chin Fang [EMAIL PROTECTED] I'm trying to set up some quick scripts using qmailanalog. I would like to generate a report every morning on the previous 24 hours. The new multilog does not rotate based on time but rather on size, so that's a bit awkward. Has anyone arrived at a simple way to dig all the log entries covering a specified period of time from a multilog directory? Gracias, Ben -- Ben Beuchler [EMAIL PROTECTED] MAILER-DAEMON (612) 321-9290 x101 Bitstream Underground www.bitstream.net
Re: qmailanalog for dummies
Hello, I run this script from cron one time per day. I've copied from qmail list time ago and it's slighty modified from the original one made by Jay Soffian. BTW thanks Jay. #!/bin/sh PATH="/usr/local/bin/qmailanalog:/usr/local/bin:$PATH" export PATH umask 077 TMP_FILE="/var/log/qmail/qmailanalog.tmp" EXT_FILE="/var/log/qmail/qmailanalog.ext" OUT_FILE="/var/log/qmail/qmailanalog.out" LOG_FILE="/var/log/qmail/*" rm -f $TMP_FILE $OUT_FILE cat MAIL_HEADER $OUT_FILE From: [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: `hostname` qmail statistics MAIL_HEADER touch $EXT_FILE cat $EXT_FILE $LOG_FILE | matchup $TMP_FILE 5$EXT_FILE.new mv $EXT_FILE.new $EXT_FILE zoverall $TMP_FILE $OUT_FILE echo "--" $OUT_FILE zfailures$TMP_FILE $OUT_FILE echo "--" $OUT_FILE zdeferrals$TMP_FILE $OUT_FILE /var/qmail/bin/qmail-inject $OUT_FILE rm -f $TMP_FILE $OUT_FILE Paco Gracia Director Técnico Amira Sistemas
Re: qmailanalog for dummies
"Tony Campisi" [EMAIL PROTECTED] wrote: Our qmail server has been up for 2 days and everything is working fine. I would like to use qmailanalog to analyze activity. I have read through the archive but need more answers. I installed qmailanalog-0.70 qmailanalog requires timestamps in a particular format that's no longer supported by cyclog, and has never been supported by syslog. If you're using cyclog, you'll need to find a utility on www.qmail.org to convert them to the old format for qmailanalog. -Dave
qmailanalog for dummies
Our qmail server has been up for 2 days and everything is working fine. I
would like to use qmailanalog to analyze activity.
I have read through the archive but need more answers.
I installed qmailanalog-0.70
:From an archived message:
awk '{$1="";$2="";$3="";$4="";$5="";print}' /var/log/maillog \
| matchup \
processed_log
My 'processed_log' is an empty file I created - /var/log/qmail/analog
I want to analyze my /var/log/qmail/current file.
awk '{$1="";$2="";$3="";$4="";$5="";print}' /var/log/qmail/current |
/usr/local/qmailanalog/bin/matchup /var/log/qmail/analog
The above is all on one line
After running the above, my 'analog' file has data in it like,
? 3317 from qmail-return-51885-tony.campisi=cardinalservices.com@list
? 256010 to local [EMAIL PROTECTED]
?
? 1908 from qmail-return-51884-tony.campisi=cardinalservices.com@list
? 256010 to local [EMAIL PROTECTED]
? 0/40
?
? 0/40
When I try
/usr/local/qmailanalog/bin/zoverall /var/log/qmail/analog
I get
One line per recipient. Information on each line:
* sbytes is the number of bytes successfully delivered to this recipient.
* mess is the number of messages sent to this recipient (success plus failu
re).
* tries is the number of delivery attempts (success, failure, deferral).
* xdelay is the total xdelay incurred by this recipient.
sbytes mess tries xdelay recipient
There is no information under these headers. Can someone please tell me what
I'm doing wrong.
TIA,
Tony Campisi
stats from qmailanalog
I am new to qmail and I am trying to set up the qmailanalog scripts to provide statistics and process the log files. I can't get any of it to work, I read the read-mes and man pages and am clueless. My installation follows the defaults in qmail, appears to work fine and uses mail directories owned by the user and placed beneath their home directories. I ran the tai64local program against a copy of a log and got human time stamps. I followed the steps on the matchup and got as far as a file that had my log with a question mark on each line. After that errors all around. the next instructions on the manpage follow log.1 matchup out.1 5pending.2 cat pending.2 log.2 | matchup out.2 5pending.3 cat pending.3 log.3 | matchup out.3 5pending.4 Is this some kind of log rotation or what? What's the deal with 5 in the first line? What on earth does that do? As you can tell I am totally lost. I really have tried to find this stuff in man pages, manuals and by searching the net, but I'm lost. Is there a how-to or a kind soul who can explain step by step (with some expanations of what a given command is doing) for me. I would be glad to codify this for some kind of mini-how to or for inclusion with the scripts with the permission of the appropriate people. Thank you Dan Sichel puzzled newbie
Re: stats from qmailanalog
[Dan, please configure your mailer to wrap lines that are longer than 80 characters.] "flitcraft33" [EMAIL PROTECTED] wrote: I ran the tai64local program against a copy of a log and got human time stamps. I followed the steps on the matchup and got as far as a file that had my log with a question mark on each line. Show us: 1) a sample line from your logs, untouched 2) the same line passed through tai64nlocal 3) a sample line from the output of matchup After that errors all around. the next instructions on the manpage follow log.1 matchup out.1 5pending.2 cat pending.2 log.2 | matchup out.2 5pending.3 cat pending.3 log.3 | matchup out.3 5pending.4 Is this some kind of log rotation or what? What's the deal with 5 in the first line? What on earth does that do? cyclog (and multilog) automatically rotates the logs, and some of the transactions at the end of one file might not be completed until the beginning of the next file. matchup outputs these incomplete--or pending--entries to file descriptor 5. Is there a how-to or a kind soul who can explain step by step (with some expanations of what a given command is doing) for me. I would be glad to codify this for some kind of mini-how to or for inclusion with the scripts with the permission of the appropriate people. There's not a good HOWTO for qmail-analog, and things are in something of a state of flux at the moment, so now's probably not the best time to undertake writing one. qmail-analog depends upon timestamps in the format used by cyclog, but cyclog has been superceded by multilog, which uses a different timestamp format. There are utilities available that will convert the timestamps. -Dave
RE: stats from qmailanalog
http://www.ornl.gov/its/archives/mailing-lists/qmail/2000/06/msg00325.html That is the link to the script that I'm using to process my mail logs. It has been pointed out to me that the conversion routine (orginally posted by Jos ?? Someone - I can't find the orginal in the archive for some reason) that I'm using is 10 second off from tai64nlocal, but it is close enough for my needs. -Original Message- From: flitcraft33 [mailto:[EMAIL PROTECTED]] Sent: Friday, July 28, 2000 12:31 PM To: [EMAIL PROTECTED] Subject: stats from qmailanalog I am new to qmail and I am trying to set up the qmailanalog scripts to provide statistics and process the log files. I can't get any of it to work, I read the read-mes and man pages and am clueless. My installation follows the defaults in qmail, appears to work fine and uses mail directories owned by the user and placed beneath their home directories. I ran the tai64local program against a copy of a log and got human time stamps. I followed the steps on the matchup and got as far as a file that had my log with a question mark on each line. After that errors all around. the next instructions on the manpage follow log.1 matchup out.1 5pending.2 cat pending.2 log.2 | matchup out.2 5pending.3 cat pending.3 log.3 | matchup out.3 5pending.4 Is this some kind of log rotation or what? What's the deal with 5 in the first line? What on earth does that do? As you can tell I am totally lost. I really have tried to find this stuff in man pages, manuals and by searching the net, but I'm lost. Is there a how-to or a kind soul who can explain step by step (with some expanations of what a given command is doing) for me. I would be glad to codify this for some kind of mini-how to or for inclusion with the scripts with the permission of the appropriate people. Thank you Dan Sichel puzzled newbie
qmailanalog compatible with multilog?
Is qmailanalog compatible with multilog when qmail is run under tcpserver? Thanks, John -- John ConoverTel. 408.370.2688 [EMAIL PROTECTED] 631 Lamont Ct. Cel. 408.772.7733 Campbell, CA 95008 Fax. 408.379.9602 http://www.johncon.com
Re: qmailanalog compatible with multilog?
On 23-Jul-2000, John Conover wrote: Is qmailanalog compatible with multilog when qmail is run under tcpserver? I'm using qmailanalog 0.70 and I need to pipe the logs to tai64nfrac first before feeding them to matchup. You can find tai64nfrac from http://qmail.org/top.html Ronny
Re: qmailanalog compatible with multilog?
On Sun, Jul 23, 2000 at 07:20:31PM -, John Conover wrote: Is qmailanalog compatible with multilog when qmail is run under tcpserver? Yes and no. Multilog produces tai64n timestamps, while qmailanalog only understands the older tai timestamps. A couple of conversion programs exist. -- Bruce Guenter [EMAIL PROTECTED] http://em.ca/~bruceg/ PGP signature
Qmailanalog
I ve just installed qmailanalog and daemontools on my server Could you please just help me on I can get good daily report of qmail usage with multilog ? What shall I do exactly ??? Is there a FAQ on this ? Thank you
Re: qmailanalog and zoverall.
Hi,
I do it with:
printf("Bytes in completed messages: %.0f\n", mbytes)
printf("Bytes weighted by success: %.0f\n", rbytes)
Thanks
On Tue, 18 Jul 2000, Michael T. Babcock wrote:
Is awk perhaps using an output format that uses scientific notation when the
number (mbytes) is too large? Should you change "print mbytes" to "printf
("%d", mbytes)" ???
Moragues Ramón, Antonio wrote:
Hi,
I run a qmail server and I want know the total number of bytes sent
trought it, y use qmailanalog 0.70 and gawk 3.0.4, but instead of show the
total bytes in completes messages show a nunmber like this 1.983e+10, I
tried use gawk and mawk, the server is a Debian GNU/Linux 2.2 on a PII
450, anyone know whats the problem?.
Completed messages: 203516
Recipients for completed messages: 249900
Total delivery attempts for completed messages: 262893
Average delivery attempts per completed message: 1.29176
Bytes in completed messages: 1.983e+10
Bytes weighted by success: 3.26035e+10
Average message qtime (s): 187.789
Total delivery attempts: 277221
success: 248610
failure: 3155
deferral: 25456
Total ddelay (s): 41635824.792378
Average ddelay per success (s): 167.474457
Total xdelay (s): 6424254.748057
Average xdelay per delivery attempt (s): 23.173767
Time span (days): 15.0111
Average concurrency: 4.95331
qmailanalog and zoverall.
Hi, I run a qmail server and I want know the total number of bytes sent trought it, y use qmailanalog 0.70 and gawk 3.0.4, but instead of show the total bytes in completes messages show a nunmber like this 1.983e+10, I tried use gawk and mawk, the server is a Debian GNU/Linux 2.2 on a PII 450, anyone know whats the problem?. Completed messages: 203516 Recipients for completed messages: 249900 Total delivery attempts for completed messages: 262893 Average delivery attempts per completed message: 1.29176 Bytes in completed messages: 1.983e+10 Bytes weighted by success: 3.26035e+10 Average message qtime (s): 187.789 Total delivery attempts: 277221 success: 248610 failure: 3155 deferral: 25456 Total ddelay (s): 41635824.792378 Average ddelay per success (s): 167.474457 Total xdelay (s): 6424254.748057 Average xdelay per delivery attempt (s): 23.173767 Time span (days): 15.0111 Average concurrency: 4.95331
Re: qmailanalog and zoverall.
Is awk perhaps using an output format that uses scientific notation when the
number (mbytes) is too large? Should you change "print mbytes" to "printf
("%d", mbytes)" ???
Moragues Ramón, Antonio wrote:
Hi,
I run a qmail server and I want know the total number of bytes sent
trought it, y use qmailanalog 0.70 and gawk 3.0.4, but instead of show the
total bytes in completes messages show a nunmber like this 1.983e+10, I
tried use gawk and mawk, the server is a Debian GNU/Linux 2.2 on a PII
450, anyone know whats the problem?.
Completed messages: 203516
Recipients for completed messages: 249900
Total delivery attempts for completed messages: 262893
Average delivery attempts per completed message: 1.29176
Bytes in completed messages: 1.983e+10
Bytes weighted by success: 3.26035e+10
Average message qtime (s): 187.789
Total delivery attempts: 277221
success: 248610
failure: 3155
deferral: 25456
Total ddelay (s): 41635824.792378
Average ddelay per success (s): 167.474457
Total xdelay (s): 6424254.748057
Average xdelay per delivery attempt (s): 23.173767
Time span (days): 15.0111
Average concurrency: 4.95331
FW: qmailanalog and multilog
Not using the patches from www.qmail.org, but this works for me
Script to convert to a format qmailanalog likes
#!/usr/bin/perl
while () {
if (my($s,$t,$rest)=/^\@.(\w{15})(\w{8})(.*)/) {
$s = hex($s);
$t = hex($t); $t =~ s/500$//;
$_ = "$s.$t$rest\n";
}
} continue {
print;
}
exit 0;
Script to process the logs and mail to me
#!/bin/sh
PATH=/usr/local/qmailanalog/bin:/var/qmail/bin:/bin:/usr/bin
QMAILLOG="/tmp/q.$$"
QMAILTMP="/tmp/r.$$"
umask 077
cat /var/log/qmail/@* $QMAILTMP
cat /var/log/qmail/current $QMAILTMP
cat $QMAILTMP | tai64n2time | matchup $QMAILLOG 5/dev/null
DATE=`date +'%a %d %b'`
(echo "To: [EMAIL PROTECTED]"
echo "From: [EMAIL PROTECTED]"
echo "Subject: Qmail daily report $DATE"
echo ""
zoverall $QMAILLOG) | qmail-inject
rm -f $QMAILLOG
rm -f $QMAILTMP
-Original Message-
From: kbo [mailto:kbo]On Behalf Of Ken Jones
Sent: Wednesday, June 07, 2000 3:29 PM
To: [EMAIL PROTECTED]
Subject: qmailanalog and multilog
Does anyone have a patch to qmailanalog to read
the new multilog time format?
Ken Jones
inter7
qmailanalog and multilog
Does anyone have a patch to qmailanalog to read the new multilog time format? Ken Jones inter7
Re: qmailanalog and multilog
On 07-Jun-2000, Ken Jones wrote: Does anyone have a patch to qmailanalog to read the new multilog time format? It's not a patch like you want, but in case you want to know how to make it work: I use a C program called tai64nfrac found on qmail.org to filter the log before feeding to qmailanalog's matchup. Ronny
Re: qmailanalog and multilog
Ken Jones writes: Does anyone have a patch to qmailanalog to read the new multilog time format? There's two (2) patches to create a program which accepts multilog time format (tai64n) and rewrites it into fractional seconds (taifrac) format. They're listed on www.qmail.org. -- -russ nelson [EMAIL PROTECTED] http://russnelson.com Crynwr sells support for free software | PGPok | "Ask not what your country 521 Pleasant Valley Rd. | +1 315 268 1925 voice | can force other people to Potsdam, NY 13676-3213 | +1 315 268 9201 FAX | do for you..." -Perry M.
qmailanalog - matchup
Hi,
I've (finally) started using qmailanalog, but when i try to pass a specific maillog
through matchup i get the following error :
matchup: fatal: unable to write to fd 5: file descriptor not open
I'm using a script to pass maillog maillog.1 thu 7 to matchup.
2 of the logs generate this error :-(
I've attached the script, just in case.
I know it's not great programming, it's more 'brute force', but i'm a newbie to unix
and haven't gotten the hang of scripting yet :-(
Thanks,
Steffan
--
http://therookie.dyndns.org
#
## Which shell to use for processing
#
#!/usr/local/bin/bash
#
## Where should temporary files be stored
#
TempLoc=/tmp
#
## Where can i find the log files
#
LogLoc=/var/log
cd $TempLoc
echo preprocessing maillog.7
echo -n ' copying'
cp $LogLoc/maillog.7.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.7.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.7 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.6
echo -n ' copying'
cp $LogLoc/maillog.6.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.6.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.6 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.5
echo -n ' copying'
cp $LogLoc/maillog.5.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.5.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.5 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.4
echo -n ' copying'
cp $LogLoc/maillog.4.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.4.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.4 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.3
echo -n ' copying'
cp $LogLoc/maillog.3.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.3.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.3 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.2
echo -n ' copying'
cp $LogLoc/maillog.2.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.2.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.2 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.1
echo -n ' copying'
cp $LogLoc/maillog.1.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.1.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.1 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog.0
echo -n ' copying'
cp $LogLoc/maillog.0.gz .
echo ' .'
echo -n ' unpacking'
gunzip ./maillog.0.gz
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog.0 | matchup
./matchup.out
echo ' .'
echo preprocessing maillog
echo -n ' copying'
cp $LogLoc/maillog .
echo ' .'
echo -n ' unpacking'
echo -n ' not needed'
echo ' .'
echo -n ' filtering'
awk '{$1="";$2="";$3="";$4="";$5="";print}' ./maillog | matchup
./matchup.out
echo ' .'
echo cleaning up
echo -n ' removing maillog.7'
rm maillog.7
echo ' .'
echo -n ' removing maillog.6'
rm maillog.6
echo ' .'
echo -n ' removing maillog.5'
rm maillog.5
echo ' .'
echo -n ' removing maillog.4'
rm maillog.4
echo ' .'
echo -n ' removing maillog.3'
rm maillog.3
echo ' .'
echo -n ' removing maillog.2'
rm maillog.2
echo ' .'
echo -n ' removing maillog.1'
rm maillog.1
echo ' .'
echo -n ' removing maillog.0'
rm maillog.0
echo ' .'
echo -n ' removing maillog'
rm maillog
echo ' .'
Re: qmailanalog - matchup
On Thu, Apr 27, 2000 at 12:35:21PM +0200, Steffan Hoeke wrote: Hi, I've (finally) started using qmailanalog, but when i try to pass a specific maillog through matchup i get the following error : matchup: fatal: unable to write to fd 5: file descriptor not open Did you read the man page for matchup? matchup exits after it sees end of file. It prints pend- ing messages and deliveries on descriptor 5, in a format suitable for input to a future invocation of matchup: log.1 matchup out.1 5pending.2 cat pending.2 log.2 | matchup out.2 5pending.3 cat pending.3 log.3 | matchup out.3 5pending.4 It's only an error if there are messages pending. You'll probably want to change your script to reflect this or you won't have accurate reports. /pg -- Peter Green Gospel Communications Network, SysAdmin [EMAIL PROTECTED]
Re: qmailanalog
Hello all, On Thu, Mar 30, 2000 at 08:42:07PM +0200, S.P. Hoeke wrote: I'm wondering if there's a FAQ or HOW-TO with regards to qmailanalog... The man pages are, for me, not sufficient to get it running :-( I had it running once, but it didn't produce the desired results. What irks me is that it's a real hack of awk and the like that I don't understand (read "unmaintainable for me"). Does anyone know if there is perchance a Perl version floating around? Other than that running qmailanalog was a two-stage processing of the qmail log files, as far as memory serves. First I had to produce an intermediate format which was then processed by various programs to generate the different reports. Best Regards, --Toni++
qmailanalog
Hello, I'm wondering if there's a FAQ or HOW-TO with regards to qmailanalog... The man pages are, for me, not sufficient to get it running :-( THNX, Steffan
Re: qmailanalog
"S.P. Hoeke" [EMAIL PROTECTED] wrote: I'm wondering if there's a FAQ or HOW-TO with regards to qmailanalog... The man pages are, for me, not sufficient to get it running :-( Have you looked at /usr/local/qmailanalog/doc/*? -Dave
Re: qmailanalog
"S.P. Hoeke" [EMAIL PROTECTED] wrote: This is wat i DO have, but it's not sufficient :( /usr/local/share/doc/qmailanalog /usr/local/share/doc/qmailanalog/ACCOUNTING /usr/local/share/doc/qmailanalog/MATCHUP In what way, specifically, is MATCHUP inadequate? -Dave
Re: qmailanalog
On Thu, Mar 30, 2000 at 02:01:11PM -0500, Dave Sill wrote: "S.P. Hoeke" [EMAIL PROTECTED] wrote: This is wat i DO have, but it's not sufficient :( /usr/local/share/doc/qmailanalog /usr/local/share/doc/qmailanalog/ACCOUNTING /usr/local/share/doc/qmailanalog/MATCHUP In what way, specifically, is MATCHUP inadequate? Keep in mind i'm a newbie to qmail and OpenBSD... a lot of this stuff maybe self-explanatory to the more 'advanced' users. Specifically I don't know how to "feed your log through" the awk line. Same goes for "feed the matchup output through any of the" scripts -Dave Greetz, Steffan
Re: qmailanalog and UNIX basics
"S.P. Hoeke" [EMAIL PROTECTED] wrote: Specifically I don't know how to "feed your log through" the awk line. Same goes for "feed the matchup output through any of the" scripts You ``feed a file through'' a program when you arrange for the file to be the input of the program. Three obvious ways of doing that are: 1. Input redirection: awk 'SCRIPT' FILE 2. Pipes: cat FILE | awk 'SCRIPT' 3. Command line arguments: awk 'SCRIPT' FILE Option #3 only works for programs which take a file as an argument, but most programs do. For example, awk, perl, sed, grep, more, less, tail, head, etc., all take a file as an argument. I have a silly personal prejudice against using #3: for operating on a single file, I usually use #1 instead; for operating on many files, I usually use #2 instead. Using #2 for a single file will win you Don Libes's "Useless Use of Cat Award". It wastes a whole process over solution #1. For multiple files, however, #2 is a useful use of cat. The fundamental concept of UNIX is the "filter". Any program which reads from the standard input, does something, and writes to the standard output is a filter. They can be assembled in "pipelines", which are probably the single most powerful concept in UNIX (though probably originally a MULTICS concept). To advance out of newbie-hood, you need "The UNIX Programming Environment" by Kernighan and Pike. Buy it, read it, live it. It's $34.00 US from http://www.us.buy.com/books/product.asp?sku=30014507. Kernighan, by the way, is the "K" in AWK, one of the authors of the C language, and one of the inventors of UNIX. Len. -- The pitiful state of "secure code" is shocking. (Actually, I just wrote an essay on the topic. Get a copy for yourself at: http://www.counterpane.com/pitfalls.html. -- Bruce Schneier
Re: qmailanalog
Is qmailanalog compatible with multilog? The first part of the
MATCHUP doc file says:
Before using qmailanalog, make sure that your qmail log contains
microsecond timestamps: e.g.,
901967408.113926 new msg 19287
901967408.116537 info msg 19287: bytes ...
Um, nope. I have lines like this:
@400038e3b11b21dd6d0c info msg 24695: bytes 70110 from snip
@400038e3b11b223b82fc starting delivery 26852: msg 24695 to local snip
Any good one liners to make this work?
Thanks,
jon
At 2:41 PM -0500 3/30/00, Dave Sill wrote:
"S.P. Hoeke" [EMAIL PROTECTED] wrote:
Keep in mind i'm a newbie to qmail and OpenBSD... a lot of this stuff
maybe self-explanatory to the more 'advanced' users.
No problem.
Specifically I don't know how to "feed your log through" the awk line.
If your log is in a file called "foo", do:
awk '{$1="";$2="";$3="";$4="";$5="";print}' foo
That will, of course, output to standard output, so you want to feed
it to matchup:
awk '{$1="";$2="";$3="";$4="";$5="";print}' foo | ./matchup
And matchup outputs to standard output, so you'll want to redirect it
to a file, say matchup.out:
awk '{$1="";$2="";$3="";$4="";$5="";print}' foo | ./matchup matchup.out
Same goes for "feed the matchup output through any of the" scripts
E.g.:
./zoverall matchup.out
-Dave
Re: qmailanalog
Jon Rust [EMAIL PROTECTED] wrote: Is qmailanalog compatible with multilog? The first part of the MATCHUP doc file says: Before using qmailanalog, make sure that your qmail log contains microsecond timestamps: e.g., 901967408.113926 new msg 19287 901967408.116537 info msg 19287: bytes ... Um, nope. I have lines like this: @400038e3b11b21dd6d0c info msg 24695: bytes 70110 from snip @400038e3b11b223b82fc starting delivery 26852: msg 24695 to local snip Those would be Dan's newer TAI64 timestamps IIRC. One of his packages can convert the timestamps back and forth, but I can't find it at the moment. Newer daemontools maybe? Charles -- --- Charles Cazabon[EMAIL PROTECTED] GPL'ed software available at: http://www.qcc.sk.ca/~charlesc/software/ Any opinions expressed are just that -- my opinions. ---
Re: qmailanalog
At 4:24 PM -0600 3/30/00, Charles Cazabon wrote: Jon Rust [EMAIL PROTECTED] wrote: Um, nope. I have lines like this: @400038e3b11b21dd6d0c info msg 24695: bytes 70110 from snip @400038e3b11b223b82fc starting delivery 26852: msg 24695 to local snip Those would be Dan's newer TAI64 timestamps IIRC. One of his packages can convert the timestamps back and forth, but I can't find it at the moment. Newer daemontools maybe? Charles tai64nlocal will convert it into something like 2000-03-30 07:56:09.195584500, but qmailanalog doesn't want that either. :-/ Looks like a job for perl. jon
