Hello,
I'm using amavisd-new 2.4.3 with SA 3.1.7, Postfix 2.2.10 and clamav
0.88.7 - so everything should be pretty up-to-date. I'm facing
performance problems, so I'd like to ask several questions. Sorry for a
mess, I have no more stamina to sort them any better :-(
I have quite standard configuration, with the exception of DCC plugin
turned on and Razor/Pyzor off (we are running local DCC servers so the
response should be really fast).
tail -f /var/log/maillog |perl -ne 'chomp; /amavis.*, (\d+ ms)$/ &&
print "$1\n"'
2584 ms
2634 ms
4791 ms
6591 ms
487 ms
2360 ms
2875 ms
2618 ms
4597 ms
2434 ms
4703 ms
4728 ms
162 ms
7665 ms
1684 ms
1044 ms
5082 ms
5201 ms
2544 ms
3032 ms
2609 ms
2547 ms
2546 ms
6939 ms
2972 ms
Are such times normal for 2.6GHz Opteron? What should I do to decrease
them? SA is configured for Bayes and AWL DB in MySQL, I have local DNS
cache, dedicated filesystem for mail spools.
My load avg is about 2 with network tests turned on and mail queues
slowly filling. When I try to turn network tests off, load goes to cca
18 and queues start to empty again, but the ratio of catched spam goes
down as well. Should I run more amavis servers with network tests on? I
already have 32...
I don't see any signs of IO/CPU/RAM problem (8 dual-core Opterons and
32GB RAM should be enough!), 100Mbps link is saturated at about 4%. From
tcpdump on port 53 I can see delays in DNS responses, but they are not
tragic.
I've tried to move tmp dirs of amavis and clamav to ram with no visible
effect.
This is lint test of SA:
[EMAIL PROTECTED] spamassassin]# su - amavis -c 'spamassassin -D --lint'
[14636] dbg: logger: adding facilities: all
[14636] dbg: logger: logging level is DBG
[14636] dbg: generic: SpamAssassin version 3.1.7
[14636] dbg: config: score set 0 chosen.
[14636] dbg: util: running in taint mode? yes
[14636] dbg: util: taint mode: deleting unsafe environment variables,
resetting PATH
[14636] dbg: util: PATH included '/usr/kerberos/bin', keeping
[14636] dbg: util: PATH included '/usr/local/bin', keeping
[14636] dbg: util: PATH included '/bin', keeping
[14636] dbg: util: PATH included '/usr/bin', keeping
[14636] dbg: util: PATH included '/usr/X11R6/bin', keeping
[14636] dbg: util: final PATH set to:
/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin
[14636] dbg: message: ---- MIME PARSER START ----
[14636] dbg: message: main message type: text/plain
[14636] dbg: message: parsing normal part
[14636] dbg: message: added part, type: text/plain
[14636] dbg: message: ---- MIME PARSER END ----
[14636] dbg: dns: is Net::DNS::Resolver available? yes
[14636] dbg: dns: Net::DNS version: 0.59
[14636] dbg: diag: perl platform: 5.008005 linux
[14636] dbg: diag: module installed: Digest::SHA1, version 2.07
[14636] dbg: diag: module not installed: Net::Ident ('require' failed)
[14636] dbg: diag: module not installed: IO::Socket::INET6 ('require'
failed)
[14636] dbg: diag: module not installed: IO::Socket::SSL ('require' failed)
[14636] dbg: diag: module installed: Time::HiRes, version 1.55
[14636] dbg: diag: module installed: DBI, version 1.40
[14636] dbg: diag: module installed: Getopt::Long, version 2.34
[14636] dbg: diag: module not installed: LWP::UserAgent ('require' failed)
[14636] dbg: diag: module not installed: HTTP::Date ('require' failed)
[14636] dbg: diag: module installed: Archive::Tar, version 1.30
[14636] dbg: diag: module installed: IO::Zlib, version 1.04
[14636] dbg: diag: module installed: DB_File, version 1.809
[14636] dbg: diag: module installed: HTML::Parser, version 3.35
[14636] dbg: diag: module installed: MIME::Base64, version 3.01
[14636] dbg: diag: module installed: Net::DNS, version 0.59
[14636] dbg: diag: module installed: Net::SMTP, version 2.29
[14636] dbg: diag: module not installed: Mail::SPF::Query ('require' failed)
[14636] dbg: diag: module not installed: IP::Country::Fast ('require'
failed)
[14636] dbg: diag: module not installed: Razor2::Client::Agent
('require' failed)
[14636] dbg: ignore: using a test message to lint rules
[14636] dbg: config: using "/etc/mail/spamassassin" for site rules pre files
[14636] dbg: config: read file /etc/mail/spamassassin/init.pre
[14636] dbg: config: read file /etc/mail/spamassassin/v310.pre
[14636] dbg: config: read file /etc/mail/spamassassin/v312.pre
[14636] dbg: config: using "/usr/share/spamassassin" for sys rules pre files
[14636] dbg: config: using "/usr/share/spamassassin" for default rules dir
[14636] dbg: config: read file /usr/share/spamassassin/10_misc.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_advance_fee.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_anti_ratware.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_body_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_compensate.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_dnsbl_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_drugs.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_fake_helo_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_head_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_html_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_meta_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_net_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_phrases.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_porn.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_ratware.cf
[14636] dbg: config: read file /usr/share/spamassassin/20_uri_tests.cf
[14636] dbg: config: read file /usr/share/spamassassin/23_bayes.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_accessdb.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_antivirus.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_body_tests_es.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_body_tests_pl.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_dcc.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_dkim.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_domainkeys.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_hashcash.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_pyzor.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_razor2.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_replace.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_spf.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_textcat.cf
[14636] dbg: config: read file /usr/share/spamassassin/25_uribl.cf
[14636] dbg: config: read file /usr/share/spamassassin/30_text_de.cf
[14636] dbg: config: read file /usr/share/spamassassin/30_text_fr.cf
[14636] dbg: config: read file /usr/share/spamassassin/30_text_it.cf
[14636] dbg: config: read file /usr/share/spamassassin/30_text_nl.cf
[14636] dbg: config: read file /usr/share/spamassassin/30_text_pl.cf
[14636] dbg: config: read file /usr/share/spamassassin/30_text_pt_br.cf
[14636] dbg: config: read file /usr/share/spamassassin/50_scores.cf
[14636] dbg: config: read file /usr/share/spamassassin/60_awl.cf
[14636] dbg: config: read file /usr/share/spamassassin/60_whitelist.cf
[14636] dbg: config: read file /usr/share/spamassassin/60_whitelist_dk.cf
[14636] dbg: config: read file /usr/share/spamassassin/60_whitelist_dkim.cf
[14636] dbg: config: read file /usr/share/spamassassin/60_whitelist_spf.cf
[14636] dbg: config: read file
/usr/share/spamassassin/60_whitelist_subject.cf
[14636] dbg: config: using "/etc/mail/spamassassin" for site rules dir
[14636] dbg: config: read file /etc/mail/spamassassin/local.cf
[14636] dbg: plugin: loading Mail::SpamAssassin::Plugin::URIDNSBL from @INC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x848210)
[14636] dbg: plugin: loading Mail::SpamAssassin::Plugin::DCC from @INC
[14636] dbg: dcc: local tests only, disabling DCC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::DCC=HASH(0x1e51ea0)
[14636] dbg: plugin: loading Mail::SpamAssassin::Plugin::SpamCop from @INC
[14636] dbg: reporter: local tests only, disabling SpamCop
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::SpamCop=HASH(0x1e0c670)
[14636] dbg: plugin: loading Mail::SpamAssassin::Plugin::AWL from @INC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::AWL=HASH(0x1e10000)
[14636] dbg: plugin: loading
Mail::SpamAssassin::Plugin::AutoLearnThreshold from @INC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::AutoLearnThreshold=HASH(0x1e11500)
[14636] dbg: plugin: loading
Mail::SpamAssassin::Plugin::WhiteListSubject from @INC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::WhiteListSubject=HASH(0x1e12310)
[14636] dbg: plugin: loading Mail::SpamAssassin::Plugin::MIMEHeader from
@INC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::MIMEHeader=HASH(0x1e13460)
[14636] dbg: plugin: loading Mail::SpamAssassin::Plugin::ReplaceTags
from @INC
[14636] dbg: plugin: registered
Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0x1ee3f80)
[14636] dbg: config: adding redirector regex:
/^http:\/\/chkpt\.zdnet\.com\/chkpt\/\w+\/(.*)$/i
[14636] dbg: config: adding redirector regex:
/^http:\/\/www(?:\d+)?\.nate\.com\/r\/\w+\/(.*)$/i
[14636] dbg: config: adding redirector regex:
/^http:\/\/.+\.gov\/(?:.*\/)?externalLink\.jhtml\?.*url=(.*?)(?:&.*)?$/i
[14636] dbg: config: adding redirector regex:
/^http:\/\/redir\.internet\.com\/.+?\/.+?\/(.*)$/i
[14636] dbg: config: adding redirector regex:
/^http:\/\/(?:.*?\.)?adtech\.de\/.*(?:;|\|)link=(.*?)(?:;|$)/i
[14636] dbg: config: adding redirector regex:
m'^http.*?/redirect\.php\?.*(?<=[?&])goto=(.*?)(?:$|[&#])'i
[14636] dbg: config: adding redirector regex:
m'^https?:/*(?:[^/]+\.)?emf\d\.com/r\.cfm.*?&r=(.*)'i
[14636] dbg: config: adding redirector regex:
m'/(?:index.php)?\?.*(?<=[?&])URL=(.*?)(?:$|[&#])'i
[14636] dbg: config: adding redirector regex:
m'^http:/*(?:\w+\.)?google(?:\.\w{2,3}){1,2}/url\?.*?(?<=[?&])q=(.*?)(?:$|[&#])'i
[14636] dbg: config: adding redirector regex:
m'^http:/*(?:\w+\.)?google(?:\.\w{2,3}){1,2}/search\?.*?(?<=[?&])q=[^&]*?(?<=%20|..[=+\s])site:(.*?)(?:$|%20|[\s+&#])'i
[14636] dbg: config: adding redirector regex:
m'^http:/*(?:\w+\.)?google(?:\.\w{2,3}){1,2}/search\?.*?(?<=[?&])q=[^&]*?(?<=%20|..[=+\s])(?:"|%22)(.*?)(?:$|%22|["\s+&#])'i
[14636] dbg: config: adding redirector regex:
m'^http:/*(?:\w+\.)?google(?:\.\w{2,3}){1,2}/translate\?.*?(?<=[?&])u=(.*?)(?:$|[&#])'i
[14636] dbg: plugin:
Mail::SpamAssassin::Plugin::ReplaceTags=HASH(0x1ee3f80) implements
'finish_parsing_end'
[14636] dbg: replacetags: replacing tags
[14636] dbg: replacetags: done replacing tags
[14636] dbg: bayes: using username: amavis
[14636] dbg: bayes: database connection established
[14636] dbg: bayes: found bayes db version 3
[14636] dbg: bayes: Using userid: 1
[14636] dbg: config: score set 2 chosen.
[14636] dbg: message: ---- MIME PARSER START ----
[14636] dbg: message: main message type: text/plain
[14636] dbg: message: parsing normal part
[14636] dbg: message: added part, type: text/plain
[14636] dbg: message: ---- MIME PARSER END ----
[14636] dbg: dns: is DNS available? 0
[14636] dbg: metadata: X-Spam-Relays-Trusted:
[14636] dbg: metadata: X-Spam-Relays-Untrusted:
[14636] dbg: metadata: X-Spam-Relays-Internal:
[14636] dbg: metadata: X-Spam-Relays-External:
[14636] dbg: message: no encoding detected
[14636] dbg: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x848210)
implements 'parsed_metadata'
[14636] dbg: rules: local tests only, ignoring RBL eval
[14636] dbg: check: running tests for priority: 0
[14636] dbg: rules: running header regexp tests; score so far=0
[14636] dbg: rules: ran header rule __HAS_MSGID ======> got hit: "<"
[14636] dbg: rules: ran header rule __SANE_MSGID ======> got hit:
"<[EMAIL PROTECTED]>
[14636] dbg: rules: "
[14636] dbg: rules: ran header rule __MSGID_OK_HOST ======> got hit:
"@lint_rules>"
[14636] dbg: rules: ran header rule __MSGID_OK_DIGITS ======> got hit:
"1167420913"
[14636] dbg: eval: all '*From' addrs:
[EMAIL PROTECTED]
[14636] dbg: eval: all '*To' addrs:
[14636] dbg: rules: ran eval rule NO_RELAYS ======> got hit
[14636] dbg: rules: ran eval rule __UNUSABLE_MSGID ======> got hit
[14636] dbg: rules: running body-text per-line regexp tests; score so
far=-0.001
[14636] dbg: rules: ran body rule __NONEMPTY_BODY ======> got hit: "I"
[14636] dbg: uri: running uri tests; score so far=-0.001
[14636] dbg: bayes: corpus size: nspam = 16404, nham = 6230
[14636] dbg: bayes: tok_get_all: token count: 20
[14636] dbg: bayes: score = 0.618147807413721
[14636] dbg: rules: ran eval rule BAYES_60 ======> got hit
[14636] dbg: rules: running raw-body-text per-line regexp tests; score
so far=0.999
[14636] dbg: rules: running full-text regexp tests; score so far=0.999
[14636] dbg: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x848210)
implements 'check_tick'
[14636] dbg: check: running tests for priority: 500
[14636] dbg: plugin: Mail::SpamAssassin::Plugin::URIDNSBL=HASH(0x848210)
implements 'check_post_dnsbl'
[14636] dbg: rules: running meta tests; score so far=0.999
[14636] dbg: rules: running header regexp tests; score so far=3.156
[14636] dbg: rules: running body-text per-line regexp tests; score so
far=3.156
[14636] dbg: uri: running uri tests; score so far=3.156
[14636] dbg: rules: running raw-body-text per-line regexp tests; score
so far=3.156
[14636] dbg: rules: running full-text regexp tests; score so far=3.156
[14636] dbg: check: running tests for priority: 1000
[14636] dbg: rules: running meta tests; score so far=3.156
[14636] dbg: rules: running header regexp tests; score so far=3.156
[14636] dbg: rules: running body-text per-line regexp tests; score so
far=3.156
[14636] dbg: uri: running uri tests; score so far=3.156
[14636] dbg: rules: running raw-body-text per-line regexp tests; score
so far=3.156
[14636] dbg: rules: running full-text regexp tests; score so far=3.156
[14636] dbg: check: is spam? score=3.156 required=6.31
[14636] dbg: check:
tests=BAYES_60,MISSING_SUBJECT,NO_RECEIVED,NO_RELAYS,TO_CC_NONE
[14636] dbg: check:
subtests=__HAS_MSGID,__MSGID_OK_DIGITS,__MSGID_OK_HOST,__NONEMPTY_BODY,__SANE_MSGID,__UNUSABLE_MSGID
I don't know why SA thinks network tests are disabled - they shouldn't,
or at least I don't have them turned off in both
/etc/mail/spamassassin/local.cf and /etc/amavisd.conf. I'm not using
user preferences for 'amavis' user - as far as I know.
If anybody sees anything bad or has some tip for me, I'll be really
grateful.
Thanks!
--
***********************************************************************
Pavel Urban ([EMAIL PROTECTED])
O2 system disaster
Telefonica O2 Czech Republic, a.s. - www.cz.o2.com
***********************************************************************
Vegetables should not operate electronic equipment.
Computer Stupidities, http://rinkworks.com/stupid/
***********************************************************************
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
AMaViS-user mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/amavis-user
AMaViS-FAQ:http://www.amavis.org/amavis-faq.php3
AMaViS-HowTos:http://www.amavis.org/howto/
