Re: filter-spamassassin fails under heavy load (may 23 extras snapshot)
On Wed, May 25, 2016 at 04:28:59PM -0400, Andrew Ruscica wrote: > Not sure if the issue lies with the spamassassin daemon or the > opensmtp-filter. > > During a surge of incoming email, the following errors were logged. > OpenSMTP stopped relaying mail during this time: > > May 25 15:57:50 mxgw3 filter-spamassassin-reject[32220]: warn: response: > shutdown: Bad file descriptor > > May 25 15:57:50 mxgw3 smtpd[25777]: smtp-in: Failed command on session > 627872db6e9c0dc0: "DATA" => 451 4.7.1 Spam filter failed > > > The immediate resolution was to temporarily disable the filter and restart > smtpd, although I think I probably could have resolved by restarting > spamassassin as well.. > > I'm pre-forking 20 spamassassin children, with max of 40, and limiting > incoming connections to opensmtpd using pf max states rules. > > While this was occurring the spamd-child processes surged to about 30 and > were starting to be released and returning back to normal as I was forcing > down connections at pf. > > using opensmtpd-extras from May 23 on OpenBSD 5.9/amd64 with spamassassin > from openbsd packages. > > > Please let me know what other system details may be relevant here... Can you provide smtpctl show stats and fstat -u _smtpd output? You can try the latest -extras snapshot and especially the limit option. -- You received this mail because you are subscribed to misc@opensmtpd.org To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
filter-spamassassin fails under heavy load (may 23 extras snapshot)
Not sure if the issue lies with the spamassassin daemon or the opensmtp-filter. During a surge of incoming email, the following errors were logged. OpenSMTP stopped relaying mail during this time: May 25 15:57:50 mxgw3 filter-spamassassin-reject[32220]: warn: response: shutdown: Bad file descriptor May 25 15:57:50 mxgw3 smtpd[25777]: smtp-in: Failed command on session 627872db6e9c0dc0: "DATA" => 451 4.7.1 Spam filter failed The immediate resolution was to temporarily disable the filter and restart smtpd, although I think I probably could have resolved by restarting spamassassin as well.. I'm pre-forking 20 spamassassin children, with max of 40, and limiting incoming connections to opensmtpd using pf max states rules. While this was occurring the spamd-child processes surged to about 30 and were starting to be released and returning back to normal as I was forcing down connections at pf. using opensmtpd-extras from May 23 on OpenBSD 5.9/amd64 with spamassassin from openbsd packages. Please let me know what other system details may be relevant here...
Re: FW: smptd stops listing to external interfaces.
On Wed, May 25, 2016 at 06:21:40PM +, Peter Fraser wrote:
> whoops I mistyped OpenBSD 5.9
which -extras version?
> -Original Message-
> From: Peter Fraser [mailto:p...@thinkage.ca]
> Sent: Wednesday, May 25, 2016 2:16 PM
> To: misc@opensmtpd.org
> Subject: smptd stops listing to external interfaces.
>
> OpenBSD 5.8 i386
>
> smtpd with smtpd.conf as shown below
> will run quite happy for several days at times, or just several hours, the it
> seems to stop listening on the external interfaces. Message can still be sent
> using the local interfaces. Even if the daemon is left for several hours it
> does not fix it self.
>
> Stopping the daemon and restarting clears the problem.
>
> Restarting the Microsoft exchange servers that the mail is being relayed to
> seems to increase the likelihood that the problem will occur.
>
> Any hint on how to track down what is causing the problem and how to fix it?
>
>
> thinkageLan = "192.102.11.0/24"
> ksmartLan = "205.189.88.112/28"
> webLan = "205.189.88.32/27"
> skyLan = "205.189.88.128/25"
>
> table aliases file:/etc/mail/aliases
> table insideComputers { $thinkageLan, $ksmartLan, $webLan, $skyLan }
>
> table ksmartDomains { ksmart.ca, structsure.ca }
> table ksmartComputers { $ksmartLan }
> table ksmartUsers file:/etc/mail/ksmartusers
> table ksmartMappings file:/etc/mail/ksmartmap
>
>
> table thinkageComputers { $thinkageLan }
> table thinkageUsers file:/etc/mail/thinkageusers
> table thinkageDomains { thinkage.ca, thinkage.com, mainboss.com,
> papertrail.ca, windview.ca, dealers.ca, bigblackpig.com }
> table thinkageMappingsfile:/etc/mail/thinkagemap
>
> max-message-size 1g
>
> filter pause pause
> filter regex regex
> filter dnsbl-sorbs dnsbl
> filter dnsbl-spamcop dnsbl "-h bl.spamcop.net"
> filter dnsbl-spamhaus dnsbl "-h sbl-xbl.spamhaus.org"
> filter clamav clamav
> filter all chain pause regex dnsbl-sorbs dnsbl-spamcop dnsbl-spamhaus
> clamav
> filter internal chain dnsbl-sorbs dnsbl-spamcop dnsbl-spamhaus
> clamav
>
> pki mail.thinkage.ca certificate "/etc/ssl/mail.thinkage.ca.crt"
> pki mail.thinkage.ca key "/etc/ssl/private/mail.thinkage.ca.key"
>
> listen on Inside filter internal
> listen on Outside filter all
> listen on 127.0.0.1
>
> reject from any for domain ksmart.on.ca
> accept from any for domain mail.thinkage.ca alias deliver to mbox
> accept from any for domain gateway.thinkage.ca alias deliver to mbox
>
> accept from sourcefor any relay as "@ksmart.ca"
> accept from any for any recipient relay via
> "smtp://router.ksmart.on.ca"
> accept from any for domain virtual
> forward-only
>
> accept from sourcefor any relay as "@thinkage.ca"
> accept from any for any recipient relay via
> "smtp://exchange.thinkage.ca"
> accept from any for domain virtual
> forward-only
>
> accept from local for any relay
>
>
> --
> You received this mail because you are subscribed to misc@opensmtpd.org To
> unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
>
>
> --
> You received this mail because you are subscribed to misc@opensmtpd.org
> To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
>
--
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
FW: smptd stops listing to external interfaces.
whoops I mistyped OpenBSD 5.9
-Original Message-
From: Peter Fraser [mailto:p...@thinkage.ca]
Sent: Wednesday, May 25, 2016 2:16 PM
To: misc@opensmtpd.org
Subject: smptd stops listing to external interfaces.
OpenBSD 5.8 i386
smtpd with smtpd.conf as shown below
will run quite happy for several days at times, or just several hours, the it
seems to stop listening on the external interfaces. Message can still be sent
using the local interfaces. Even if the daemon is left for several hours it
does not fix it self.
Stopping the daemon and restarting clears the problem.
Restarting the Microsoft exchange servers that the mail is being relayed to
seems to increase the likelihood that the problem will occur.
Any hint on how to track down what is causing the problem and how to fix it?
thinkageLan = "192.102.11.0/24"
ksmartLan = "205.189.88.112/28"
webLan = "205.189.88.32/27"
skyLan = "205.189.88.128/25"
table aliases file:/etc/mail/aliases
table insideComputers { $thinkageLan, $ksmartLan, $webLan, $skyLan }
table ksmartDomains { ksmart.ca, structsure.ca }
table ksmartComputers { $ksmartLan }
table ksmartUsers file:/etc/mail/ksmartusers
table ksmartMappingsfile:/etc/mail/ksmartmap
table thinkageComputers { $thinkageLan }
table thinkageUsers file:/etc/mail/thinkageusers
table thinkageDomains { thinkage.ca, thinkage.com, mainboss.com,
papertrail.ca, windview.ca, dealers.ca, bigblackpig.com }
table thinkageMappings file:/etc/mail/thinkagemap
max-message-size 1g
filter pause pause
filter regex regex
filter dnsbl-sorbs dnsbl
filter dnsbl-spamcop dnsbl "-h bl.spamcop.net"
filter dnsbl-spamhaus dnsbl "-h sbl-xbl.spamhaus.org"
filter clamav clamav
filter all chain pause regex dnsbl-sorbs dnsbl-spamcop dnsbl-spamhaus
clamav
filter internal chain dnsbl-sorbs dnsbl-spamcop dnsbl-spamhaus
clamav
pki mail.thinkage.ca certificate "/etc/ssl/mail.thinkage.ca.crt"
pki mail.thinkage.ca key "/etc/ssl/private/mail.thinkage.ca.key"
listen on Inside filter internal
listen on Outside filter all
listen on 127.0.0.1
reject from any for domain ksmart.on.ca
accept from any for domain mail.thinkage.ca alias deliver to mbox
accept from any for domain gateway.thinkage.ca alias deliver to mbox
accept from sourcefor any relay as "@ksmart.ca"
accept from any for any recipient relay via
"smtp://router.ksmart.on.ca"
accept from any for domain virtual forward-only
accept from sourcefor any relay as "@thinkage.ca"
accept from any for any recipient relay via
"smtp://exchange.thinkage.ca"
accept from any for domain virtual
forward-only
accept from local for any relay
--
You received this mail because you are subscribed to misc@opensmtpd.org To
unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
--
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
smptd stops listing to external interfaces.
OpenBSD 5.8 i386
smtpd with smtpd.conf as shown below
will run quite happy for several days at times, or just several hours, the it
seems to stop listening on the
external interfaces. Message can still be sent using the local interfaces. Even
if the daemon is left
for several hours it does not fix it self.
Stopping the daemon and restarting clears the problem.
Restarting the Microsoft exchange servers that the mail is being relayed to
seems
to increase the likelihood that the problem will occur.
Any hint on how to track down what is causing the problem and how to fix it?
thinkageLan = "192.102.11.0/24"
ksmartLan = "205.189.88.112/28"
webLan = "205.189.88.32/27"
skyLan = "205.189.88.128/25"
table aliases file:/etc/mail/aliases
table insideComputers { $thinkageLan, $ksmartLan, $webLan, $skyLan }
table ksmartDomains { ksmart.ca, structsure.ca }
table ksmartComputers { $ksmartLan }
table ksmartUsers file:/etc/mail/ksmartusers
table ksmartMappingsfile:/etc/mail/ksmartmap
table thinkageComputers { $thinkageLan }
table thinkageUsers file:/etc/mail/thinkageusers
table thinkageDomains { thinkage.ca, thinkage.com, mainboss.com,
papertrail.ca, windview.ca, dealers.ca, bigblackpig.com }
table thinkageMappings file:/etc/mail/thinkagemap
max-message-size 1g
filter pause pause
filter regex regex
filter dnsbl-sorbs dnsbl
filter dnsbl-spamcop dnsbl "-h bl.spamcop.net"
filter dnsbl-spamhaus dnsbl "-h sbl-xbl.spamhaus.org"
filter clamav clamav
filter all chain pause regex dnsbl-sorbs dnsbl-spamcop dnsbl-spamhaus
clamav
filter internal chain dnsbl-sorbs dnsbl-spamcop dnsbl-spamhaus
clamav
pki mail.thinkage.ca certificate "/etc/ssl/mail.thinkage.ca.crt"
pki mail.thinkage.ca key "/etc/ssl/private/mail.thinkage.ca.key"
listen on Inside filter internal
listen on Outside filter all
listen on 127.0.0.1
reject from any for domain ksmart.on.ca
accept from any for domain mail.thinkage.ca alias deliver to mbox
accept from any for domain gateway.thinkage.ca alias deliver to mbox
accept from sourcefor any relay as "@ksmart.ca"
accept from any for any recipient relay via
"smtp://router.ksmart.on.ca"
accept from any for domain virtual forward-only
accept from sourcefor any relay as "@thinkage.ca"
accept from any for any recipient relay via
"smtp://exchange.thinkage.ca"
accept from any for domain virtual
forward-only
accept from local for any relay
--
You received this mail because you are subscribed to misc@opensmtpd.org
To unsubscribe, send a mail to: misc+unsubscr...@opensmtpd.org
