On 2/3/2022 5:27 μ.μ., Damian wrote:
As Bastian pointed out, your mail sample passed Amavis within a few seconds. If those received timings are typical for your problem, forget about micro-optimizing Amavis.

You are right Damian and Bastian.

I include here the actual logs of one such session (only mail local part has been changed):

Phase 1: Postfix receives mail from the Internet (auto collated)

Mar  2 15:28:47 mailgw1 postfix/smtpd[1255009]: connect from mail-eopbgr40130.outbound.protection.outlook.com[40.107.4.130] Mar  2 15:28:47 mailgw1 postfix/smtpd[1255009]: Anonymous TLS connection established from mail-eopbgr40130.outbound.protection.outlook.com[40.107.4.130]: TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits) Mar  2 15:28:47 mailgw1 postfix/smtpd[1255009]: 4K7w1W6F77zMMYt: client=mail-eopbgr40130.outbound.protection.outlook.com[40.107.4.130] Mar  2 15:28:47 mailgw1 postfix/cleanup[1255000]: 4K7w1W6F77zMMYt: message-id=<odspmicro-SpoShare-e5cf25a0-d0ea-c000-b666-025e9e385410-1aa7b39f-88ac-4fd9-89dd-afb9eb36dccb-13168c28-f663-4e5f-bda9-1782c685117f@RD501AC5C3338C> Mar  2 15:28:47 mailgw1 postfix/qmgr[1253942]: 4K7w1W6F77zMMYt: from=<[email protected]>, size=11595, nrcpt=1 (queue active) Mar  2 15:28:48 mailgw1 postfix/smtpd[1255009]: disconnect from mail-eopbgr40130.outbound.protection.outlook.com[40.107.4.130] ehlo=2 starttls=1 mail=1 rcpt=1 bdat=1 quit=1 commands=7 Mar  2 15:30:47 mailgw1 postfix/lmtp[1254999]: 4K7w1W6F77zMMYt: to=<[email protected]>, relay=127.0.0.1[127.0.0.1]:10024, conn_use=16, delay=120, delays=0.39/119/0/0.59, dsn=2.0.0, status=sent (250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 4K7w3q6jL2zMMYV)
Mar  2 15:30:47 mailgw1 postfix/qmgr[1253942]: 4K7w1W6F77zMMYt: removed

Phase 2: Amavis receives from Postfix, processes and delivers back to Postfix

Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) body hash: 3c3a7d7aef31b9cbbceab17a9be9f47c Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) trace: UTF8LMTP://[127.0.0.1]:42650 < ESMTPS://40.107.4.130 < Microsoft_SMTP_Server://x < Microsoft_SMTP_Server://x < Microsoft_SMTP_Server://52.232.126.143 Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) dkim: VALID third-party signature by d=spoemeaeop.onmicrosoft.com, From: <[email protected]>, a=rsa-sha256, c=relaxed/relaxed, s=selector1-spoemeaeop-onmicrosoft-com, [email protected] Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) dkim: policy bank WHITELIST,NOBANNEDCHECK,NOVIRUSCHECK by [email protected] Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) dkim: VALID Author+Sender+MailFrom signature by d=sharepointonline.com, From: <[email protected]>, a=rsa-sha256, c=relaxed/relaxed, s=selector1, [email protected] Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) loaded policy bank "WHITELIST" Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) loaded policy bank "NOBANNEDCHECK" over "WHITELIST" Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) loaded policy bank "NOVIRUSCHECK" over "WHITELIST/NOBANNEDCHECK" Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) client IP address unknown, fetched from Received: 127.0.0.1 Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) Checking: CBhdqtu9BU97 WHITELIST/NOBANNEDCHECK/NOVIRUSCHECK [127.0.0.1] <[email protected]> -> <[email protected]> Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) 2822.From: <[email protected]>, 2822.Sender: <[email protected]> Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) Checking for banned types and filenames Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) skipping banned check: all recipients bypass banned checks Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) do_notify_and_quar: ccat=Clean (1,0) ("1":Clean, "0":CatchAll) ccat_block=(), qar_mth= Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) delivery method is 1, recips: [email protected] Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp session reuse (smtp:[127.0.0.1]:10025), 13 transactions so far Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp session most likely still valid (short idle 0.6 s) Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) AUTH not needed, user='', MTA offers '' Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp cmd> MAIL FROM:<[email protected]> BODY=7BIT Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp cmd> RCPT TO:<[email protected]> ORCPT=rfc822;[email protected] NOTIFY=NEVER
Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp cmd> DATA
Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp resp to MAIL (pip): 250 2.1.0 Ok Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp resp to RCPT (pip) (<[email protected]>): 250 2.1.5 Ok Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp resp to DATA: 354 End data with <CR><LF>.<CR><LF> Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) smtp resp to data-dot (<[email protected]>): 250 2.0.0 Ok: queued as 4K7w3q6jL2zMMYV, dt: 6.8 ms Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) Amavis::Out::SMTP::Session close, keeping connection Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) CBhdqtu9BU97 FWD from <[email protected]> -> <[email protected]>, BODY=7BIT 250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 4K7w3q6jL2zMMYV Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) DSN: sender is credible (dkim), SA: 0.000, <[email protected]> Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) status counters: InMsgsStatus{Relayed,RelayedUntagged,RelayedUntaggedInbound} Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) Passed CLEAN {RelayedInbound}, WHITELIST/NOBANNEDCHECK/NOVIRUSCHECK [127.0.0.1] [52.232.126.143] <[email protected]> -> <[email protected]>, Message-ID: <odspmicro-SpoShare-e5cf25a0-d0ea-c000-b666-025e9e385410-1aa7b39f-88ac-4fd9-89dd-afb9eb36dccb-13168c28-f663-4e5f-bda9-1782c685117f@RD501AC5C3338C>, mail_id: CBhdqtu9BU97, Hits: -, size: 11575, 589 ms Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) LMTP response for <[email protected]>: "250 2.0.0 from MTA(smtp:[127.0.0.1]:10025): 250 2.0.0 Ok: queued as 4K7w3q6jL2zMMYV" Mar  2 15:30:47 mailgw1 amavis[1254468]: (1254468-09-16) size: 11575, TIMING [total 601 ms] - SMTP MAIL: 0.7 (0%)0, SMTP pre-DATA-flush: 0.8 (0%)0, SMTP DATA: 40 (7%)7, check_init: 0.3 (0%)7, digest_hdr: 2.4 (0%)7, digest_body_dkim: 458 (76%)84, collect_info: 22 (4%)87, check_header: 1.1 (0%)87, decide_mail_destiny: 0.4 (0%)88, notif-quar: 0.3 (0%)88, fwd-connect: 25 (4%)92, fwd-mail-pip: 1.7 (0%)92, fwd-rcpt-pip: 0.2 (0%)92, fwd-data-chkpnt: 0.0 (0%)92, write-header: 0.6 (0%)92, fwd-data-contents: 24 (4%)96, fwd-end-chkpnt: 8 (1%)98, prepare-dsn: 0.6 (0%)98, report: 0.9 (0%)98, main_log_entry: 1.7 (0%)98, update_snmp: 0.7 (0%)98, SMTP pre-response: 0.2 (0%)98, SMTP response: 0.2 (0%)98, rundown: 11 (2%)100

Phase 3: Postfix receives back from Amavis and forwards to final destination (auto collated)

Mar  2 15:28:52 mailgw1 postfix/smtpd[1254591]: connect from localhost[127.0.0.1] Mar  2 15:28:52 mailgw1 postfix/smtpd[1254591]: 4K7w1c6zw0zMMYY: client=localhost[127.0.0.1] Mar  2 15:28:53 mailgw1 postfix/smtpd[1254591]: 4K7w1d2S7fzMMYY: client=localhost[127.0.0.1] Mar  2 15:28:53 mailgw1 postfix/smtpd[1254591]: 4K7w1d6khZzMMYc: client=localhost[127.0.0.1] Mar  2 15:28:54 mailgw1 postfix/smtpd[1254591]: 4K7w1f0qrgzMMYY: client=localhost[127.0.0.1] Mar  2 15:28:54 mailgw1 postfix/smtpd[1254591]: 4K7w1f21hPzMMYc: client=localhost[127.0.0.1] Mar  2 15:29:01 mailgw1 postfix/smtpd[1254591]: 4K7w1n1J0wzMMYY: client=localhost[127.0.0.1] Mar  2 15:29:19 mailgw1 postfix/smtpd[1254591]: 4K7w270k2GzMMYf: client=localhost[127.0.0.1] Mar  2 15:29:21 mailgw1 postfix/smtpd[1254591]: 4K7w2959DyzMMYd: client=localhost[127.0.0.1] Mar  2 15:29:24 mailgw1 postfix/smtpd[1254591]: 4K7w2D0KMfzMMYf: client=localhost[127.0.0.1] Mar  2 15:30:44 mailgw1 postfix/smtpd[1254591]: 4K7w3m1jQfzMMYP: client=localhost[127.0.0.1] Mar  2 15:30:44 mailgw1 postfix/smtpd[1254591]: 4K7w3m3nvDzMMYV: client=localhost[127.0.0.1] Mar  2 15:30:46 mailgw1 postfix/smtpd[1254591]: 4K7w3p1xwCzMMYG: client=localhost[127.0.0.1] Mar  2 15:30:47 mailgw1 postfix/smtpd[1254591]: 4K7w3q2hGyzMMYP: client=localhost[127.0.0.1] Mar  2 15:30:47 mailgw1 postfix/smtpd[1254591]: 4K7w3q6jL2zMMYV: client=localhost[127.0.0.1] Mar  2 15:30:47 mailgw1 postfix/cleanup[1254592]: 4K7w3q6jL2zMMYV: message-id=<odspmicro-SpoShare-e5cf25a0-d0ea-c000-b666-025e9e385410-1aa7b39f-88ac-4fd9-89dd-afb9eb36dccb-13168c28-f663-4e5f-bda9-1782c685117f@RD501AC5C3338C> Mar  2 15:30:47 mailgw1 postfix/qmgr[1253942]: 4K7w3q6jL2zMMYV: from=<[email protected]>, size=12203, nrcpt=1 (queue active) Mar  2 15:35:48 mailgw1 postfix/smtp[1255336]: 4K7w3q6jL2zMMYV: to=<[email protected]>, relay=vmail2.noa.gr[194.177.195.166]:25, delay=300, delays=0.03/0.02/0.05/300, dsn=2.0.0, status=sent (250 2.0.0 Ok: queued as 14A6C809703C1)
Mar  2 15:35:48 mailgw1 postfix/qmgr[1253942]: 4K7w3q6jL2zMMYV: removed

That shows indeed that amavis completes very quickly.

But why does Postfix delay so much in delivering, both at Phase 1 and 3?

Thanks,
Nick

Reply via email to