Re: Unexpected record type 'X'

2022-10-06 Thread John Alex.
In my case, a single alias was used that expands to 5000 or more addresses in a virtual_alias_maps table (after increasing virtual_alias_expansion_limit). The error is reproduced both when sending an email to this alias address and when just checking with 'sendmail -bv'. John On 10/6/22

Re: Unexpected record type 'X'

2022-10-06 Thread Wietse Venema
Wietse Venema: > > So it seems this issue occurs whenever the mail queue total recipient count > > reaches 5000 > > addresses. > > Thanks, that is very useful. This appears to be a corner-case error, > and that would explain why the problem was difficult to reproduce. This reproduces 100% with

Re: Unexpected record type 'X'

2022-10-06 Thread Wietse Venema
John Alex.: > Hi, I encountered the same issue on two FreeBSD 13.1 + Postfix 3.7.2 > installations. It > only occurs when trying to send an email with >4999 recipients (the mail > queue is > otherwise empty). This issue does not happen on another machine with FreeBSD > 13.0 + > Postfix

Re: Unexpected record type 'X'

2022-10-06 Thread John Alex.
Hi, I encountered the same issue on two FreeBSD 13.1 + Postfix 3.7.2 installations. It only occurs when trying to send an email with >4999 recipients (the mail queue is otherwise empty). This issue does not happen on another machine with FreeBSD 13.0 + Postfix 3.6.3. After some search I found

Re: Unexpected record type 'X'

2022-09-16 Thread J Doe
On 2022-09-06 23:18, Viktor Dukhovni wrote: On Tue, Sep 06, 2022 at 09:43:38PM -0400, J Doe wrote: Out of curiosity ... why do queue files require the execute bit ? That's how they're marked "complete". A partially written queue file is just read-write. When a queue is committed it is

Re: Unexpected record type 'X'

2022-09-06 Thread Viktor Dukhovni
On Tue, Sep 06, 2022 at 09:43:38PM -0400, J Doe wrote: > Out of curiosity ... why do queue files require the execute bit ? That's how they're marked "complete". A partially written queue file is just read-write. When a queue is committed it is marked executable and synced to disk, at that

Re: Unexpected record type 'X'

2022-09-06 Thread J Doe
On 2022-08-30 10:35, Viktor Dukhovni wrote: On Tue, Aug 30, 2022 at 02:25:20PM +, Frank Brendel wrote: So I can try to reproduce it by simply putting that file into the incoming queue? Within the same filesystem, yes. Our test system has FreeBSD 13.1 and Postfix 3.7.2 installed. I'd

Re: Unexpected record type 'X'

2022-08-31 Thread Frank Brendel
You're so right. But sending files via SFTP would be too easy  I think with recipient verification and queue/log monitoring I have a lot stuff for improving the system. Wietse, Viktor many thanks! Frank Frank Brendel Administrator Rechenzentrum Telefon: +49 811 9595-157 Telefax: +49 811

Re: Unexpected record type 'X'

2022-08-31 Thread Viktor Dukhovni
On Wed, Aug 31, 2022 at 02:32:33PM +, Frank Brendel wrote: > Monitoring the logs is on the list. > > If I understand the Postfix architecture right all I have to do in case > of failed recipients is to write something like > b...@recipient.com REJECT Mailbox full > into a

Re: Unexpected record type 'X'

2022-08-31 Thread Wietse Venema
Frank Brendel: > > You really should do something about that, build a table of over- > > quota > > recipients, and tempfail new mail for such users when briefly over > > quota, and ultimately reject if long-term over-quota. > > > but is that possible with remote mailboxes? The Postfix

Re: Unexpected record type 'X'

2022-08-31 Thread Frank Brendel
Hi Viktor, thank you for the hint. Monitoring the logs is on the list. If I understand the Postfix architecture right all I have to do in case of failed recipients is to write something like b...@recipient.com REJECT Mailbox full into a $smtpd_recipient_restriction table and wait for

Re: Unexpected record type 'X'

2022-08-31 Thread Viktor Dukhovni
On Wed, Aug 31, 2022 at 09:56:49AM +, Frank Brendel wrote: > > You really should do something about that, build a table of over- > > quota recipients, and tempfail new mail for such users when briefly > > over quota, and ultimately reject if long-term over-quota. > > but is that possible with

Re: Unexpected record type 'X'

2022-08-31 Thread Frank Brendel
Hi Viktor, Frank Brendel Administrator Rechenzentrum Telefon: +49 811 9595-157 Telefax: +49 811 9595-199 Internet: https://www.eurolog.com EURO-LOG AG Am Söldnermoos 17, D-85399 Hallbergmoos Vorstand: Jörg Fürbacher Aufsichtsratsvorsitzender: Markus Quicken Registergericht: AG München HRB

Re: Unexpected record type 'X'

2022-08-31 Thread Frank Brendel
Hi Wietse, all pending 'corrupt' messages are sent now. No errors.  I'll upgrade the system to FreeBSD 13.1 and Postfix 3.7.2 and keep an eye on the queue size. Thank you for your help. And thank you for Postfix, it makes a good job here since 2004!  Kind regards Frank Frank Brendel

Re: Unexpected record type 'X'

2022-08-30 Thread Wietse Venema
Frank Brendel: > I can't reproduce it anymore. > I moved two files which failed before into incoming and they are now > sent. > > Could it be that it was because of the large deferred queue? By design, Postfix does not know how many messages there are in the mail queue. The queue manager knows

Re: Unexpected record type 'X'

2022-08-30 Thread Frank Brendel
I can't reproduce it anymore. I moved two files which failed before into incoming and they are now sent. Could it be that it was because of the large deferred queue? Filesystem or parallel processing somehow? The queue is now small because the remote full mailbox was fixed and all messages were

Re: Unexpected record type 'X'

2022-08-30 Thread Wietse Venema
Viktor Dukhovni: > On Tue, Aug 30, 2022 at 02:25:20PM +, Frank Brendel wrote: > > > So I can try to reproduce it by simply putting that file into the > > incoming queue? > > Within the same filesystem, yes. > > > Our test system has FreeBSD 13.1 and Postfix 3.7.2 installed. I'd try > > to

Re: Unexpected record type 'X'

2022-08-30 Thread Viktor Dukhovni
On Tue, Aug 30, 2022 at 02:25:20PM +, Frank Brendel wrote: > So I can try to reproduce it by simply putting that file into the > incoming queue? Within the same filesystem, yes. > Our test system has FreeBSD 13.1 and Postfix 3.7.2 installed. I'd try > to resend a mail via that system. If

Re: Unexpected record type 'X'

2022-08-30 Thread Frank Brendel
So I can try to reproduce it by simply putting that file into the incoming queue? Our test system has FreeBSD 13.1 and Postfix 3.7.2 installed. I'd try to resend a mail via that system. Thank you Frank Frank Brendel Administrator Rechenzentrum Telefon: +49 811 9595-157 Telefax: +49 811

Re: Unexpected record type 'X'

2022-08-30 Thread Viktor Dukhovni
On Tue, Aug 30, 2022 at 11:27:19AM +, Frank Brendel wrote: > > Are you using MailScanner or other non-Postfix software that > > reads or updates Postfix queue files? > > > > Wietse > > No, only Postfix and Dovecot with replication. I've attached the > postconf output. > > But

Re: Unexpected record type 'X'

2022-08-30 Thread Wietse Venema
Wietse Venema: > Frank Brendel: > > Here's the Postfix log and the queue file. > > > > Aug 30 13:02:23 elvmwlx94.eurolog.com postfix/smtpd[56532] 57850C4DC9: > > client=unknown[194.50.162.68] > > Aug 30 13:02:23 elvmwlx94.eurolog.com postfix/cleanup[55311] > > 57850C4DC9: message-id=<> > > Aug 30

Re: Unexpected record type 'X'

2022-08-30 Thread Frank Brendel
Hi Wietse, no, only Postfix and Dovecot with replication. I've attached the postconf output. But regarding 'queue files' I have about 265.000 deferred mails (recipients mailbox full). Filesystem is UFS2. Thank you Frank Frank Brendel Administrator Rechenzentrum Telefon: +49 811 9595-157

Re: Unexpected record type 'X'

2022-08-30 Thread Wietse Venema
Frank Brendel: > Hi, > > sporadically I get the error > Unexpected record type 'X' at offset ... > and the message is moved to the corrupt queue. > > E.g. > postfix/smtpd[19574] 010EDD6443: client=unknown[1.2.3.4] > postfix/cleanup[98995] 010EDD6443: message-id=<> > postfix/qmgr[63719]