OT: maildir usage profiles (Re: feature request: improve vague/incorrect error message)

2021-11-17 Thread Kris Deugau

Jim wrote:

On Tue, Nov 16, 2021 at 11:41 (-0500), Kris Deugau wrote:


Jim wrote:

On Mon, Nov 15, 2021 at 12:25 (-0500), Wietse Venema wrote:



Instead, use Maildir format with one message per file,



I thought about that once, but I decided I have too many e-mail
messages for that.  (I don't want to run out of inodes, nor do I want to
make file accesses too slow because of the number of files in the
directory.)



I converted "local"[*] storage from mbox to maildir a number of
years ago - IIRC I was starting to see performance issues with mbox
in part due to the way I manage my mail and in part simply due to
the number of messages I keep around.



This account has ~13G of mail on my PC, with over 100K messages each
in two folders, several in the tens of thousands, and most dedicated
mailing list folders holding somewhere between about 5K and 8K
messages each.


Thanks for the specifics.


The only performance issues I have are:



a) something sucks in the the IMAP protocol such that my mail client keeps
having to create a new connection and reauthenticate - it's not strictly a
timeout, because it's not on anything remotely resembling a predictable
timing


At first glance I wouldn't see that related to mbox vs. maildir, but
I've been surprised before.


Hard to tell, since I converted to maildir long before I had this much 
mail sitting around.  IIRC I was at ~20K messages in the biggest folders 
at the time.  I converted more for convenience in doing "grep -r |xargs 
rm"-ish things - can't really do that with mbox folders.


I also have the same needs-to-log-in-again-for-no-good-reason issue 
using Thunderbird against a role account on a central mail platform with 
"many" - but quite a bit fewer - messages, so my money is definitely on 
some weird corner case in the IMAP protocol.





Local storage is ext4 on a SATA SSD, although I wouldn't expect a noticeable
performance difference if it were on a conventional hard drive.


I am surprised that accessing files in a directory with 100K entries
is not slow, since (according to what I read) ext4 stores entries in
an "almost linear" list, and thus to find a director entry you might
have to chew through (on average) 50K entries.  Of course, file system
caching will speed things up immensely, assuming one has enough RAM
(given the other activity on the system) to keep the contents of those
maildirs (that is, the directory contents, not the contents of the
files) in RAM.


That could well be at the root of some of my issues, but the whole-file 
rewrites needed for mbox would be worse IMO.  Aside from whatever 
strange state Seamonkey gets itself into after running for several weeks 
I'm not seeing any other slowdowns.  Dovecot seems to be quite happy to 
manage all that baggage - TBH some of Dovecot's indexing may be helping 
out there by avoiding having to re-read the filesystem's entire 
directory index very often.


I do also have 32G of physical RAM, and top reports 17G of that is in 
use for cache...



[*] Due to some legacy mail flow that would be painful to convert, I
pull mail with fetchmail, deliver locally with procmail (sorry),
then expose it to my mail client with a local Dovecot instance.


Again, thanks for your specifics.  Maybe I should give maildir a try
some time and see what happens.  (Or maybe I should just delete a bunch
of email and forget that I ever got it.)


I haven't used actual client-local mail folders for much in a LONG time; 
 both Seamonkey and Thunderbird default to mbox-ish files IIRC, 
(although TB at least has an option to use a maildir-ish format).


-kgd


Re: ESMTP banner duplicate

2021-11-17 Thread micah
On 2021-11-17 15:25:19, Florian Effenberger wrote:
> Hello Micah,
>
> micah wrote on 17.11.21 at 15:11:
>
>> I've been doing some tests of my postfix server and sometimes when I
>> connect, I get *two* ESMTP banners, one that has a hyphen (-) after the
>> 220, and one that doesn't. Other connections, I only get one banner:
>
> that is the postscreen banner: http://www.postfix.org/POSTSCREEN_README.html
>
> If the connecting machine's IP is cached, the banner is not shown.

Thanks! I could not find that detail anywhere.

micah


Re: ESMTP banner duplicate

2021-11-17 Thread Florian Effenberger

Hello Micah,

micah wrote on 17.11.21 at 15:11:


I've been doing some tests of my postfix server and sometimes when I
connect, I get *two* ESMTP banners, one that has a hyphen (-) after the
220, and one that doesn't. Other connections, I only get one banner:


that is the postscreen banner: http://www.postfix.org/POSTSCREEN_README.html

If the connecting machine's IP is cached, the banner is not shown.

Florian


Re: ESMTP banner duplicate

2021-11-17 Thread Gerald Galster
> I've been doing some tests of my postfix server and sometimes when I
> connect, I get *two* ESMTP banners, one that has a hyphen (-) after the
> 220, and one that doesn't. Other connections, I only get one banner:
> 
> $ nc -v server.example.net 25
> Connection to server.example.net (10.0.0.1) 25 port [tcp/smtp] succeeded!
> 220-server.example.net ESMTP (spam is not appreciated)
> 220 server.example.net ESMTP (spam is not appreciated)
> quit
> 221 2.0.0 Bye
> root@mon02-mtl:~# nc -v server.example.net 25
> Connection to server.example.net (10.0.0.1) 25 port [tcp/smtp] succeeded!
> 220 server.example.net ESMTP (spam is not appreciated)
> quit
> 221 2.0.0 Bye
> 
> Can someone explain what the two banners mean, and why they happen
> sometimes, and are slightly different?

220- (with hyphen) means that the server has not finished sending yet.

Often this is used to detect spammers that don't play by the rules and send
smtp commands without waiting for answers (pipelining).

e.g. http://www.postfix.org/postconf.5.html#reject_unauth_pipelining

Or if an answer is too long and is broken into several lines, all lines
but the last will have a hyphen after the status code.

Best regards
Gerald


ESMTP banner duplicate

2021-11-17 Thread micah


Hi all,

I've been doing some tests of my postfix server and sometimes when I
connect, I get *two* ESMTP banners, one that has a hyphen (-) after the
220, and one that doesn't. Other connections, I only get one banner:

$ nc -v server.example.net 25
Connection to server.example.net (10.0.0.1) 25 port [tcp/smtp] succeeded!
220-server.example.net ESMTP (spam is not appreciated)
220 server.example.net ESMTP (spam is not appreciated)
quit
221 2.0.0 Bye
root@mon02-mtl:~# nc -v server.example.net 25
Connection to server.example.net (10.0.0.1) 25 port [tcp/smtp] succeeded!
220 server.example.net ESMTP (spam is not appreciated)
quit
221 2.0.0 Bye

Can someone explain what the two banners mean, and why they happen
sometimes, and are slightly different?

thanks!
Micah


Re: heads up: dkimpy-milter signing breaks w/ python 3.10 (e.g., @ fedora 45 -> 35 upgrade)

2021-11-17 Thread Benny Pedersen

On 2021-11-16 23:25, PGNet Dev wrote:


fyi,

upstream pymilter's fixed the issue

 https://github.com/sdgathman/pymilter/issues/44

using (for now), pymilter from git main, dkimpy-milter signing with
python 3.10 is again functional


good news, is it then possible to use pymilter in fuglu ?

https://gitlab.com/fumail/fuglu/-/issues/234

i am still the maintainer for gentoo fuglu, thanks for dkimpy


Re: email from servers claiming to be ours

2021-11-17 Thread Benny Pedersen

On 2021-11-17 08:57, Ruben Safir wrote:

On Wed, Nov 17, 2021 at 07:56:12AM +0100, Benny Pedersen wrote:

On 2021-11-16 23:55, Ruben Safir wrote:
>I got an email from cpa...@mrbrklyn.com which is not from
>us, as we are mrbrklyn.com

local envelope sender should be rejected in port 25, no real users
do this



my mailing lists does...


run maillist software inside of mynetwork on postfix, not outside

if that is ensured you should still reject envelope senders of your 
domain on port 25


sorry cant help more