Re: [Courier-imap] Errata release of courier and courier-imap packages.

2021-03-21 Thread Sam Varshavchik

Eugene Suprun writes:



21.03.2021 17:56, Sam Varshavchik пишет:

Eugene Suprun writes:


Try increasing /proc/sys/fs/inotify/max_user_instances
Increased its value from 128 to 4096, no problems in an hour. Thanks for the  
tip. I am going to check it tomorrow, when there will be much more mail  
users.


In any case, I think enabling inotify notification facility should be  
configurable: inotify structures require non-negligible amount of memory to  
maintain (and it can't be swapped out to disk)


That's what that post said. Technically, that's obviously true. I am not  
very knowledgeable of the Linux kernel's internals; but this doesn't sound  
like something that demands megabytes of additional overhead per file  
descriptor.


The difference between the two models is one process using a single inotify  
file descriptor to monitor all directories, versus each process using its  
own individual inotify file descriptors. Either way, the same set of  
directories gets monitored. I'd think the book-keeping for that will be  
what's taking up most of the resources.


It's one inotify file descriptor having to carry around the necessary  
baggage to monitor a thousand directories, versus a few hundred processes  
using a couple of inotify file descriptors to monitor the same thousand  
directories (imapd monitors cur+new+keyword directories on one inotify  
descriptor). I can't see this by itself amounting to anything significant.


Plus, I'd say that most of that would be recovered by not having the  
gam_server process around, or its predecessor, famd. That's worth a few  
megabytes, easily. I see that gam_server is linked with libglib:


$ ldd /usr/libexec/gam_server
linux-vdso.so.1 (0x7ffda33ba000)
libglib-2.0.so.0 => /lib64/libglib-2.0.so.0 (0x7f2508a02000)
libc.so.6 => /lib64/libc.so.6 (0x7f2508837000)
libpcre.so.1 => /lib64/libpcre.so.1 (0x7f25087be000)
libpthread.so.0 => /lib64/libpthread.so.0 (0x7f250879c000)
/lib64/ld-linux-x86-64.so.2 (0x7f2508b75000)
$ size /lib64/libglib-2.0.so.0
  text data bss dec hex filename
123076946723112 1238553  12e619 /lib64/libglib-2.0.so.0

Unless someone also has something else running that requires Gnome stuff,  
that's an extra meg and a half (counting gam-server itself, but excluding  
pcre, it's likely there's something else that links with it), that's no  
longer needed. And, the less dependencies there is on the Gnome cruft, the  
better.


As for alerting a user? It frustrates the user. May be also configurable  
setting?


I definitely need to update the message itself. I don't know, though, of a  
better alerting mechanism. This is really exposing how bad IMAP clients  
respond to IMAP alerts. This alert does not break the connection, the IMAP  
client can continue, the IMAP session is still there.


pgpDmR12MiA7Q.pgp
Description: PGP signature
___
Courier-imap mailing list
Courier-imap@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap


Re: [Courier-imap] Errata release of courier and courier-imap packages.

2021-03-21 Thread Eugene Suprun



21.03.2021 17:56, Sam Varshavchik пишет:

Eugene Suprun writes:


« HTML content follows »
Hi Sam.

Installed courier-imap 5.1.1 at the production server (1500 
mailboxes), users get alerts in their clients (e.g. Mozilla 
Thunderbird) when jumping from a folder to another:


Filesystem notification initialization error -- contact your mail 
administrator (check for configuration errors with the FAM/Gamin 
library)


In /var/log/mail:

Mar 21 16:57:49 mail imapd-ssl[1994]: LOGIN, 
mailto:user=u...@domain.org>user=u...@domain.org, 
ip=[194.158.XXX.YYY], port=[61752], protocol=IMAP
Mar 21 16:57:49 mail imapd-ssl[1994]: Failed to create cache file: 
maildirwatch (mailto:u...@domain.org>u...@domain.org)

Mar 21 16:57:49 mail imapd-ssl[1994]: Error: Too many open files
Mar 21 16:57:50 mail imapd-ssl[1994]: Failed to create cache file: 
maildirwatch (mailto:u...@domain.org>u...@domain.org)

Mar 21 16:57:50 mail imapd-ssl[1994]: Error: Too many open files

openSuSE 15.2.
I believe 'FAM/Gamin' should be replaced by 'inotify' in the alerts.
inotifywait -m works fine at the server.

Reinstalled courier-imap 5.0.14


Some Googling around suggests that this might be on a per-userid limit 
of inotify file descriptors:


https://stackoverflow.com/questions/0245/inotify-fd-why-is-the-limit-per-user-id-and-not-per-process 



I'm guessing that all your mailboxes are virtual and use the same 
system userid.

That is true.


Try increasing /proc/sys/fs/inotify/max_user_instances
Increased its value from 128 to 4096, no problems in an hour. Thanks for 
the tip. I am going to check it tomorrow, when there will be much more 
mail users.


In any case, I think enabling inotify notification facility should be 
configurable: inotify structures require non-negligible amount of memory 
to maintain (and it can't be swapped out to disk)


As for alerting a user? It frustrates the user. May be also configurable 
setting?


Rough metric: number of concurrent IMAP sessions multiplied by 4.

It's worth adding this to the installation notes.



___
Courier-imap mailing list
Courier-imap@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap


___
Courier-imap mailing list
Courier-imap@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap


Re: [Courier-imap] Errata release of courier and courier-imap packages.

2021-03-21 Thread Sam Varshavchik

Eugene Suprun writes:


« HTML content follows »
Hi Sam.

Installed courier-imap 5.1.1 at the production server (1500 mailboxes), users  
get alerts in their clients (e.g. Mozilla Thunderbird) when jumping from a  
folder to another:


Filesystem notification initialization error -- contact your mail  
administrator (check for configuration errors with the FAM/Gamin library)


In /var/log/mail:

Mar 21 16:57:49 mail imapd-ssl[1994]: LOGIN,  
mailto:user=u...@domain.org>user=u...@domain.org, ip=[194.158.XXX.YYY],  
port=[61752], protocol=IMAP
Mar 21 16:57:49 mail imapd-ssl[1994]: Failed to create cache file:  
maildirwatch (mailto:u...@domain.org>u...@domain.org)

Mar 21 16:57:49 mail imapd-ssl[1994]: Error: Too many open files
Mar 21 16:57:50 mail imapd-ssl[1994]: Failed to create cache file:  
maildirwatch (mailto:u...@domain.org>u...@domain.org)

Mar 21 16:57:50 mail imapd-ssl[1994]: Error: Too many open files

openSuSE 15.2.
I believe 'FAM/Gamin' should be replaced by 'inotify' in the alerts.
inotifywait -m works fine at the server.

Reinstalled courier-imap 5.0.14


Some Googling around suggests that this might be on a per-userid limit of  
inotify file descriptors:


https://stackoverflow.com/questions/0245/inotify-fd-why-is-the-limit-per-user-id-and-not-per-process

I'm guessing that all your mailboxes are virtual and use the same system  
userid.


Try increasing /proc/sys/fs/inotify/max_user_instances

Rough metric: number of concurrent IMAP sessions multiplied by 4.

It's worth adding this to the installation notes.



pgpHgtnng7pnZ.pgp
Description: PGP signature
___
Courier-imap mailing list
Courier-imap@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap


Re: [Courier-imap] Errata release of courier and courier-imap packages.

2021-03-21 Thread Eugene Suprun

Hi Sam.

Installed courier-imap 5.1.1 at the production server (1500 mailboxes), 
users get alerts in their clients (e.g. Mozilla Thunderbird) when 
jumping from a folder to another:


Filesystem notification initialization error -- contact your mail 
administrator (check for configuration errors with the FAM/Gamin library)


In /var/log/mail:

Mar 21 16:57:49 mail imapd-ssl[1994]: LOGIN, user=u...@domain.org, 
ip=[194.158.XXX.YYY], port=[61752], protocol=IMAP
Mar 21 16:57:49 mail imapd-ssl[1994]: Failed to create cache file: 
maildirwatch (u...@domain.org)

Mar 21 16:57:49 mail imapd-ssl[1994]: Error: Too many open files
Mar 21 16:57:50 mail imapd-ssl[1994]: Failed to create cache file: 
maildirwatch (u...@domain.org)

Mar 21 16:57:50 mail imapd-ssl[1994]: Error: Too many open files

openSuSE 15.2.
I believe 'FAM/Gamin' should be replaced by 'inotify' in the alerts.
inotifywait -m works fine at the server.

Reinstalled courier-imap 5.0.14

Regards, Eugene

21.03.2021 01:58, Sam Varshavchik пишет:

Download: https://www.courier-mta.org/download.html

New versions released of  courier (1.1.1), courier-imap (5.1.1) packages.

Changes:

- courier: fix the RPM build script to build either with OpenSSL or 
GnuTLS.


- courier, courier-imap: fix swapped TLS_CACHEFILE settings in the 
IMAP and POP3 configuration files.




___
Courier-imap mailing list
Courier-imap@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap


___
Courier-imap mailing list
Courier-imap@lists.sourceforge.net
Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap