Re: Dovecot Logging and Shell Script Hang
On Feb 27, 2019, at 11:00 AM, Aki Tuomi via dovecot wrote: > > >> On 27 February 2019 18:49 Asai via dovecot wrote: >> >> >> Greetings, >> >> We have a PHP based shell script that runs a doveadm backup routine. >> >> This script was running just fine, and then we turned on more logging for >> Dovecot (enabled the mail_log plugin). For some reason, once this was done, >> the shell script would run for a few minutes and then hang, as it added more >> log messages to the dsync STDOUT. Once the mail_log plugin was disabled, it >> ran without hanging. >> >> Is there any way to run doveadm and temporarily suspend the mail_log plugin? >> Or is there a better way to do this? >> >> Thanks for the insights. >> >> Asai >> > > You might want to enable mail_log plugin for imap/pop3 protocols only. > > protocol imap { > mail_plugins = $mail_plugins mail_log > } > > protocol pop3 { > mail_plugins = $mail_plugins mail_log > } > > Aki Thank you, Aki, I will try that.
Re: Dovecot Logging and Shell Script Hang
> On 27 February 2019 18:49 Asai via dovecot wrote: > > > Greetings, > > We have a PHP based shell script that runs a doveadm backup routine. > > This script was running just fine, and then we turned on more logging for > Dovecot (enabled the mail_log plugin). For some reason, once this was done, > the shell script would run for a few minutes and then hang, as it added more > log messages to the dsync STDOUT. Once the mail_log plugin was disabled, it > ran without hanging. > > Is there any way to run doveadm and temporarily suspend the mail_log plugin? > Or is there a better way to do this? > > Thanks for the insights. > > Asai > You might want to enable mail_log plugin for imap/pop3 protocols only. protocol imap { mail_plugins = $mail_plugins mail_log } protocol pop3 { mail_plugins = $mail_plugins mail_log } Aki
Re: Dovecot 2.3.3 Mailbox does not exist
Dear Martin, Many thanks for the advise and yes I agree I should set debug mode to on and work from there. Thanks! Kunal On Wed, Feb 27, 2019 at 4:11 AM Martin Johannes Dauser via dovecot < dovecot@dovecot.org> wrote: > Never done shared/public folders but perhaps Debug mode will give a hint. > > doveadm -Dv acl get -A Public/Archive > > On Tue, 2019-02-26 at 10:21 -0500, Kunal A. via dovecot wrote: > > HI, > I would deeply aprechiate if someone here could help me address a problem > with ACL. I would personally refrain from e-mailing ever so often as I > understand other users have more important issues to discuss about. Anyways > I hope someone here could help. > > When I run ;- > doveadm acl get -A Public/Archive > I keep getting an error that says Mailbox does not exist . See erorr > message below : - > > Error: Can't open mailbox Public/Archive: Mailbox doesn't exist: > Public/Archive > > In the fastmail folder there is a folder called Archive, why isn't it > being read? The folder is drwxr-xr-x. with vmail as owner. > > Deeply appreciate if someone could help with this. > Many thanks > > dovecot -n output :- > > # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf > # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty Nine) > # Hostname: machine > auth_mechanisms = plain login > mail_location = maildir:~/Maildir > mail_plugins = acl > mail_privileged_group = mail > mbox_write_locks = fcntl > namespace { > list = children > location = maildir:/run/media/computer/Storage/Email/fastmail/ > prefix = Public/ > separator = / > subscriptions = yes > type = public > } > namespace inbox { > inbox = yes > list = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = INBOX/ > separator = / > } > passdb { > driver = pam > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > acl = vfile > } > postmaster_address = postmaster at example.com > protocols = imap pop3 > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > mode = 0600 > user = vmail > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl = required > ssl_cert = ssl_cipher_list = PROFILE=SYSTEM > ssl_key = # hidden, use -P to show it > userdb { > driver = passwd > } > userdb { > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > driver = static > } > protocol imap { > mail_plugins = acl imap_acl > } > >
Dovecot Logging and Shell Script Hang
Greetings, We have a PHP based shell script that runs a doveadm backup routine. This script was running just fine, and then we turned on more logging for Dovecot (enabled the mail_log plugin). For some reason, once this was done, the shell script would run for a few minutes and then hang, as it added more log messages to the dsync STDOUT. Once the mail_log plugin was disabled, it ran without hanging. Is there any way to run doveadm and temporarily suspend the mail_log plugin? Or is there a better way to do this? Thanks for the insights. Asai
Unexpected behavior with sieve_vacation_to_header_ignore_envelope = yes
Hello, we face an issue with the vacation extension of pigeonhole. Our upstream mail server (from which we pull our E-Mails with POP3) uses SPF and performs a SRS re-write of the Return Path. Once the mail is processed via our local postfix, it is delivered via dovecot deliver (using the lda). When the recipient has a vacation rule enabled in sieve, the out-of-office note cannot be sent, as pigeonhole tries to use the Return-Path (which is not accepted as sender by the mail server). We are using the following dovecot / pigeonhole versions: dovecot-2.3.2.1 dovecot-pigeonhole-0.5.2 As of my understanding, the problem was addressed in pigeonhole version v0.4.21 by introducing the sieve_vacation_to_header_ignore_envelope setting. Anyway - even when this is set to "yes" pigeonhole still uses the Return-Path instead of the "From:" header which I had expected: Feb 27 13:22:26 mail dovecot: lda(customer)<48383><3o+yOQGBdlz/vAAAZU03Dg>: Error: sieve: msgid=: failed to send vacation response to SRS0=gwGXg6ad=RC=petermann-it.de=matth...@example.com: returned error> (temporary error) Are my expectations wrong or did I miss some precondition? Best regards, Matthias 1) This is the email which I use to test (I replaced the actual domain with example.com): -->8-- Return-Path: Delivered-To: customer[[@example.com]] To: Customer From: Matthias Petermann Subject: Test Message-ID: Date: Wed, 27 Feb 2019 05:21:45 +0100 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.5.1 Test message --8<-- 2) The related excerpt of the configuration: -->8-- mail /usr/local/etc/dovecot/conf.d >doveconf | grep -A 10 -B 10 to_header_ignore_envelope result_failure = continue result_internalfail = continue result_success = return-ok skip = never username_filter = } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes sieve = file:/srv/vmail/%u/sieve;active=/srv/vmail/%u/active.sieve sieve_vacation_to_header_ignore_envelope = yes } pop3_client_workarounds = pop3_delete_type = default pop3_deleted_flag = pop3_enable_last = no pop3_fast_size_lookups = no pop3_lock_session = no pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s pop3_no_flag_updates = no pop3_reuse_xuidl = no --8<-- -- Matthias Petermann
Re: performance issue with UID SEARCH
Without FTS, dovecot needs to open *each* and *every* email when doing text searches, which is understandably rather slow process. Aki On 27.2.2019 10.43, Marc Roos wrote: > > > I am not sure if this any help. From what I understand of maildir it has > lots of separate files, thus uid/gid lookups. Try running something like > nscd, that will cache these lookups? > > > > > -Original Message- > From: Aki Tuomi via dovecot [mailto:dovecot@dovecot.org] > Sent: 27 February 2019 06:24 > To: Ben Burke; Dovecot Mailing List > Subject: Re: performance issue with UID SEARCH > > > On 27 February 2019 03:27 Ben Burke via dovecot < > dovecot@dovecot.org> wrote: > > > Hi, > > I'm running dovecot 2.2.x and I'm having an issue where I see many > dovecot processes use all the available IO on a server. According > to > iotop the worst offenders seem to be in this state (NOTE: I swapped > in > phony username & IP info): > > dovecot/imap [someusername 123.456.789.012 UID SEARCH] > > The server in question is running with Maildirs on top of an XFS > filesystem. Is there anything I can do to optimize "UID SEARCH" or > find > out why it's being a problem? I've read > https://wiki2.dovecot.org/PerformanceTuning and the linked pages. > > By "being a problem" I mean iostat -xmt 1 /dev/diskdevice shows > 100% > utilization for long periods and in some cases io service times are > > taking many seconds... which causes thunderbird to timeout when > doing > things like appending messages to user "Sent" mailboxes. > > Any ideas? > > Thanks, > Ben Burke > > > Are you using FTS? If not, you should. See > https://wiki.dovecot.org/Plugins/FTS > --- > Aki Tuomi > >
Re: CASifying dovecot and webmail
El 17/2/19 a las 18:33, Juan Carlos Sánchez via dovecot escribió: Hello: I'm trying to authenticate webmail (roundcube) and dovecot with Apereo CAS. I don't find any good guide and everything I have found is some years old. Has any of you done a recent integration with CAS and can share the details ? I can't help you with rouncube part (because we use horde as webmail), but dovecot we have configured with pam_cas module. The idea is that horde pass a PGT as user password, and with PAM dovecot server checks it. -- Angel L. Mateo Martínez Sección de Telemática Área de Tecnologías de la Información y las Comunicaciones Aplicadas (ATICA) http://www.um.es/atica Tfo: 868889150 Fax: 86337
Re: Linking mailboxes
So did you get everything fixed up ? > doveadm(lightdm): Error: Can't open mailbox Storage/Email: stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied (euid=976(lightdm) egid=976(lightdm) missing +x perm: /run/media/computer/Storage/Email, dir owned by 5000:5000 mode=0700) Now it's another user that needs to access that directory (lightdm, euid=976). I would add lightdm to the vmail group and make the directory group readable and accessible, so chmod g+rx /run/media/computer/Storage/Email and any other folder it's complaining about. Yassine.
Re: Dovecot 2.3.3 Mailbox does not exist
Never done shared/public folders but perhaps Debug mode will give a hint. doveadm -Dv acl get -A Public/Archive On Tue, 2019-02-26 at 10:21 -0500, Kunal A. via dovecot wrote: > HI, > I would deeply aprechiate if someone here could help me address a > problem with ACL. I would personally refrain from e-mailing ever so > often as I understand other users have more important issues to > discuss about. Anyways I hope someone here could help. > > When I run ;- > doveadm acl get -A Public/ArchiveI keep getting an error that says > Mailbox does not exist . See erorr message below : - > > Error: Can't open mailbox Public/Archive: Mailbox doesn't exist: > Public/Archive > > In the fastmail folder there is a folder called Archive, why isn't it > being read? The folder is drwxr-xr-x. with vmail as owner. > > Deeply appreciate if someone could help with this. > Many thanks > > dovecot -n output :- > > # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf > # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty > Nine) > # Hostname: machine > auth_mechanisms = plain login > mail_location = maildir:~/Maildir > mail_plugins = acl > mail_privileged_group = mail > mbox_write_locks = fcntl > namespace { > list = children > location = maildir:/run/media/computer/Storage/Email/fastmail/ > prefix = Public/ > separator = / > subscriptions = yes > type = public > } > namespace inbox { > inbox = yes > list = yes > location = > mailbox Drafts { > special_use = \Drafts > } > mailbox Junk { > special_use = \Junk > } > mailbox Sent { > special_use = \Sent > } > mailbox "Sent Messages" { > special_use = \Sent > } > mailbox Trash { > special_use = \Trash > } > prefix = INBOX/ > separator = / > } > passdb { > driver = pam > } > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > plugin { > acl = vfile > } > postmaster_address = postmaster at example.com > protocols = imap pop3 > service auth-worker { > user = vmail > } > service auth { > unix_listener /var/spool/postfix/private/auth { > group = postfix > mode = 0666 > user = postfix > } > unix_listener auth-userdb { > mode = 0600 > user = vmail > } > user = dovecot > } > service imap-login { > inet_listener imap { > port = 143 > } > inet_listener imaps { > port = 993 > ssl = yes > } > } > service lmtp { > unix_listener /var/spool/postfix/private/dovecot-lmtp { > group = postfix > mode = 0600 > user = postfix > } > } > service pop3-login { > inet_listener pop3 { > port = 0 > } > inet_listener pop3s { > port = 995 > ssl = yes > } > } > ssl = required > ssl_cert = ssl_cipher_list = PROFILE=SYSTEM > ssl_key = # hidden, use -P to show it > userdb { > driver = passwd > } > userdb { > args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n > driver = static > } > protocol imap { > mail_plugins = acl imap_acl > } > >