Re: Dovecot Logging and Shell Script Hang

2019-02-27 Thread Asai via dovecot
On Feb 27, 2019, at 11:00 AM, Aki Tuomi via dovecot  wrote:
> 
> 
>> On 27 February 2019 18:49 Asai via dovecot  wrote:
>> 
>> 
>> Greetings,
>> 
>> We have a PHP based shell script that runs a doveadm backup routine.
>> 
>> This script was running just fine, and then we turned on more logging for 
>> Dovecot (enabled the mail_log plugin). For some reason, once this was done, 
>> the shell script would run for a few minutes and then hang, as it added more 
>> log messages to the dsync STDOUT. Once the mail_log plugin was disabled, it 
>> ran without hanging.
>> 
>> Is there any way to run doveadm and temporarily suspend the mail_log plugin? 
>> Or is there a better way to do this?
>> 
>> Thanks for the insights.
>> 
>> Asai
>> 
> 
> You might want to enable mail_log plugin for imap/pop3 protocols only.
> 
> protocol imap {
>   mail_plugins = $mail_plugins mail_log
> }
> 
> protocol pop3 {
>   mail_plugins = $mail_plugins mail_log
> }
> 
> Aki

Thank you, Aki,  I will try that.



Re: Dovecot Logging and Shell Script Hang

2019-02-27 Thread Aki Tuomi via dovecot


> On 27 February 2019 18:49 Asai via dovecot  wrote:
> 
> 
> Greetings,
> 
> We have a PHP based shell script that runs a doveadm backup routine.
> 
> This script was running just fine, and then we turned on more logging for 
> Dovecot (enabled the mail_log plugin). For some reason, once this was done, 
> the shell script would run for a few minutes and then hang, as it added more 
> log messages to the dsync STDOUT. Once the mail_log plugin was disabled, it 
> ran without hanging.
> 
> Is there any way to run doveadm and temporarily suspend the mail_log plugin? 
> Or is there a better way to do this?
> 
> Thanks for the insights.
> 
> Asai
>

You might want to enable mail_log plugin for imap/pop3 protocols only.

protocol imap {
   mail_plugins = $mail_plugins mail_log
}

protocol pop3 {
   mail_plugins = $mail_plugins mail_log
}

Aki


Re: Dovecot 2.3.3 Mailbox does not exist

2019-02-27 Thread Kunal A. via dovecot
Dear Martin,
Many thanks for the advise and yes I agree I should set debug mode to on
and work from there.
Thanks!
Kunal


On Wed, Feb 27, 2019 at 4:11 AM Martin Johannes Dauser via dovecot <
dovecot@dovecot.org> wrote:

> Never done shared/public folders but perhaps Debug mode will give a hint.
>
> doveadm -Dv acl get -A Public/Archive
>
> On Tue, 2019-02-26 at 10:21 -0500, Kunal A. via dovecot wrote:
>
> HI,
> I would deeply aprechiate if someone here could help me address a problem
> with ACL. I would personally refrain from e-mailing ever so often as I
> understand other users have more important issues to discuss about. Anyways
> I hope someone here could help.
>
> When I run ;-
>  doveadm acl get -A Public/Archive
> I keep getting an error that says Mailbox does not exist . See erorr
> message below : -
>
> Error: Can't open mailbox Public/Archive: Mailbox doesn't exist:
> Public/Archive
>
> In the fastmail folder there is a folder called Archive, why isn't it
> being read?  The folder is drwxr-xr-x. with vmail as owner.
>
> Deeply appreciate if someone could help with this.
> Many  thanks
>
> dovecot -n output :-
>
> # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf
> # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty Nine)
> # Hostname: machine
> auth_mechanisms = plain login
> mail_location = maildir:~/Maildir
> mail_plugins = acl
> mail_privileged_group = mail
> mbox_write_locks = fcntl
> namespace {
>   list = children
>   location = maildir:/run/media/computer/Storage/Email/fastmail/
>   prefix = Public/
>   separator = /
>   subscriptions = yes
>   type = public
> }
> namespace inbox {
>   inbox = yes
>   list = yes
>   location =
>   mailbox Drafts {
> special_use = \Drafts
>   }
>   mailbox Junk {
> special_use = \Junk
>   }
>   mailbox Sent {
> special_use = \Sent
>   }
>   mailbox "Sent Messages" {
> special_use = \Sent
>   }
>   mailbox Trash {
> special_use = \Trash
>   }
>   prefix = INBOX/
>   separator = /
> }
> passdb {
>   driver = pam
> }
> passdb {
>   args = /etc/dovecot/dovecot-sql.conf.ext
>   driver = sql
> }
> plugin {
>   acl = vfile
> }
> postmaster_address = postmaster at example.com
> protocols = imap pop3
> service auth-worker {
>   user = vmail
> }
> service auth {
>   unix_listener /var/spool/postfix/private/auth {
> group = postfix
> mode = 0666
> user = postfix
>   }
>   unix_listener auth-userdb {
> mode = 0600
> user = vmail
>   }
>   user = dovecot
> }
> service imap-login {
>   inet_listener imap {
> port = 143
>   }
>   inet_listener imaps {
> port = 993
> ssl = yes
>   }
> }
> service lmtp {
>   unix_listener /var/spool/postfix/private/dovecot-lmtp {
> group = postfix
> mode = 0600
> user = postfix
>   }
> }
> service pop3-login {
>   inet_listener pop3 {
> port = 0
>   }
>   inet_listener pop3s {
> port = 995
> ssl = yes
>   }
> }
> ssl = required
> ssl_cert =  ssl_cipher_list = PROFILE=SYSTEM
> ssl_key = # hidden, use -P to show it
> userdb {
>   driver = passwd
> }
> userdb {
>   args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n
>   driver = static
> }
> protocol imap {
>   mail_plugins = acl imap_acl
> }
>
>


Dovecot Logging and Shell Script Hang

2019-02-27 Thread Asai via dovecot
Greetings,

We have a PHP based shell script that runs a doveadm backup routine.

This script was running just fine, and then we turned on more logging for 
Dovecot (enabled the mail_log plugin).  For some reason, once this was done, 
the shell script would run for a few minutes and then hang, as it added more 
log messages to the dsync STDOUT.  Once the mail_log plugin was disabled, it 
ran without hanging.

Is there any way to run doveadm and temporarily suspend the mail_log plugin?  
Or is there a better way to do this?

Thanks for the insights.
Asai


Unexpected behavior with sieve_vacation_to_header_ignore_envelope = yes

2019-02-27 Thread Matthias Petermann via dovecot

Hello,

we face an issue with the vacation extension of pigeonhole. Our upstream 
mail server (from which we pull our E-Mails with POP3) uses SPF and 
performs a SRS re-write of the Return Path. Once the mail is processed 
via our local postfix, it is delivered via dovecot deliver (using the 
lda). When the recipient has a vacation rule enabled in sieve, the 
out-of-office note cannot be sent, as pigeonhole tries to use the 
Return-Path (which is not accepted as sender by the mail server).


We are using the following dovecot / pigeonhole versions:

dovecot-2.3.2.1
dovecot-pigeonhole-0.5.2

As of my understanding, the problem was addressed in pigeonhole version 
v0.4.21 by introducing the sieve_vacation_to_header_ignore_envelope 
setting. Anyway - even when this is set to "yes" pigeonhole still uses 
the Return-Path instead of the "From:" header which I had expected:


Feb 27 13:22:26 mail dovecot: 
lda(customer)<48383><3o+yOQGBdlz/vAAAZU03Dg>: Error: sieve: 
msgid=: failed to 
send vacation response to 
SRS0=gwGXg6ad=RC=petermann-it.de=matth...@example.com: returned error> (temporary error)


Are my expectations wrong or did I miss some precondition?

Best regards,
Matthias

1) This is the email which I use to test (I replaced the actual domain 
with example.com):


-->8--
Return-Path: 
Delivered-To: customer[[@example.com]]
To: Customer 
From: Matthias Petermann 
Subject: Test
Message-ID: 
Date: Wed, 27 Feb 2019 05:21:45 +0100
User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101
 Thunderbird/60.5.1

Test message
--8<--

2) The related excerpt of the configuration:

-->8--
mail /usr/local/etc/dovecot/conf.d >doveconf | grep -A 10 -B 10 
to_header_ignore_envelope

  result_failure = continue
  result_internalfail = continue
  result_success = return-ok
  skip = never
  username_filter =
}
plugin {
  acl = vfile
  acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes
  sieve = file:/srv/vmail/%u/sieve;active=/srv/vmail/%u/active.sieve
  sieve_vacation_to_header_ignore_envelope = yes
}
pop3_client_workarounds =
pop3_delete_type = default
pop3_deleted_flag =
pop3_enable_last = no
pop3_fast_size_lookups = no
pop3_lock_session = no
pop3_logout_format = top=%t/%p, retr=%r/%b, del=%d/%m, size=%s
pop3_no_flag_updates = no
pop3_reuse_xuidl = no
--8<--

--
Matthias Petermann 


Re: performance issue with UID SEARCH

2019-02-27 Thread Aki Tuomi via dovecot
Without FTS, dovecot needs to open *each* and *every* email when doing
text searches, which is understandably rather slow process.

Aki

On 27.2.2019 10.43, Marc Roos wrote:
>  
>
> I am not sure if this any help. From what I understand of maildir it has 
> lots of separate files, thus uid/gid lookups. Try running something like 
> nscd, that will cache these lookups?
>
>
>
>
> -Original Message-
> From: Aki Tuomi via dovecot [mailto:dovecot@dovecot.org] 
> Sent: 27 February 2019 06:24
> To: Ben Burke; Dovecot Mailing List
> Subject: Re: performance issue with UID SEARCH
>
>
>   On 27 February 2019 03:27 Ben Burke via dovecot < 
> dovecot@dovecot.org> wrote: 
>
>
>   Hi, 
>
>   I'm running dovecot 2.2.x and I'm having an issue where I see many 
>   dovecot processes use all the available IO on a server. According 
> to 
>   iotop the worst offenders seem to be in this state (NOTE: I swapped 
> in 
>   phony username & IP info): 
>
>   dovecot/imap [someusername 123.456.789.012 UID SEARCH] 
>
>   The server in question is running with Maildirs on top of an XFS 
>   filesystem. Is there anything I can do to optimize "UID SEARCH" or 
> find 
>   out why it's being a problem? I've read 
>   https://wiki2.dovecot.org/PerformanceTuning and the linked pages. 
>
>   By "being a problem" I mean iostat -xmt 1 /dev/diskdevice shows 
> 100% 
>   utilization for long periods and in some cases io service times are 
>
>   taking many seconds... which causes thunderbird to timeout when 
> doing 
>   things like appending messages to user "Sent" mailboxes. 
>
>   Any ideas? 
>
>   Thanks, 
>   Ben Burke 
>
>
> Are you using FTS? If not, you should. See 
> https://wiki.dovecot.org/Plugins/FTS
> ---
> Aki Tuomi
>
>


Re: CASifying dovecot and webmail

2019-02-27 Thread Ángel L . Mateo via dovecot

El 17/2/19 a las 18:33, Juan Carlos Sánchez via dovecot escribió:

Hello:

I'm trying to authenticate webmail (roundcube) and dovecot with Apereo CAS.

I don't find any good guide and everything I have found is some years 
old. Has any of you done a recent integration with CAS and can share the 
details ?


	I can't help you with rouncube part (because we use horde as webmail), 
but dovecot we have configured with pam_cas module.


	The idea is that horde pass a PGT as user password, and with PAM 
dovecot server checks it.


--
Angel L. Mateo Martínez
Sección de Telemática
Área de Tecnologías de la Información
y las Comunicaciones Aplicadas (ATICA)
http://www.um.es/atica
Tfo: 868889150
Fax: 86337


Re: Linking mailboxes

2019-02-27 Thread Yassine Chaouche via dovecot

So did you get everything fixed up ?

> doveadm(lightdm): Error: Can't open mailbox Storage/Email: 
stat(/run/media/computer/Storage/Email/tmp) failed: Permission denied 
(euid=976(lightdm) egid=976(lightdm) missing +x perm: 
/run/media/computer/Storage/Email, dir owned by 5000:5000 mode=0700)


Now it's another user that needs to access that directory (lightdm, 
euid=976). I would add lightdm to the vmail group and make the directory 
group readable and accessible, so chmod g+rx 
/run/media/computer/Storage/Email and any other folder it's complaining 
about.


Yassine.


Re: Dovecot 2.3.3 Mailbox does not exist

2019-02-27 Thread Martin Johannes Dauser via dovecot
Never done shared/public folders but perhaps Debug mode will give a
hint.
 doveadm -Dv acl get -A Public/Archive
On Tue, 2019-02-26 at 10:21 -0500, Kunal A. via dovecot wrote:
> HI,
> I would deeply aprechiate if someone here could help me address a
> problem with ACL. I would personally refrain from e-mailing ever so
> often as I understand other users have more important issues to
> discuss about. Anyways I hope someone here could help. 
> 
> When I run ;-
>  doveadm acl get -A Public/ArchiveI keep getting an error that says
> Mailbox does not exist . See erorr message below : -
> 
> Error: Can't open mailbox Public/Archive: Mailbox doesn't exist:
> Public/Archive
> 
> In the fastmail folder there is a folder called Archive, why isn't it
> being read?  The folder is drwxr-xr-x. with vmail as owner.
> 
> Deeply appreciate if someone could help with this.
> Many  thanks
> 
> dovecot -n output :-
> 
> # 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf
> # OS: Linux 4.20.10-200.fc29.x86_64 x86_64 Fedora release 29 (Twenty
> Nine) 
> # Hostname: machine
> auth_mechanisms = plain login
> mail_location = maildir:~/Maildir
> mail_plugins = acl
> mail_privileged_group = mail
> mbox_write_locks = fcntl
> namespace {
>   list = children
>   location = maildir:/run/media/computer/Storage/Email/fastmail/
>   prefix = Public/
>   separator = /
>   subscriptions = yes
>   type = public
> }
> namespace inbox {
>   inbox = yes
>   list = yes
>   location = 
>   mailbox Drafts {
>     special_use = \Drafts
>   }
>   mailbox Junk {
>     special_use = \Junk
>   }
>   mailbox Sent {
>     special_use = \Sent
>   }
>   mailbox "Sent Messages" {
>     special_use = \Sent
>   }
>   mailbox Trash {
>     special_use = \Trash
>   }
>   prefix = INBOX/
>   separator = /
> }
> passdb {
>   driver = pam
> }
> passdb {
>   args = /etc/dovecot/dovecot-sql.conf.ext
>   driver = sql
> }
> plugin {
>   acl = vfile
> }
> postmaster_address = postmaster at example.com
> protocols = imap pop3
> service auth-worker {
>   user = vmail
> }
> service auth {
>   unix_listener /var/spool/postfix/private/auth {
>     group = postfix
>     mode = 0666
>     user = postfix
>   }
>   unix_listener auth-userdb {
>     mode = 0600
>     user = vmail
>   }
>   user = dovecot
> }
> service imap-login {
>   inet_listener imap {
>     port = 143
>   }
>   inet_listener imaps {
>     port = 993
>     ssl = yes
>   }
> }
> service lmtp {
>   unix_listener /var/spool/postfix/private/dovecot-lmtp {
>     group = postfix
>     mode = 0600
>     user = postfix
>   }
> }
> service pop3-login {
>   inet_listener pop3 {
>     port = 0
>   }
>   inet_listener pop3s {
>     port = 995
>     ssl = yes
>   }
> }
> ssl = required
> ssl_cert =  ssl_cipher_list = PROFILE=SYSTEM
> ssl_key = # hidden, use -P to show it
> userdb {
>   driver = passwd
> }
> userdb {
>   args = uid=vmail gid=vmail home=/var/mail/vhosts/%d/%n
>   driver = static
> }
> protocol imap {
>   mail_plugins = acl imap_acl
> }
> 
>