Re: [2.3.4] Segmentation faults

[Aki Tuomi]

It's still missing core dump (or bt full from it)

Aki

On 27.11.2018 8.39, Joan Moreau wrote:
>
> Thank you Aki
>
> here the requested data (below)
>
> Please not as well that we have numerous subfolders (>50) and pretty
> big mailbox sizes (>20G)
>
> Bug appears mostly in auth process and index-worker
>
>
> dovecot -n :
>
> # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf
> # Pigeonhole version 0.6.devel (65909cfa)
> # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4
> # Hostname: gjserver
> base_dir = /run/dovecot
> default_login_user = dovecot
> default_vsz_limit = 16 G
> disable_plaintext_auth = no
> listen = *
> log_path = /var/log/mail/dovecot.log
> mail_gid = mail
> mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n
> mail_plugins = fts fts_squat
> mail_uid = mailusers
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope
> encoded-character vacation subaddress comparator-i;ascii-numeric
> relational regex imap4flags copy include variables body enotify
> environment mailbox date index ihave duplicate mime foreverypart
> extracttext
> mdbox_rotate_size = 24 M
>
> (...)
>
> passdb {
> args = /etc/dovecot/dovecot-sql.conf
> driver = sql
> }
> (the rest default values)
>
>  
>
>
> On 2018-11-25 08:08, Aki Tuomi wrote:
>
>  
>
> On 25 November 2018 at 06:29 Joan Moreau < j...@grosjo.net
> > wrote:
>  
>  
> Hi
>  
> THis is the lines I have in my dmesg (see below)
>  
> In dovecot log , I see:
>  
> Nov 25 04:26:47 auth-worker: Error: double free or corruption
> (fasttop)
>  
> What do to about it ?
>  
> Using lastest 2.3.4 version
>  
> Thank you
>  
> 
>  
> [132932.169265] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00
> 00 00 00 00
> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa 36 f5
> 7a 7f 00
> 00 <40> 24 3d f5 7a 7f 00 00 21 80 00 00 00 00 00 00 00 94 16
> d6 ee 55
> [134031.969596] auth[27031]: segfault at 55e509612c30 ip
> 55e509612c30 sp 7ffeb96dee48 error 15
> [134031.969603] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00
> 00 00 00 00
> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 3a d3 e4
> ef 7f 00
> 00 <40> b4 d9 e4 ef 7f 00 00 21 80 00 00 00 00 00 00 00 04 5f
> 09 e5 55
> [134081.497871] doveadm[28930]: segfault at 7ffe4a16efc8 ip
> 7f393841013e sp 7ffe4a16efc0 error 6 in
> libdovecot.so.0.0.0[7f3938363000+e2000]
> [134081.497876] Code: 7d be e9 68 ff ff ff e8 10 4c f5 ff 41
> 57 41 89 cf
> 41 56 49 89 f6 41 55 41 89 fd 31 ff 41 54 55 44 89 c5 53 89 d3
> 48 83 ec
> 58 <4c> 89 4c 24 08 64 48 8b 04 25 28 00 00 00 48 89 44 24 48
> 31 c0 e8
> [134084.145731] doveadm[29186]: segfault at 7fff1cfdbff8 ip
> 7f4376e32ffb sp 7fff1cfdc000 error 6 in
> libdovecot.so.0.0.0[7f4376d86000+e2000]
> [134084.145735] Code: ff 66 0f 1f 44 00 00 e9 9d dc f6 ff 0f
> 1f 00 48 83
> ec 08 48 83 3d 14 16 0b 00 00 0f 85 d2 76 f6 ff 31 f6 48 8d 3d
> 05 16 0b
> 00  00 54 f5 ff 85 c0 0f 88 e4 76 f6 ff 48 83 c4 08 e9 69
> dc f6 ff
> [135453.211242] indexer-worker[2539]: segfault at 7ffec3ba4ff8 ip
> 7ffec43fdcff sp 7ffec3ba5000 error 6
> [135453.211245] Code: 95 4c 89 f7 48 89 75 d0 e8 5e fc ff ff
> 48 8b 75 d0
> e9 56 ff ff ff 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41
> 54 49 89
> f4 <53> 48 83 ec 08 48 85 ff 0f 84 b3 00 00 00 48 89 fb 4c 8d
> 35 69 c3
> [135453.730250] indexer-worker[9236]: segfault at 7fffed921ff8 ip
> 7fb7c9c4f5b1 sp 7fffed922000 error 6 in
> libdovecot.so.0.0.0[7fb7c9ba2000+e2000]
> [135453.730256] Code: 2e 0f 1f 84 00 00 00 00 00 41 57 4d 89
> cf 41 56 41
> 89 fe 41 55 49 89 f5 41 54 41 89 d4 55 89 cd 53 48 83 ec 08 4c
> 8b 4c 24
> 40  6a fb ff ff 85 c0 7e 4f 48 8b 05 7f f9 0a 00 be 38 00
> 00 00 48
> [135796.171575] auth[11121]: segfault at 555f8645cc30 ip
> 555f8645cc30 sp 7ffcbb510868 error 15
> [135796.171586] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00
> 00 00 00 00
> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 ba ed 38
> b7 7f 00
> 00 <40> 34 f4 38 b7 7f 00 00 21 80 00 00 00 00 00 00 00 a4 43
> 86 5f 55
> [136710.562003] auth[17828]: segfault at 563443604c30 ip
> 563443604c30 sp 7ffc1aa8b498 error 15
> [136710.562013] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00
> 00 00 00 00
> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 fa 48 da
> d5 7f 

Re: [2.3.4] Segmentation faults

[Joan Moreau]

Thank you Aki 

here the requested data (below) 


Please not as well that we have numerous subfolders (>50) and pretty big
mailbox sizes (>20G) 

Bug appears mostly in auth process and index-worker 

dovecot -n : 


# 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.6.devel (65909cfa)
# OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4
# Hostname: gjserver
base_dir = /run/dovecot
default_login_user = dovecot
default_vsz_limit = 16 G
disable_plaintext_auth = no
listen = *
log_path = /var/log/mail/dovecot.log
mail_gid = mail
mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n
mail_plugins = fts fts_squat
mail_uid = mailusers
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date index ihave duplicate mime foreverypart
extracttext
mdbox_rotate_size = 24 M 

(...) 


passdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
(the rest default values)

On 2018-11-25 08:08, Aki Tuomi wrote:

On 25 November 2018 at 06:29 Joan Moreau < j...@grosjo.net> wrote: 

Hi 

THis is the lines I have in my dmesg (see below) 

In dovecot log , I see: 

Nov 25 04:26:47 auth-worker: Error: double free or corruption (fasttop) 

What do to about it ? 

Using lastest 2.3.4 version 

Thank you 

 

[132932.169265] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa 36 f5 7a 7f 00 
00 <40> 24 3d f5 7a 7f 00 00 21 80 00 00 00 00 00 00 00 94 16 d6 ee 55 
[134031.969596] auth[27031]: segfault at 55e509612c30 ip 
55e509612c30 sp 7ffeb96dee48 error 15 
[134031.969603] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 3a d3 e4 ef 7f 00 
00 <40> b4 d9 e4 ef 7f 00 00 21 80 00 00 00 00 00 00 00 04 5f 09 e5 55 
[134081.497871] doveadm[28930]: segfault at 7ffe4a16efc8 ip 
7f393841013e sp 7ffe4a16efc0 error 6 in 
libdovecot.so.0.0.0[7f3938363000+e2000] 
[134081.497876] Code: 7d be e9 68 ff ff ff e8 10 4c f5 ff 41 57 41 89 cf 
41 56 49 89 f6 41 55 41 89 fd 31 ff 41 54 55 44 89 c5 53 89 d3 48 83 ec 
58 <4c> 89 4c 24 08 64 48 8b 04 25 28 00 00 00 48 89 44 24 48 31 c0 e8 
[134084.145731] doveadm[29186]: segfault at 7fff1cfdbff8 ip 
7f4376e32ffb sp 7fff1cfdc000 error 6 in 
libdovecot.so.0.0.0[7f4376d86000+e2000] 
[134084.145735] Code: ff 66 0f 1f 44 00 00 e9 9d dc f6 ff 0f 1f 00 48 83 
ec 08 48 83 3d 14 16 0b 00 00 0f 85 d2 76 f6 ff 31 f6 48 8d 3d 05 16 0b 
00  00 54 f5 ff 85 c0 0f 88 e4 76 f6 ff 48 83 c4 08 e9 69 dc f6 ff 
[135453.211242] indexer-worker[2539]: segfault at 7ffec3ba4ff8 ip 
7ffec43fdcff sp 7ffec3ba5000 error 6 
[135453.211245] Code: 95 4c 89 f7 48 89 75 d0 e8 5e fc ff ff 48 8b 75 d0 
e9 56 ff ff ff 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 49 89 
f4 <53> 48 83 ec 08 48 85 ff 0f 84 b3 00 00 00 48 89 fb 4c 8d 35 69 c3 
[135453.730250] indexer-worker[9236]: segfault at 7fffed921ff8 ip 
7fb7c9c4f5b1 sp 7fffed922000 error 6 in 
libdovecot.so.0.0.0[7fb7c9ba2000+e2000] 
[135453.730256] Code: 2e 0f 1f 84 00 00 00 00 00 41 57 4d 89 cf 41 56 41 
89 fe 41 55 49 89 f5 41 54 41 89 d4 55 89 cd 53 48 83 ec 08 4c 8b 4c 24 
40  6a fb ff ff 85 c0 7e 4f 48 8b 05 7f f9 0a 00 be 38 00 00 00 48 
[135796.171575] auth[11121]: segfault at 555f8645cc30 ip 
555f8645cc30 sp 7ffcbb510868 error 15 
[135796.171586] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 ba ed 38 b7 7f 00 
00 <40> 34 f4 38 b7 7f 00 00 21 80 00 00 00 00 00 00 00 a4 43 86 5f 55 
[136710.562003] auth[17828]: segfault at 563443604c30 ip 
563443604c30 sp 7ffc1aa8b498 error 15 
[136710.562013] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 fa 48 da d5 7f 00 
00 <40> 74 4f da d5 7f 00 00 21 80 00 00 00 00 00 00 00 24 5e 43 34 56 
[138331.686718] auth[31046]: segfault at 55b27bc63c30 ip 
55b27bc63c30 sp 7ffd5d5b9298 error 15 
[138331.686721] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 9a 08 17 cd 7f 00 
00 <40> 14 0f 17 cd 7f 00 00 21 80 00 00 00 00 00 00 00 14 c4 7b b2 55 
[138521.070485] auth[32481]: segfault at 556e05197c30 ip 
556e05197c30 sp 7ffe87217c08 error 15 
[138521.070487] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa a7 20 3c 7f 00 
00 <40> 24 ae 20 3c 7f 00 00 21 80 00 00 00 00 00 00 00 54 17 05 6e 55 
[138782.544700] auth[2408]: segfault at 5570d3e46c30 ip 5570d3e46c30 
sp 7ffc9118a5e8 error 15 
[138782.544709] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 da fc 71 11 7f 00 
00 <40> 54 03 72 11 7f 00 00 21 80 00 

Re: Ubuntu 18.04 (Bionic) packages now available

[Michael Ludwig]

Hi Jean-Daniel,

thanks a lot for your answer.
Think for the first time I will stick to the default ubuntu version and see
how these packages will progress in the future.

Michael


Am Mo., 26. Nov. 2018 um 09:46 Uhr schrieb Jean-Daniel Dupas <
jddu...@xooloo.com>:

>
>
> > Le 25 nov. 2018 à 19:25, Michael Ludwig  a
> écrit :
> >
> >
> > Hello Dovecot-List,
> >
> > so Ubuntu users now can get the latest dovecot version. As I am just
> building a production mailserver for customers, this could come in handy,
> maybe.
> > For a live production system, is it reasonable to switch from the main
> Ubuntu Dovecot release to your newer packages?
> > How long will the Dovecot team build these packages? When the team don't
> want to build these packages anymore, how difficult will it be to switch
> back to the Ubuntu maintained versions?
> >
>
> I did the switch from mainstream to dovecot repo to upgrade from 2.2 to
> 2.3 on xenial, and appart one or two minor configurations changes, it
> worked just fine.
>
> And more recently, I switched from a bionic-backport of cosmic release
> (used to get 2.3 on bionic) to this just released version using apt and it
> was transparent.
>
> In my case, switching back to mainstream on the other hand would be
> harder, as I now rely on 2.3 specific features.
>
> So I guess as long as you don't use features that are not yet released
> upstream, switching back should not be difficult.
>
>
>
>

replication dropped imap flags

[Patrick Cernko]

Hi list,

I think, I found a bug in the replication setup, that drops (custom) 
flags like Thunderbird labels. I have set up a simple 2 node setup to 
reproduce and explain it:


Host adove.mpi-klsb.mpg.de and bdove.mpi-klsb.mpg.de (doveconf -n 
attached) have dovecot-imapd (from repo.dovecot.org) installed on an 
ext4 filesystem. They only have one account "test" via 
/etc/dovecot/userdb ("test:testpassword:::Test User::/bin/bash:"). It's 
mailbox contains one message, that is flagged with "$label1":


doveadm -f flow fetch -u test 'guid flags' ALL
guid=d1516a2b5c08fc5b541d5a350039 flags=\Recent $label1

Now I simulate a node reinstall on adove by uninstalling dovecot, 
removing all remnants, reinstalling and configuring it again:


apt purge dovecot-core dovecot-imapd
rm -rf /var/vmail /var/lib/dovecot /etc/dovecot
apt install dovecot-imapd
# disable system auth
: > /etc/dovecot/conf.d/auth-system.conf.ext
# create /var/vmail
install -d -o nobody -g nogroup -m 700 /var/vmail
# create userdb
echo 'test:testpassword:::Test User::/bin/bash:' > /etc/dovecot/userdb
# create /etc/dovecot/local.conf
# not described here, the resulting doveconf -n is attached!
service dovecot restart


When I check the flags of the mail of user test now, the "$label1" is 
disapeared on both machines, even after "doveadm replicator replicate -f 
test":


doveadm -f flow fetch -u test 'guid flags' ALL
guid=d1516a2b5c08fc5b541d5a350039 flags=\Recent


Any hints what I am doing wrong here or is this really a bug?

Best,
--
Patrick Cernko  +49 681 9325 5815
Joint Administration: Information Services and Technology
Max-Planck-Institute fuer Informatik & Softwaresysteme
# 2.3.4 (0ecbaf23d): /etc/dovecot/dovecot.conf
# OS: Linux 4.14.65.1.amd64-smp x86_64 Debian 9.6 
# Hostname: bdove.mpi-klsb.mpg.de
doveadm_password = # hidden, use -P to show it
doveadm_port = 12345
listen = *
mail_gid = nogroup
mail_home = /var/vmail/%u
mail_location = mdbox:~/mdbox
mail_plugins = notify replication
mail_uid = nobody
namespace inbox {
  inbox = yes
  location = 
  mailbox Drafts {
special_use = \Drafts
  }
  mailbox Junk {
special_use = \Junk
  }
  mailbox Sent {
special_use = \Sent
  }
  mailbox "Sent Messages" {
special_use = \Sent
  }
  mailbox Trash {
special_use = \Trash
  }
  prefix = 
}
passdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
plugin {
  mail_replica = tcp:adove.mpi-klsb.mpg.de
}
protocols = " imap"
service aggregator {
  fifo_listener replication-notify-fifo {
mode = 0666
  }
  unix_listener replication-notify {
mode = 0666
  }
}
service doveadm {
  inet_listener doveadm-server {
port = 12345
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
mode = 0666
  }
}
ssl = no
userdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
# 2.3.4 (0ecbaf23d): /etc/dovecot/dovecot.conf
# OS: Linux 4.14.65.1.amd64-smp x86_64 Debian 9.6 
# Hostname: adove.mpi-klsb.mpg.de
doveadm_password = # hidden, use -P to show it
doveadm_port = 12345
listen = *
mail_gid = nogroup
mail_home = /var/vmail/%u
mail_location = mdbox:~/mdbox
mail_plugins = notify replication
mail_uid = nobody
namespace inbox {
  inbox = yes
  location = 
  mailbox Drafts {
special_use = \Drafts
  }
  mailbox Junk {
special_use = \Junk
  }
  mailbox Sent {
special_use = \Sent
  }
  mailbox "Sent Messages" {
special_use = \Sent
  }
  mailbox Trash {
special_use = \Trash
  }
  prefix = 
}
passdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}
plugin {
  mail_replica = tcp:bdove.mpi-klsb.mpg.de
}
protocols = " imap"
service aggregator {
  fifo_listener replication-notify-fifo {
mode = 0666
  }
  unix_listener replication-notify {
mode = 0666
  }
}
service doveadm {
  inet_listener doveadm-server {
port = 12345
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
mode = 0666
  }
}
ssl = no
userdb {
  args = /etc/dovecot/userdb
  driver = passwd-file
}


smime.p7s
Description: S/MIME Cryptographic Signature

Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): auth-client-connection.c:338

[Mart Pirita]

Hmm, can this be related to SMTP brute force attack attempts and
Postfix, using conf:

smtpd_junk_command_limit = 2
smtpd_error_sleep_time = 15s
smtpd_soft_error_limit = 5
smtpd_hard_error_limit = 10
smtpd_client_connection_count_limit = 5
smtpd_client_connection_rate_limit = 30

cuts connection and Dovecot gives error. But since Postfix conf have
been same for a long time and these errors came with Dovecot 2.3.3, then
seems I just must ignore them, however the error type is a bit spooky
(like debug message), so maybe some human readable explanation in logs
would be better. :).





Timo Sirainen wrote:
> On 26 Nov 2018, at 13.16, Mart Pirita  wrote:
>> Hi,
>>
>> Auth process is not constantly being shutdown and/or restarted and Dovecot 
>> is used for SMTP authentication (Postfix).
>>
>> Checked few servers logs, they are running v2.3.3, for example latest
>> (some day none, some day a lot, some day few) logs:
>>
>> Nov 25 18:48:11 server1 dovecot: auth: Warning: Event 0x2b79250f15f0
>> leaked (parent=(nil)): auth-client-connection.c:338
> I suppose these are happening because of:
>
>> dovecot: auth: Warning: auth client 0 disconnected with 1 pending
>> requests: EOF: 12 Time(s)
> Which probably happens when Postfix disconnects from Dovecot before the 
> authentication has finished.
>
> I can reproduce these if I set up PAM authentication and then do:
>
> doveadm auth test testuser wrongpass
> 
>
> Repeat the above a few times. Each time logs:
>
> Nov 26 13:36:13.588354 auth: Warning: auth client 0 disconnected with 1 
> pending requests: EOF
>
> Then stop Dovecot (or auth process at least):
>
> Nov 26 13:36:23.403778 auth: Warning: Event 0x561565277db0 leaked 
> (parent=(nil)): auth-client-connection.c:338
>
>

-- 
Mart

Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): auth-client-connection.c:338

[Timo Sirainen]

On 26 Nov 2018, at 13.16, Mart Pirita  wrote:
> 
> Hi,
> 
> Auth process is not constantly being shutdown and/or restarted and Dovecot is 
> used for SMTP authentication (Postfix).
> 
> Checked few servers logs, they are running v2.3.3, for example latest
> (some day none, some day a lot, some day few) logs:
> 
> Nov 25 18:48:11 server1 dovecot: auth: Warning: Event 0x2b79250f15f0
> leaked (parent=(nil)): auth-client-connection.c:338

I suppose these are happening because of:

> dovecot: auth: Warning: auth client 0 disconnected with 1 pending
> requests: EOF: 12 Time(s)

Which probably happens when Postfix disconnects from Dovecot before the 
authentication has finished.

I can reproduce these if I set up PAM authentication and then do:

doveadm auth test testuser wrongpass


Repeat the above a few times. Each time logs:

Nov 26 13:36:13.588354 auth: Warning: auth client 0 disconnected with 1 pending 
requests: EOF

Then stop Dovecot (or auth process at least):

Nov 26 13:36:23.403778 auth: Warning: Event 0x561565277db0 leaked 
(parent=(nil)): auth-client-connection.c:338

Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): auth-client-connection.c:338

[Mart Pirita]

Hi,

Auth process is not constantly being shutdown and/or restarted and Dovecot is 
used for SMTP authentication (Postfix).

Checked few servers logs, they are running v2.3.3, for example latest
(some day none, some day a lot, some day few) logs:

Nov 25 18:48:11 server1 dovecot: auth: Warning: Event 0x2b79250f15f0
leaked (parent=(nil)): auth-client-connection.c:338
Nov 25 18:48:11 server1 dovecot: auth: Warning: Event 0x2b79250ddc50
leaked (parent=(nil)): auth-client-connection.c:338
Nov 25 22:55:38 server1 dovecot: auth: Warning: Event 0x2b374a7bafb0
leaked (parent=(nil)): auth-client-connection.c:338
Nov 26 03:08:24 server1 dovecot: auth: Warning: Event 0x2b9b89e79040
leaked (parent=(nil)): auth-client-connection.c:338

Nov 25 04:38:04 server2 dovecot: auth: Warning: Event 0x2b4afb1ac370
leaked (parent=(nil)): auth-client-connection.c:338
Nov 25 04:38:04 server2 dovecot: auth: Warning: Event 0x2b4afb18eeb0
leaked (parent=(nil)): auth-client-connection.c:338
Nov 25 04:38:04 server2 dovecot: auth: Warning: Event 0x2b4afb183490
leaked (parent=(nil)): auth-client-connection.c:338
Nov 25 04:38:04 server2 dovecot: auth: Warning: Event 0x2b4afb18a900
leaked (parent=(nil)): auth-client-connection.c:338
Nov 25 04:38:04 server2 dovecot: auth: Warning: Event 0x2b4afb193d20
leaked (parent=(nil)): auth-client-connection.c:338


Conf:

# 2.3.3 (dcead646b): /etc/dovecot/dovecot.conf
# OS: Linux 2.6.18-419.el5 x86_64 CentOS release 5.11 (Final)
auth_cache_size = 1 k
auth_failure_delay = 1 mins
auth_mechanisms = plain login
base_dir = /var/run/dovecot/
disable_plaintext_auth = no
listen = *
login_log_format_elements = %u %r %m %c
mail_location = maildir:~/Maildir
mail_log_prefix = "%s(%u): "
mail_plugins = " mail_log notify"
mbox_very_dirty_syncs = yes
passdb {
  args = cache_key=#hidden_use-P_to_show# *
  driver = pam
}
plugin {
  autocreate = Drafts
  autocreate2 = Sent Items
  autosubscribe = Drafts
  autosubscribe2 = Sent Items
  fts_autoindex = yes
  mail_log_events = delete undelete expunge copy mailbox_delete
mailbox_rename
  mail_log_fields = uid box msgid size from subject vsize flags
}
service auth {
  unix_listener /var/spool/postfix/private/auth {
    group = postfix
    mode = 0666
    user = postfix
  }
}
service imap-login {
  inet_listener imap {
    port = 143
  }
  inet_listener imaps {
    port = 993
    ssl = yes
  }
}
service pop3-login {
  inet_listener pop3 {
    port = 110
  }
  inet_listener pop3s {
    port = 995
    ssl = yes
  }
}
ssl_ca =  On 3 Nov 2018, at 17.41, Mart Pirita  wrote:
>> Hi,
>>
>>
>> But this harmless is spamming logs, so how to disable it:
>>
>> grep auth-client-connection.c:338 maillog | wc -l
>>1259
> Actually this specific event leak isn't a known issue. I don't really 
> understand how it could happen. These event leaks are supposed to be checked 
> only at process deinit. Is the auth process constantly being shutdown and 
> restarted? What's your doveconf -n? Are you using Dovecot for SMTP 
> authentication or some other external auth?
>
>
>> Aki Tuomi wrote:
 On 03 November 2018 at 12:12 Mart Pirita < sysad...@e-positive.ee 
  
 >> wrote:


 Hi,


 Noticed with latest v2.3.3 some new warning in logs, for example:

 dovecot: auth: Warning: Event 0x80a6fc0 leaked (parent=(nil)):
 auth-client-connection.c:338: 1 Time(s)
 dovecot: auth: Warning: Event 0x80aa1c8 leaked (parent=(nil)):
 auth-client-connection.c:338: 1 Time(s)
 dovecot: auth: Warning: Event 0x80aa718 leaked (parent=(nil)):
 auth-client-connection.c:338: 1 Time(s)
 dovecot: auth: Warning: Event 0x80adac0 leaked (parent=(nil)):
 auth-client-connection.c:338: 1 Time(s)
 dovecot: auth: Warning: Event 0x80b6c38 leaked (parent=(nil)):
 auth-client-connection.c:338: 1 Time(s)
 dovecot: auth: Warning: Event 0x80c0e00 leaked (parent=(nil)):
 auth-client-connection.c:338: 1 Time(s)
 dovecot: auth: Warning: auth client 0 disconnected with 1 pending
 requests: EOF: 12 Time(s)


 What are they?


 -- 
 Mart
>>> Hi! It's harmless event leak. This is a known issue to us.
>>> ---
>>> Aki Tuomi
>> -- 
>> Mart


-- 
Mart

Re: Event 0x2b1a5f270bd0 leaked (parent=(nil)): auth-client-connection.c:338

[Timo Sirainen]

On 3 Nov 2018, at 17.41, Mart Pirita  wrote:
> 
> Hi,
> 
> 
> But this harmless is spamming logs, so how to disable it:
> 
> grep auth-client-connection.c:338 maillog | wc -l
>1259

Actually this specific event leak isn't a known issue. I don't really 
understand how it could happen. These event leaks are supposed to be checked 
only at process deinit. Is the auth process constantly being shutdown and 
restarted? What's your doveconf -n? Are you using Dovecot for SMTP 
authentication or some other external auth?


> Aki Tuomi wrote:
>>> On 03 November 2018 at 12:12 Mart Pirita < sysad...@e-positive.ee 
>>>  
>>> >> wrote:
>>> 
>>> 
>>> Hi,
>>> 
>>> 
>>> Noticed with latest v2.3.3 some new warning in logs, for example:
>>> 
>>> dovecot: auth: Warning: Event 0x80a6fc0 leaked (parent=(nil)):
>>> auth-client-connection.c:338: 1 Time(s)
>>> dovecot: auth: Warning: Event 0x80aa1c8 leaked (parent=(nil)):
>>> auth-client-connection.c:338: 1 Time(s)
>>> dovecot: auth: Warning: Event 0x80aa718 leaked (parent=(nil)):
>>> auth-client-connection.c:338: 1 Time(s)
>>> dovecot: auth: Warning: Event 0x80adac0 leaked (parent=(nil)):
>>> auth-client-connection.c:338: 1 Time(s)
>>> dovecot: auth: Warning: Event 0x80b6c38 leaked (parent=(nil)):
>>> auth-client-connection.c:338: 1 Time(s)
>>> dovecot: auth: Warning: Event 0x80c0e00 leaked (parent=(nil)):
>>> auth-client-connection.c:338: 1 Time(s)
>>> dovecot: auth: Warning: auth client 0 disconnected with 1 pending
>>> requests: EOF: 12 Time(s)
>>> 
>>> 
>>> What are they?
>>> 
>>> 
>>> -- 
>>> Mart
>> 
>> Hi! It's harmless event leak. This is a known issue to us.
>> ---
>> Aki Tuomi
> 
> 
> -- 
> Mart

Re: Ubuntu 18.04 (Bionic) packages now available

[Jean-Daniel Dupas]

> Le 25 nov. 2018 à 19:25, Michael Ludwig  a écrit 
> :
> 
> 
> Hello Dovecot-List,
> 
> so Ubuntu users now can get the latest dovecot version. As I am just building 
> a production mailserver for customers, this could come in handy, maybe.
> For a live production system, is it reasonable to switch from the main Ubuntu 
> Dovecot release to your newer packages?
> How long will the Dovecot team build these packages? When the team don't want 
> to build these packages anymore, how difficult will it be to switch back to 
> the Ubuntu maintained versions?
> 

I did the switch from mainstream to dovecot repo to upgrade from 2.2 to 2.3 on 
xenial, and appart one or two minor configurations changes, it worked just fine.

And more recently, I switched from a bionic-backport of cosmic release (used to 
get 2.3 on bionic) to this just released version using apt and it was 
transparent.

In my case, switching back to mainstream on the other hand would be harder, as 
I now rely on 2.3 specific features.

So I guess as long as you don't use features that are not yet released 
upstream, switching back should not be difficult.

Re: determine why mail clients download mails 2nd time

[Aki Tuomi]

On 26.11.2018 10.01, Poliman - Serwis wrote:
> I have strange problem. In last Friday I had a problem with dovecot.
> It didn't see directories with mailboxes in /var/vmail. Somehow it
> crashed because probably two things (a lot of this type of lines in
> mail.err file):
> /Nov 23 07:05:02 s1 dovecot: lda(p...@poli.li ):
> Error: User initialization failed: Initializing mail storage from
> mail_location setting failed: mkdir(/var/vmail/poli.li/poli/Maildir
> ) failed: Permission denied
> (euid=5000(vmail) egid=5000(vmail) missing +w perm: /var/vmail, dir
> owned by 0:0 mode=0755)/

/var/vmail is not owned by vmail:vmail, which I think it should be in
your configuration.

> and maybe /
> /
> //
> /Nov 12 09:27:59 s1 dovecot: imap(ar...@firmastanaszek.pl
> ): Error: Corrupted index cache file
> /var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache
> : Broken
> MIME parts for mail UID 559 in mailbox INBOX: Cached MIME parts don't
> match message during parsing: Cached header size mismatch (parts=)
> Nov 12 09:27:59 s1 dovecot: imap(ar...@firmastanaszek.pl
> ): Error:
> unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache
> ) failed:
> No such file or directory (in mail-cache.c:28)/
>
> and after this event probably all mailboxes download again all emails
> from 1.11 to 22.11. They were duplicated in mail clients.

Unlikely that this causes all mailboxes to download all mails.

> -- 
> /Pozdrawiam / Best Regards
> /
> /Piotr Bracha/

Also which version of dovecot is this?

Aki

determine why mail clients download mails 2nd time

[Poliman - Serwis]

I have strange problem. In last Friday I had a problem with dovecot. It
didn't see directories with mailboxes in /var/vmail. Somehow it crashed
because probably two things (a lot of this type of lines in mail.err file):
*Nov 23 07:05:02 s1 dovecot: lda(p...@poli.li ): Error: User
initialization failed: Initializing mail storage from mail_location setting
failed: mkdir(/var/vmail/poli.li/poli/Maildir
) failed: Permission denied (euid=5000(vmail)
egid=5000(vmail) missing +w perm: /var/vmail, dir owned by 0:0 mode=0755)*
and maybe

*Nov 12 09:27:59 s1 dovecot: imap(ar...@firmastanaszek.pl
): Error: Corrupted index cache file
/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache
: Broken MIME
parts for mail UID 559 in mailbox INBOX: Cached MIME parts don't match
message during parsing: Cached header size mismatch (parts=)Nov 12 09:27:59
s1 dovecot: imap(ar...@firmastanaszek.pl ): Error:
unlink(/var/vmail/firmastanaszek.pl/artur/Maildir/dovecot.index.cache
) failed: No
such file or directory (in mail-cache.c:28)*

and after this event probably all mailboxes download again all emails from
1.11 to 22.11. They were duplicated in mail clients.
-- 

*Pozdrawiam / Best Regards*
*Piotr Bracha*