date:20180105

Re: zlib plugin producing errors on 2.3.0

2018-01-05 Thread Carsten Uppenbrink


On 24.12.2017 15:58, Adam Weinberger wrote:

Hello,

I use the zlib and imap_zlib plugins on FreeBSD. As of 2.3.0, my logs
are producing these errors every so often, but AFAICT the messages
themselves aren't getting corrupted.

Panic: file ostream-zlib.c: line 36 (o_stream_zlib_close): assertion
failed: (zstream->ostream.finished ||
zstream->ostream.ostream.stream_errno != 0)
Fatal: master: service(imap): child 80128 killed with signal 6 (core
not dumped - set service imap { drop_priv_before_exec=yes })
Panic: file ostream-zlib.c: line 36 (o_stream_zlib_close): assertion
failed: (zstream->ostream.finished ||
zstream->ostream.ostream.stream_errno != 0)
Fatal: master: service(imap): child 80266 killed with signal 6 (core
not dumped - set service imap { drop_priv_before_exec=yes })

They always come in pairs like that. Following is my doveconf. Let
me know what else I can provide here. Thanks!


I had this errors in my logs, too.

It happens only to users who using K-9 Mail on Android. They all had a 
setting enabled called "Use compression on network: Mobile, Wi-Fi, 
Other" in "Incoming server settings". I didn't looked for other imap 
clients, because without this setting enabled the errors vanished.


But it is likely that there are other imap clients who try to compress 
the transfer.

No stored mails are corrupted, it is only the connection somehow.

Carsten

Re: TLS problem after upgrading from v2.2 to v2.3

2018-01-05 Thread Goetz Schultz

Hi,

what are your settings?

Mine are below and they work just fine:

ssl_cipher_list =
ECDHE-RSA-AES128-GCM-SHA256:ECDHE-ECDSA-AES128-GCM-SHA256:ECDHE-RSA-AES256-GCM-SHA384:ECDHE-ECDSA-AES256-GCM-SHA384:DHE-RSA-AES128-GCM-SHA256:DHE-DSS-AES128-GCM-SHA256:kEDH+AESGCM:ECDHE-RSA-AES128-SHA256:ECDHE-ECDSA-AES128-SHA256:ECDHE-RSA-AES128-SHA:ECDHE-ECDSA-AES128-SHA:ECDHE-RSA-AES256-SHA384:ECDHE-ECDSA-AES256-SHA384:ECDHE-RSA-AES256-SHA:ECDHE-ECDSA-AES256-SHA:DHE-RSA-AES128-SHA256:DHE-RSA-AES128-SHA:DHE-DSS-AES128-SHA256:DHE-RSA-AES256-SHA256:DHE-DSS-AES256-SHA:DHE-RSA-AES256-SHA:!aNULL:!eNULL:!EXPORT:!DES:!RC4:!3DES:!MD5:!PSK:!SS
Lv2:!SSLv3


Thanks and regards

  Goetz R. Schultz

On 04/01/18 18:56, Jan Vejvalka wrote:
> Hi *,
> 
> The change in default SSL settings between 2.2 and 2.3 cut off a few
> clients; Microsoft-hosted Exchange (?) being one of them:
> 
> Jan  4 11:02:56 kremail dovecot: pop3-login: Disconnected (no auth
> attempts in 0 secs): user=<>, rip=40.101.4.hisip, lip=myip, TLS
> handshaking: SSL_accept() failed: error:1408A0C1:SSL
> routines:SSL3_GET_CLIENT_HELLO:no shared cipher, session=<8SGob/BhTdcoZQS1>
> 
> Explicitly setting ssl_cipher_list to the old defaults helped:
> ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL
> 
> Does someone have an idea what to recommend to the poor user or should
> I accept that I stay with the old defaults ? The guy is cooperative, so
> we can find out which of the !'s in the new defaults actually breaks the
> connection... if you think it's worth.
> 
> Thanks for your help,
> 
> Jan
> 



signature.asc
Description: OpenPGP digital signature

dovecot-2.3.0 'make check' error

2018-01-05 Thread Eric Broch


Hello list,

I've configured dovecot-2.3.0 on CentOS 6 with the following options.

CFLAGS="-O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions 
-fstack-protector --param=ssp-buffer-size=4 -m64 -mtune=generic 
-fno-strict-aliasing"    \

LDFLAGS="-Wl,-z,now -Wl,-z,relro"    \
./configure \
    --docdir=/usr/share/doc/dovecot-2.3.0   \
    --with-lzma    \
    --disable-static   \
    --disable-rpath   \
    --with-nss        \
    --with-shadow   \
    --with-pam \
    --with-gssapi=plugin \
    --with-ldap=plugin    \
    --with-sql=plugin   \
    --with-lua=plugin   \
    --with-pgsql    \
    --with-mysql   \
    --with-sqlite   \
    --with-vpopmail=/etc/libvpopmail   \
    --with-zlib  \
    --with-libcap  \
    --with-libwrap   \
    --with-ssl=openssl    \
    --with-ssldir=/etc/pki/dovecot    \
    --with-solr \
    --with-docs

and compiled with the following:

# make -j2

When I run a 'make check':

# make check

I get the following error:

make[3]: Entering directory 
`/root/dovecot/dovecot-ce-2.3.0/src/lib-compression'

for bin in test-compression; do \
  if ! /bin/sh ../../run-test.sh ../.. ./$bin; then exit 1; fi; \
    done
compression handler gz ... : ok
compression handler bz2 .. : ok
compression handler deflate .. : ok
compression handler xz ... : ok
gz concat  : ok
gz no concat . : ok
gz large header .. : ok
0 / 7 tests failed
==4468== Conditional jump or move depends on uninitialised value(s)
==4468==    at 0x3A6160ACB2: ??? (in /usr/lib64/liblzma.so.0.0.0)
==4468==    by 0x3A6160AEA9: ??? (in /usr/lib64/liblzma.so.0.0.0)
==4468==    by 0x3A61603121: ??? (in /usr/lib64/liblzma.so.0.0.0)
==4468==    by 0x3A616061A0: ??? (in /usr/lib64/liblzma.so.0.0.0)
==4468==    by 0x3A61605212: lzma_easy_encoder (in 
/usr/lib64/liblzma.so.0.0.0)

==4468==    by 0x406ACF: o_stream_create_lzma (ostream-lzma.c:206)
==4468==    by 0x403D89: test_compression_handler (test-compression.c:36)
==4468==    by 0x4040BD: test_compression (test-compression.c:96)
==4468==    by 0x408281: test_run_funcs (test-common.c:244)
==4468==    by 0x4083E0: test_run (test-common.c:315)
==4468==    by 0x40398B: main (test-compression.c:308)
==4468==
Failed to run: ./test-compression
make[3]: *** [check-local] Error 1
make[3]: Leaving directory 
`/root/dovecot/dovecot-ce-2.3.0/src/lib-compression'

make[2]: *** [check-am] Error 2
make[2]: Leaving directory 
`/root/dovecot/dovecot-ce-2.3.0/src/lib-compression'

make[1]: *** [check-recursive] Error 1
make[1]: Leaving directory `/root/dovecot/dovecot-ce-2.3.0/src'
make: *** [check-recursive] Error 1


Has anyone seen the above error and/or, Can anyone give me a reason why 
it's occurring?


--
Eric Broch
White Horse Technical Consulting (WHTC)

Re: zlib plugin producing errors on 2.3.0

2018-01-05 Thread Florian Pritz

On 24.12.2017 15:58, Adam Weinberger wrote:
> Hello,
> 
> I use the zlib and imap_zlib plugins on FreeBSD. As of 2.3.0, my logs
> are producing these errors every so often, but AFAICT the messages
> themselves aren't getting corrupted.
> 
> Panic: file ostream-zlib.c: line 36 (o_stream_zlib_close): assertion failed: 
> (zstream->ostream.finished || zstream->ostream.ostream.stream_errno != 0)
> Fatal: master: service(imap): child 80128 killed with signal 6 (core not 
> dumped - set service imap { drop_priv_before_exec=yes })
> Panic: file ostream-zlib.c: line 36 (o_stream_zlib_close): assertion failed: 
> (zstream->ostream.finished || zstream->ostream.ostream.stream_errno != 0)
> Fatal: master: service(imap): child 80266 killed with signal 6 (core not 
> dumped - set service imap { drop_priv_before_exec=yes })

I'm also seeing these errors, but I actually use gz compression. I'm
running 2.3.0 on Arch Linux. Config and logs are below.

Do you need any more information or can you reproduce this?

Florian


log:

> Jan  5 17:37:38 karif dovecot[28075]: imap(xxx)<29587>: 
> Panic: file ostream-zlib.c: line 36 (o_stream_zlib_close): assertion failed: 
> (zstream->ostream.finished || zstream->ostream.ostream.stream_errno != 0)
> Jan  5 17:37:38 karif dovecot[28075]: imap(xxx)<29587>: 
> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xc4567) 
> [0x7fe8af7be567] -> /usr/lib/dovecot/libdovecot.so.0(+0xc462a) 
> [0x7fe8af7be62a] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7
> fe8af72ddf9] -> /usr/lib/dovecot/modules/lib20_zlib_plugin.so(+0x757b) 
> [0x7fe8ae91a57b] -> /usr/lib/dovecot/libdovecot.so.0(+0xeb686) 
> [0x7fe8af7e5686] -> dovecot/imap(+0x18bcd) [0x56168ab2fbcd] -> 
> dovecot/imap(+0x11755) [0x56168ab28755] -> /usr/lib/dovecot/libdovecot.so.0(
> io_loop_call_io+0x6b) [0x7fe8af7d691b] -> 
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x137) 
> [0x7fe8af7d8247] -> 
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4d) [0x7fe8af7d6a1d] 
> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x39) [0x7fe8af7d6
> c39] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x14) 
> [0x7fe8af7515a4] -> dovecot/imap(main+0x357) [0x56168ab23cc7] -> 
> /usr/lib/libc.so.6(__libc_start_main+0xea) [0x7fe8af362f4a] -> 
> dovecot/imap(_start+0x2a) [0x56168ab23eba]
> Jan  5 17:37:38 karif dovecot[28075]: imap(xxx)<29587>: 
> Fatal: master: service(imap): child 29587 killed with signal 6 (core not 
> dumped)

config:

> # 2.3.0 (c8b89eb): /etc/dovecot/dovecot.conf
> # Pigeonhole version 0.5.0 (d68c23a1)
> # OS: Linux 4.14.6-1-ARCH x86_64 Arch Linux 
> auth_mechanisms = plain login
> auth_username_format = %Ln
> imap_id_log = *
> login_log_format_elements = user=<%u> method=%m rip=%r lip=%l mpid=%e %c %k
> mail_location = mdbox:~/.mdbox
> mail_plugins = " zlib notify mail_log quota"
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope encoded-character 
> vacation subaddress comparator-i;ascii-numeric relational regex imap4flags 
> copy include variables body enotify environment mailbox date index ihave 
> duplicate mime foreverypart extracttext
> mdbox_rotate_size = 20 M
> namespace inbox {
>   hidden = no
>   inbox = yes
>   list = yes
>   location = 
>   mailbox Drafts {
> auto = subscribe
> special_use = \Drafts
>   }
>   mailbox Junk {
> auto = subscribe
> special_use = \Junk
>   }
>   mailbox Sent {
> auto = subscribe
> special_use = \Sent
>   }
>   mailbox Trash {
> auto = subscribe
> special_use = \Trash
>   }
>   prefix = 
>   separator = .
>   type = private
> }
> passdb {
>   driver = pam
> }
> plugin {
>   mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename
>   mail_log_fields = uid box msgid size
>   quota = count:User quota
>   quota_status_nouser = DUNNO
>   quota_status_overquota = 552 5.2.2 Mailbox is full
>   quota_status_success = DUNNO
>   quota_vsizes = yes
>   sieve = ~/.dovecot.sieve
>   sieve_dir = ~/.sieve
>   sieve_global_dir = /etc/dovecot/sieve/global/
>   sieve_global_path = /etc/dovecot/sieve/default.sieve
>   zlib_save = gz
>   zlib_save_level = 9
> }
> protocols = imap pop3 sieve lmtp
> service auth {
>   unix_listener auth-client {
> group = postfix
> mode = 0660
> user = postfix
>   }
>   user = root
> }
> service imap-login {
>   process_limit = 400
>   process_min_avail = 5
> }
> service lmtp {
>   drop_priv_before_exec = yes
>   unix_listener /var/spool/postfix/private/dovecot-lmtp {
> group = postfix
> mode = 0660
> user = postfix
>   }
> }
> service managesieve-login {
>   inet_listener sieve-obsolete {
> port = 2000
>   }
> }
> ssl_cert =  ssl_cipher_list = 
> EDH+CAMELLIA:EDH+aRSA:EECDH+aRSA+AESGCM:EECDH+aRSA+SHA384:EECDH+aRSA+SHA256:EECDH:+CAMELLIA256:+AES256:+CAMELLIA128:+AES128:+SSLv3:!aNULL:!eNULL:!LOW:!3DES:!MD5:!EXP:!PSK:!DSS:!RC4:!SEED:!ECDSA:CAMELLIA256-SHA:AES256-SHA:CAMELLIA128-SHA:AES128-SHA
> ssl_dh =  #

Re: Bug in dovecot 2.3 virtual plugin

2018-01-05 Thread Jakob Schürz


So hello back again!


Am 05.01.2018 um 14:31 schrieb Jakobus Schürz:



Am 05.01.2018 um 10:25 schrieb Aki Tuomi:

This is a different bug, and I suspect it might be caused by virtual
plugin. We'll look into it.

Aki






It was a problem with selfhealing the index...
I deleted all my emails and mailboxes and rebuild the tree of mailboxes 
again with doveadm.
Then i put back email for email from the cur-folders from backup to the 
new-folders in the rebuild mailboxes. From the filename i cut of the 
part with hostname and size and flags.


The archive now is in a separate namespace, because there are really a 
lot of emails in.


Now it works great again (exept one error, i posted before)

Maybe you can find something to improve dovecot in selfhealing broken index.

Thanks for the great work on this server!

jakob

Re: Bug in dovecot 2.3 virtual plugin

2018-01-05 Thread Jakobus Schürz


Good morning!

I did more research on this error.
The virtual mailboxes are working in two other accounts. The big 
difference to my account is, i have a lot (sub)mailboxes (about 430) and 
a lot emails in my account. The other accounts only have a few emails 
and mailboxes (5 or 6 standard, inbox, trash, templates...)


So i moved all my mailboxes to another place  and left there only a few. 
The virtual mailbox is working.

Then i put back some mailboxes, it is working.
Then i put back the next and the next and tried if the virtual mailbox 
is reachable. it was working, and after i put back more then a half of 
my mailboxes, the error occured again.

dovecot says:

Panic: Leaked view for index 
/var/lib/dovecot/db/indexes/Maildir/jakob/TU-Wien/dovecot.index: Opened 
in index-storage.c:336


The missing dovecot.indes file is now another. But it is on every 
error-message the same missing indes-file.


Deleting the according mailbox, it gets another missing index-file. And 
the every error-message stays on the next indes-file...


It looks to me, it'S a question about too many mailboxes, then an 
internal index gets broken and can't rebuild on the every same point 
(mailbox). This is just an idea, but i don't know how dovecot really 
works...


I do not understand, why it worked till yesterday. And why it breaked on 
deleting not used debian-packages... (maybe this is not the reason)


I removed all my virtual mailboxes from config


Am 04.01.2018 um 22:41 schrieb Jakob Schürz:

Hi!

This is very strange...
This error affects only one mailaccount, and it happend not yesterday.
The file

/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index

which hat "Panic: Leaked view for index" does not exist. only
dovecot.index.log and .cache exists in this mailbox. (which is normal
for small mailboxes, i've read). But why is dovecot throwing an error?

And i could find out, this is only, when i try to open a virtual folder.

I switched back to older self-compiled dovecot-versions... but the error
exists also there (but not before the update!!!)

I also deleted all the dovecot.index-files, dovecot.index.log and
dovecot.index.cache-files to let rebuild dovecot the index again... the
error persists.

Is it a misconfiguration?

So i tried to build for the virtual-Mailboxes the Index in memory... the
error persists and dovecot wants to read this index-file.

My virtual folders not working any longer (on this account only!)

For debug purpose i deleted all the emails in this mailbox, the error
dissapered on this folder, but comes back in the next folder.

could this be a problem with ulimit?

greez
jakob

Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:

Hi!

Is this a bug according to the other one?

When i try to open a real or virtual mailbox, i often (not on every
mailbox) get this error-message:

Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>: Panic: Leaked view for index
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
index-storage.c:336
Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>: Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
[0x7f47d5c11942] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
[0x7f47d5be8ec2] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
[0x7f47d5b68c0a] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
[0x7f47d0dd397b] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
[0x7f47d0dd6926] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
[0x7f47d5b6b05d] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
[0x7f47d5b6b117] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
[0x7f47d5be7781] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
-> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
[0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
[0x7f47d5001975] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
[0x7f47d5b6b4b1] ->
/usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
[0x7f47d0dd6a4d] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
[0x7f47d5b6b05d] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
[0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
dovecot/imap [jakob 192.168.0.14

Re: Dovecot 2.3 - using doveadm as non-root?

2018-01-05 Thread Rob Hoelz

On Wed, 3 Jan 2018 13:37:07 -0500
Timo Sirainen  wrote:

> On 3 Jan 2018, at 11.38, Rob Hoelz  wrote:
> > 
> > Hi dovecot developers and users,
> > 
> > I recently upgraded my server running Arch Linux to dovecot 2.3.0,
> > and I noticed some of my cron jobs started issuing me error
> > messages.  These cron jobs run as a non-root user associated with
> > my mail account, and they use doveadm to tidy things up (ex.
> > purging the trash, moving old mail in certain folders into the
> > trash).  The error message is:
> > 
> >> Error: net_connect_unix(/var/run/dovecot/stats-writer) failed:
> >> Permission denied
> > 
> > I assume this is doveadm trying to participate in the new 2.3 stats
> > process, and after reading the code a bit, I can't see way to tell
> > doveadm to not connect to the stats writer.  The socket is owned by
> > root with 600 permissions.
> > 
> > What would be the right way to remedy this?  AFAICT, I could
> > potentially run doveadm as root (which I would prefer to avoid), or
> > I could change the permissions on the stats writer socket, but I
> > would hate to introduce any sort of security vulnerability by doing
> > so.  I currently have a scrappy Perl script that just runs doveadm
> > and filters out the error message (it doesn't seem to affect the
> > behavior of doveadm other than the message), but that feels dirty
> > and I would prefer a cleaner solution.  Any advice?
> 
> I was wondering what to do about this while developing it. I think
> you can disable this by clearing out the socket path:
> 
> doveadm -o stats_writer_socket_path=
> 
> But .. I think the changing the socket permissions is the better
> solution. The new stats process should know about everything that is
> going on in the system, and these doveadm calls are part of that. So
> if they're excluded then the stats aren't exactly correct. The
> stats-writer can't do all that much harm other than messing up the
> statistics or probably crashing stats process by using up all of its
> memory.
> 

Thanks for the advice, Timo - I went ahead and applied the permission change to 
my dovecot config.  On a side note, thanks for dovecot in general - it's a 
great piece of software!

-Rob

TLS problem after upgrading from v2.2 to v2.3

2018-01-05 Thread Jan Vejvalka


Hi *,

The change in default SSL settings between 2.2 and 2.3 cut off a few
clients; Microsoft-hosted Exchange (?) being one of them:

Jan  4 11:02:56 kremail dovecot: pop3-login: Disconnected (no auth 
attempts in 0 secs): user=<>, rip=40.101.4.hisip, lip=myip, TLS 
handshaking: SSL_accept() failed: error:1408A0C1:SSL 
routines:SSL3_GET_CLIENT_HELLO:no shared cipher, session=<8SGob/BhTdcoZQS1>


Explicitly setting ssl_cipher_list to the old defaults helped:
ssl_cipher_list = ALL:!LOW:!SSLv2:!EXP:!aNULL

Does someone have an idea what to recommend to the poor user or should
I accept that I stay with the old defaults ? The guy is cooperative, so
we can find out which of the !'s in the new defaults actually breaks the
connection... if you think it's worth.

Thanks for your help,

Jan

Re: Bug in dovecot 2.3 virtual plugin

2018-01-05 Thread Jakob Schürz




Am 05.01.2018 um 10:25 schrieb Aki Tuomi:

This is a different bug, and I suspect it might be caused by virtual
plugin. We'll look into it.

Aki


Ok!
So the subject for this bug is (now) correct...

I found out, that the count of mailboxes is not the problem. But the 
count of emails!!

So i deletet all my mailboxes an created them new with doveadm.
430 empty mailboxes existed then. No problem with my virtual boxes.
Then i restored my emails mailbox for mailbox from backup.
After each restored mailbox i tested the virtual mailboxes.

It worked with 15482 emails.
Then i restored a larger one.  The total amount of emails was then 
16843, and the virtual mailbox crashed like before.

Then i deleted the emails from the box... all is working.
I added them again, deletet 200, all is working.
deleted all of them again and added them again... so they are again 
16844 (one email arrived in another mailbox), all is working. :-/


Put more and more emails to my mailboxes... checking every time if 
virtual mailboxes are working, so i get a new error:


Jän 05 14:28:18 aldebaran dovecot[17022]: 
imap(jakob)<5117>: Panic: file mail-index.c: line 793 
(mail_index_close): assertion failed: (index->open_count > 0)
Jän 05 14:28:18 aldebaran dovecot[17022]: 
imap(jakob)<5117>: Error: Raw backtrace: 
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f419fecd021] -> 
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f419fecd0ed] -> 
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f419fe3f481] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf39a8) 
[0x7f41a026c9a8] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd92d1) 
[0x7f41a02522d1] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd9363) 
[0x7f41a0252363] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_free+0x9) 
[0x7f41a0243f39] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xd05a4) 
[0x7f41a02495a4] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x19) 
[0x7f41a01c3c99] -> 
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xabdc) [0x7f419b42ebdc] 
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) 
[0x7f419b42ecb9] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) 
[0x7f41a01c3c0a] -> 
/usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xac60) [0x7f419b42ec60] 
-> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xacb9) 
[0x7f419b42ecb9] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a) 
[0x7f41a01c3c0a] -> 
/usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_free+0x13) 
[0x7f41a01c3c93] -> dovecot/imap [jakob 92.60.9.18 
select](imap_client_close_mailbox+0x5b) [0x564c2088205b] -> dovecot/imap 
[jakob 92.60.9.18 select](+0x14f03) [0x564c20879f03] -> dovecot/imap 
[jakob 92.60.9.18 select](cmd_select_full+0xf9) [0x564c2087a129] -> 
dovecot/imap [jakob 92.60.9.18 select](command_exec+0x64) 
[0x564c20881ca4] -> dovecot/imap [jakob 92.60.9.18 select](+0x1b0b2) 
[0x564c208800b2] -> dovecot/imap [jakob 92.60.9.18 select](+0x1b13c) 
[0x564c2088013c] -> dovecot/imap [jakob 92.60.9.18 
select](client_handle_input+0x1a5) [0x564c20880565] -> dovecot/imap 
[jakob 92.60.9.18 select](client_input+0x82) [0x564c20880be2] -> 
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) 
[0x7f419fee4c09] -> 
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109) 
[0x7f419fee64a9] -> 
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52) 
[0x7f419fee4d12] -> 
/usr/local/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f419fee4f28]
Jän 05 14:28:18 aldebaran dovecot[17022]: 
imap(jakob)<5117>: Fatal: master: service(imap): child 
5117 killed with signal 6 (core not dumped)




Do you need some configs and deeper descriptions from me?

I have two namespaces with virtual mailboxes:
The first "Real" is normally hidden. It's not hidden now for debug-purpose.

namespace Real {
  hidden = no
  ignore_on_failure = yes
  list = children
  location = 
virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u

  prefix = Real/
  separator = /
  subscriptions = no
}

namespace Synoptic {
  hidden = no
  ignore_on_failure = yes
  list = children
  location = 
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u

  mailbox INBOX/Archives {
    auto = no
    special_use = \Archive
  }
  mailbox INBOX/Drafts {
    auto = no
    special_use = \Drafts
  }
  mailbox INBOX/Entwürfe {
    auto = no
    special_use = \Drafts
  }
  mailbox INBOX/Junk {
    auto = no
    special_use = \Junk
  }
  mailbox INBOX/Sent {
    auto = no
    special_use = \Sent
  }
  mailbox INBOX/Spam {
    auto = no
    special_use = \Junk
  }
  prefix = Synoptic/
  separator = /
  subscriptions = no
}

The "Real" namespace is to get a first filter for emails for all, the 
last 1, 2 and 3 years:


Here is the virtual-mailbox-definition:

/var/mail/real: # tree
.
├── Alle
│   └── dovecot-virtual
├── dovecot-acl-list
├── dreijahr
│   └── dovecot-virtual

Re: Bug in dovecot 2.3 virtual plugin

2018-01-05 Thread Aki Tuomi

Does it always happen with 2.2 and 2.3? I was not immediately able to
reproduce your problem.

Aki


On 05.01.2018 12:26, Jakobus Schürz wrote:
> Ok!
> So the subject for this bug is correct...
>
> Do you need some configs and deeper descriptions from me?
>
> I have two namespaces with virtual mailboxes:
> The first "Real" is normally hidden. It's not hidden now for
> debug-purpose.
>
> namespace Real {
>   hidden = no
>   ignore_on_failure = yes
>   list = children
>   location =
> virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u
>   prefix = Real/
>   separator = /
>   subscriptions = no
> }
>
> namespace Synoptic {
>   hidden = no
>   ignore_on_failure = yes
>   list = children
>   location =
> virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u
>   mailbox INBOX/Archives {
>     auto = no
>     special_use = \Archive
>   }
>   mailbox INBOX/Drafts {
>     auto = no
>     special_use = \Drafts
>   }
>   mailbox INBOX/Entwürfe {
>     auto = no
>     special_use = \Drafts
>   }
>   mailbox INBOX/Junk {
>     auto = no
>     special_use = \Junk
>   }
>   mailbox INBOX/Sent {
>     auto = no
>     special_use = \Sent
>   }
>   mailbox INBOX/Spam {
>     auto = no
>     special_use = \Junk
>   }
>   prefix = Synoptic/
>   separator = /
>   subscriptions = no
> }
>
> The "Real" namespace is to get a first filter for emails for all, the
> last 1, 2 and 3 years:
>
> Here is the virtual-mailbox-definition:
>
> /var/mail/real: # tree
> .
> ├── Alle
> │   └── dovecot-virtual
> ├── dovecot-acl-list
> ├── dreijahr
> │   └── dovecot-virtual
> ├── einjahr
> │   └── dovecot-virtual
> └── zweijahr
>     └── dovecot-virtual
>
> and the index-files
> /var/lib/dovecot/db/indexes: # tree real/
> real/
> └── jakob
>     ├── Alle
>     │   └── dovecot.index.log
>     ├── dovecot.list.index.log
>     ├── dreijahr
>     │   └── dovecot.index.log
>     ├── einjahr
>     │   └── dovecot.index.log
>     └── zweijahr
>     └── dovecot.index.log
>
>
> /var/mail/real: # cat Alle/dovecot-virtual
> !INBOX
> INBOX/*
> -INBOX/Trash
> -INBOX/Trash/*
> -INBOX/Archives
> -INBOX/Archives/*
> -INBOX/Drafts
> -INBOX/Drafts/*
> -INBOX/Junk
> -INBOX/Junk/*
> -INBOX/SYSTEM
> -INBOX/SYSTEM/*
>  all
>
> /var/mail/real: # cat einjahr/dovecot-virtual
> Real/Alle
>  all younger 31536000
>
> And the namespace Synoptic is the one, i can subscribe. It has as
> Background the "Real"-namespace:
>
> /var/mail/virtual: # tree
> .
> ├── AKTUELL
> │   └── dovecot-virtual
> ├── Archives
> │   └── dovecot-virtual
> ├── dovecot-acl-list
> ├── Drafts
> │   └── dovecot-virtual
> ├── GINBOX
> │   └── dovecot-virtual
> ├── Markierte
> │   └── dovecot-virtual
> ├── Neue
> │   └── dovecot-virtual
> ├── Sent
> │   └── dovecot-virtual
> ├── Trash
> │   └── dovecot-virtual
> ├── Ungelesene
> │   └── dovecot-virtual
> └── WICHTIG
>     └── dovecot-virtual
>
> /var/mail/virtual: # cat AKTUELL/dovecot-virtual
> Real/einjahr
>  inthread refs younger 2592000
>
> /var/mail/virtual: # cat Markierte/dovecot-virtual
> Real/Alle
>  flagged
>
> The error only appears in a Mailbox from one of this two namespaces.
> Every other mailboxes (public, private, shared) are working correct.
> When i try to open a mailbox from one of this two namespaces, the
> error below (Panic: Leaked view for index) is throwen
>
> jakob
>
>
> Am 05.01.2018 um 10:25 schrieb Aki Tuomi:
>> This is a different bug, and I suspect it might be caused by virtual
>> plugin. We'll look into it.
>>
>> Aki
>>
>> On 04.01.2018 23:41, Jakob Schürz wrote:
>>> Hi!
>>>
>>> This is very strange...
>>> This error affects only one mailaccount, and it happend not yesterday.
>>> The file
>>>
>>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>>>
>>> which hat "Panic: Leaked view for index" does not exist. only
>>> dovecot.index.log and .cache exists in this mailbox. (which is normal
>>> for small mailboxes, i've read). But why is dovecot throwing an error?
>>>
>>> And i could find out, this is only, when i try to open a virtual
>>> folder.
>>>
>>> I switched back to older self-compiled dovecot-versions... but the
>>> error
>>> exists also there (but not before the update!!!)
>>>
>>> I also deleted all the dovecot.index-files, dovecot.index.log and
>>> dovecot.index.cache-files to let rebuild dovecot the index again... the
>>> error persists.
>>>
>>> Is it a misconfiguration?
>>>
>>> So i tried to build for the virtual-Mailboxes the Index in memory...
>>> the
>>> error persists and dovecot wants to read this index-file.
>>>
>>> My virtual folders not working any longer (on this account only!)
>>>
>>> For debug purpose i deleted all the emails in this mailbox, the error
>>> dissapered on this folder, but comes back in the next folder.
>>>
>>> could this be a problem with ulimit?
>>>
>>> greez
>>> jakob
>>>
>>> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
 Hi!

 Is this a bug according to the other one?

 When i try to open a real or virtual mailbox, i

Re: Bug in dovecot 2.3 virtual plugin

2018-01-05 Thread Jakobus Schürz


Ok!
So the subject for this bug is correct...

Do you need some configs and deeper descriptions from me?

I have two namespaces with virtual mailboxes:
The first "Real" is normally hidden. It's not hidden now for debug-purpose.

namespace Real {
  hidden = no
  ignore_on_failure = yes
  list = children
  location = 
virtual:/var/mail/real:INDEX=/var/lib/dovecot/db/indexes/real/%u

  prefix = Real/
  separator = /
  subscriptions = no
}

namespace Synoptic {
  hidden = no
  ignore_on_failure = yes
  list = children
  location = 
virtual:/var/mail/virtual:INDEX=/var/lib/dovecot/db/indexes/virtual/%u

  mailbox INBOX/Archives {
auto = no
special_use = \Archive
  }
  mailbox INBOX/Drafts {
auto = no
special_use = \Drafts
  }
  mailbox INBOX/Entwürfe {
auto = no
special_use = \Drafts
  }
  mailbox INBOX/Junk {
auto = no
special_use = \Junk
  }
  mailbox INBOX/Sent {
auto = no
special_use = \Sent
  }
  mailbox INBOX/Spam {
auto = no
special_use = \Junk
  }
  prefix = Synoptic/
  separator = /
  subscriptions = no
}

The "Real" namespace is to get a first filter for emails for all, the 
last 1, 2 and 3 years:


Here is the virtual-mailbox-definition:

/var/mail/real: # tree
.
├── Alle
│   └── dovecot-virtual
├── dovecot-acl-list
├── dreijahr
│   └── dovecot-virtual
├── einjahr
│   └── dovecot-virtual
└── zweijahr
└── dovecot-virtual

and the index-files
/var/lib/dovecot/db/indexes: # tree real/
real/
└── jakob
├── Alle
│   └── dovecot.index.log
├── dovecot.list.index.log
├── dreijahr
│   └── dovecot.index.log
├── einjahr
│   └── dovecot.index.log
└── zweijahr
└── dovecot.index.log


/var/mail/real: # cat Alle/dovecot-virtual
!INBOX
INBOX/*
-INBOX/Trash
-INBOX/Trash/*
-INBOX/Archives
-INBOX/Archives/*
-INBOX/Drafts
-INBOX/Drafts/*
-INBOX/Junk
-INBOX/Junk/*
-INBOX/SYSTEM
-INBOX/SYSTEM/*
 all

/var/mail/real: # cat einjahr/dovecot-virtual
Real/Alle
 all younger 31536000

And the namespace Synoptic is the one, i can subscribe. It has as 
Background the "Real"-namespace:


/var/mail/virtual: # tree
.
├── AKTUELL
│   └── dovecot-virtual
├── Archives
│   └── dovecot-virtual
├── dovecot-acl-list
├── Drafts
│   └── dovecot-virtual
├── GINBOX
│   └── dovecot-virtual
├── Markierte
│   └── dovecot-virtual
├── Neue
│   └── dovecot-virtual
├── Sent
│   └── dovecot-virtual
├── Trash
│   └── dovecot-virtual
├── Ungelesene
│   └── dovecot-virtual
└── WICHTIG
└── dovecot-virtual

/var/mail/virtual: # cat AKTUELL/dovecot-virtual
Real/einjahr
 inthread refs younger 2592000

/var/mail/virtual: # cat Markierte/dovecot-virtual
Real/Alle
 flagged

The error only appears in a Mailbox from one of this two namespaces. 
Every other mailboxes (public, private, shared) are working correct.
When i try to open a mailbox from one of this two namespaces, the error 
below (Panic: Leaked view for index) is throwen


jakob


Am 05.01.2018 um 10:25 schrieb Aki Tuomi:

This is a different bug, and I suspect it might be caused by virtual
plugin. We'll look into it.

Aki

On 04.01.2018 23:41, Jakob Schürz wrote:

Hi!

This is very strange...
This error affects only one mailaccount, and it happend not yesterday.
The file

/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index

which hat "Panic: Leaked view for index" does not exist. only
dovecot.index.log and .cache exists in this mailbox. (which is normal
for small mailboxes, i've read). But why is dovecot throwing an error?

And i could find out, this is only, when i try to open a virtual folder.

I switched back to older self-compiled dovecot-versions... but the error
exists also there (but not before the update!!!)

I also deleted all the dovecot.index-files, dovecot.index.log and
dovecot.index.cache-files to let rebuild dovecot the index again... the
error persists.

Is it a misconfiguration?

So i tried to build for the virtual-Mailboxes the Index in memory... the
error persists and dovecot wants to read this index-file.

My virtual folders not working any longer (on this account only!)

For debug purpose i deleted all the emails in this mailbox, the error
dissapered on this folder, but comes back in the next folder.

could this be a problem with ulimit?

greez
jakob

Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:

Hi!

Is this a bug according to the other one?

When i try to open a real or virtual mailbox, i often (not on every
mailbox) get this error-message:

Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>: Panic: Leaked view for index
/var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
index-storage.c:336
Jän 04 11:03:32 aldebaran dovecot[24534]:
imap(jakob)<24705>: Error: Raw backtrace:
/usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
/usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
/usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
/usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)

Re: Bug in dovecot 2.3 virtual plugin

2018-01-05 Thread Aki Tuomi

This is a different bug, and I suspect it might be caused by virtual
plugin. We'll look into it.

Aki

On 04.01.2018 23:41, Jakob Schürz wrote:
> Hi!
>
> This is very strange...
> This error affects only one mailaccount, and it happend not yesterday.
> The file
>
> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index
>
> which hat "Panic: Leaked view for index" does not exist. only
> dovecot.index.log and .cache exists in this mailbox. (which is normal
> for small mailboxes, i've read). But why is dovecot throwing an error?
>
> And i could find out, this is only, when i try to open a virtual folder.
>
> I switched back to older self-compiled dovecot-versions... but the error
> exists also there (but not before the update!!!)
>
> I also deleted all the dovecot.index-files, dovecot.index.log and
> dovecot.index.cache-files to let rebuild dovecot the index again... the
> error persists.
>
> Is it a misconfiguration?
>
> So i tried to build for the virtual-Mailboxes the Index in memory... the
> error persists and dovecot wants to read this index-file.
>
> My virtual folders not working any longer (on this account only!)
>
> For debug purpose i deleted all the emails in this mailbox, the error
> dissapered on this folder, but comes back in the next folder.
>
> could this be a problem with ulimit?
>
> greez
> jakob
>
> Am 2018-01-04 um 11:07 schrieb Jakobus Schürz:
>> Hi!
>>
>> Is this a bug according to the other one?
>>
>> When i try to open a real or virtual mailbox, i often (not on every
>> mailbox) get this error-message:
>>
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705>: Panic: Leaked view for index
>> /var/lib/dovecot/db/indexes/Maildir/jakob/INBOX/dovecot.index: Opened in
>> index-storage.c:336
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705>: Error: Raw backtrace:
>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc6021) [0x7f47d5872021] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(+0xc60ed) [0x7f47d58720ed] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f47d57e4481] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xf3942)
>> [0x7f47d5c11942] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_mailbox_close+0x72)
>> [0x7f47d5be8ec2] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_close+0x1a)
>> [0x7f47d5b68c0a] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0xa7e0) [0x7f47d0dd37e0]
>> ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_backend_box_open+0x2b)
>> [0x7f47d0dd397b] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x1026)
>> [0x7f47d0dd6926] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>> [0x7f47d5b6b05d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>> [0x7f47d5b6b117] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(index_storage_get_status+0x31)
>> [0x7f47d5be7781] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(+0x9b3d) [0x7f47d0dd2b3d]
>> -> /usr/local/lib/dovecot/libdovecot-storage.so.0(+0xaded1)
>> [0x7f47d5bcbed1] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xe975)
>> [0x7f47d5001975] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_get_status+0x31)
>> [0x7f47d5b6b4b1] ->
>> /usr/local/lib/dovecot/lib20_virtual_plugin.so(virtual_storage_sync_init+0x114d)
>> [0x7f47d0dd6a4d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync_init+0x4d)
>> [0x7f47d5b6b05d] ->
>> /usr/local/lib/dovecot/libdovecot-storage.so.0(mailbox_sync+0x37)
>> [0x7f47d5b6b117] -> dovecot/imap [jakob 192.168.0.14
>> EXAMINE](cmd_select_full+0x171) [0x555d195a91a1] -> dovecot/imap [jakob
>> 192.168.0.14 EXAMINE](command_exec+0x64) [0x555d195b0ca4] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b0b2) [0x555d195af0b2] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](+0x1b13c) [0x555d195af13c] ->
>> dovecot/imap [jakob 192.168.0.14 EXAMINE](client_handle_input+0x1a5)
>> [0x555d195af565] -> dovecot/imap [jakob 192.168.0.14
>> EXAMINE](client_input+0x82) [0x555d195afbe2] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69)
>> [0x7f47d5889bf9] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x109)
>> [0x7f47d588b499] ->
>> /usr/local/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x52)
>> [0x7f47d5889d02]
>> Jän 04 11:03:32 aldebaran dovecot[24534]:
>> imap(jakob)<24705>: Fatal: master: service(imap):
>> child 24705 killed with signal 6 (core dumps disabled)
>>
>> I deinstalled all debian-dovecot-packages and installed the user
>> dovenull manually again. This is all, i did.
>>
>> jakob
>

Re: zlib plugin producing errors on 2.3.0

Re: TLS problem after upgrading from v2.2 to v2.3

dovecot-2.3.0 'make check' error

Re: zlib plugin producing errors on 2.3.0

Re: Bug in dovecot 2.3 virtual plugin

Re: Bug in dovecot 2.3 virtual plugin

Re: Dovecot 2.3 - using doveadm as non-root?

TLS problem after upgrading from v2.2 to v2.3

Re: Bug in dovecot 2.3 virtual plugin

Re: Bug in dovecot 2.3 virtual plugin

Re: Bug in dovecot 2.3 virtual plugin

Re: Bug in dovecot 2.3 virtual plugin

12 matches

Site Navigation

Mail list logo

Footer information