Re: Workaround for infinite loop in XCLIENT command bug
> On 24 May 2019, at 12.22, mabi via dovecot wrote:
>
> ‐‐‐ Original Message ‐‐‐
> On Friday, May 24, 2019 10:40 AM, Aki Tuomi via dovecot
> wrote:
>
>> Try setting login_trusted_networks=
>
> Thank you Aki for your answer. Unfortunately on my Dovecot mailbox backend
> servers I already have login_trusted_networks set to the IP of my Dovecot
> LMTP proxy server.
just add:
protocol lmtp {
login_trusted_networks=
}
Sami
SIGABRT on fetching mail
Hello, I'm running dovecot with getmail for several months already, but today it's always crashing: "getmailrc: operation error (child pid 2995 killed by signal 6)". The deliver process aborts due to an unknown reason. > tail /var/log/dovecot-info.log May 24 12:10:28 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=2970, secured, session= May 24 12:10:49 lda(peter.nabbef...@gmx.de)<2994>: Info: sieve: msgid=<318d121b-37fc-4e8c-b4b8-93c87e069...@gmx.de>: stored mail into mailbox 'Gesendet' May 24 15:14:30 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=6304, secured, session=<+Rae+qGJ4IUB> May 24 15:14:31 imap(peter.nabbef...@gmx.de)<6304><+Rae+qGJ4IUB>: Info: Connection closed (append finished 0.562 secs ago) in=157758 out=520 deleted=0 expunged=0 trashed=0 hdr_count=0 hdr_bytes=0 body_count=0 body_bytes=0 May 24 15:14:37 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=6307, secured, session= May 24 15:55:28 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=7205, secured, session= May 24 15:57:00 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=7254, secured, session= May 24 16:08:22 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=7507, secured, session= May 24 16:16:40 imap(peter.nabbef...@gmx.de)<6307>: Info: Connection closed (IDLE running for 0.001 + waiting input for 0.001 secs, 2 B in + 10 B out, state=wait-input) in=4251 out=137885 deleted=0 expunged=0 trashed=0 hdr_count=1 hdr_bytes=661 body_count=0 body_bytes=0 May 24 16:16:54 imap-login: Info: Login: user=, method=PLAIN, rip=::1, lip=::1, mpid=7662, secured, session= > tail /var/log/dovecot.log May 24 11:25:33 master: Warning: Killed with signal 15 (by pid=12275 uid=0 code=kill) May 24 11:25:35 log(660): Warning: Killed with signal 15 (by pid=1 uid=0 code=kill) May 24 12:10:47 lda(peter.nabbef...@gmx.de)<2994>: Warning: Failed to parse return-path header May 24 12:10:50 lda(peter.nabbef...@gmx.de)<2995>: Panic: file istream-crlf.c: line 24 (i_stream_crlf_read_common): assertion failed: (ret != -2) May 24 12:10:50 lda(peter.nabbef...@gmx.de)<2995>: Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xeee14) [0x7fd668defe14] -> /usr/lib/dovecot/libdovecot.so.0(+0xeee51) [0x7fd668defe51] -> /usr/lib/dovecot/libdovecot.so.0(+0x46268) [0x7fd668d47268] -> /usr/lib/dovecot/libdovecot.so.0(+0x4892e) [0x7fd668d4992e] -> /usr/lib/dovecot/libdovecot.so.0(+0x1004e6) [0x7fd668e014e6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7fd668dfd681] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7fd668dfd8a6] -> /usr/lib/dovecot/libdovecot.so.0(+0x1058f8) [0x7fd668e068f8] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x81) [0x7fd668dfd681] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x36) [0x7fd668dfd8a6] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4c) [0x7fd668dfe33c] -> /usr/lib/dovecot/libdovecot.so.0(io_stream_copy+0x8a) [0x7fd668e18aba] -> /usr/lib/dovecot/libdovecot.so.0(+0x119ac2) [0x7fd668e1aac2] -> /usr/lib/dovecot/libdovecot.so.0(o_stream_send_istream+0x4f) [0x7fd668e1874f] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_save_continue+0x2e) [0x7fd668f981ee] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_save_continue+0x27) [0x7fd668f36887] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_save_continue+0x44) [0x7fd668f083f4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_storage_copy+0xf8) [0x7fd668ef9828] -> /usr/lib/dovecot/libdovecot-storage.so.0(maildir_copy+0x59) [0x7fd668f32639] -> /usr/lib/dovecot/libdovecot-lda.so.0(+0x3d5c) [0x7fd66902ad5c] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x10eec) [0x7fd668a90eec] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0x58981) [0x7fd668f08981] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x4e6df) [0x7fd66676e6df] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_result_execute+0x4e5) [0x7fd666764065] -> /usr/lib/dovecot/libdovecot-sieve.so.0(+0x57259) [0x7fd666777259] -> /usr/lib/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0xa2) [0x7fd6667783f2] -> /usr/lib/dovecot/modules/lib90_sieve_plugin.so(+0x3d45) [0x7fd668cecd45] -> /usr/lib/dovecot/libdovecot-lda.so.0(mail_deliver+0xf9) [0x7fd66902c229] How can I find out which message is causing the crash? It would be very helpful, if the message's subject and receipt time could be logged in case of an abort or anything else that could help identify the corrupt message. This would also enable me to send You the message for further investigation (if appropriate). Kind regards Peter
Re: [ext] Re: Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
* Aki Tuomi via dovecot : > Known issue when folder cache is too big. Try rm -rf dovecot.index.cache > for the folder. -rw--- 1 mail mail 1746959712 May 24 14:37 dovecot.index.cache yes, it is quite big :) 1.746.959.712 -- Ralf Hildebrandt Geschäftsbereich IT | Abteilung Netzwerk Charité - Universitätsmedizin Berlin Campus Benjamin Franklin Hindenburgdamm 30 | D-12203 Berlin Tel. +49 30 450 570 155 | Fax: +49 30 450 570 962 ralf.hildebra...@charite.de | https://www.charite.de
Re: Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
Known issue when folder cache is too big. Try rm -rf dovecot.index.cache for the folder. Aki On 24.5.2019 13.37, Ralf Hildebrandt via dovecot wrote: > I'm encountering a crash which this command: > > % doveadm import -u restore@backup.invalid mdbox:/home/copymail2/mdbox '' > mailbox INBOX header X-Spam Yes SAVEDBEFORE 2019-05-23 > > doveadm(restore@backup.invalid): Panic: file mail-index-util.c: line 10 > (mail_index_uint32_to_offset): assertion failed: (offset < 0x4000) > doveadm(restore@backup.invalid): Error: Raw backtrace: > /usr/lib/dovecot/libdovecot.so.0(+0xd9f9e) [0x7fbc52ba7f9e] -> > /usr/lib/dovecot/libdovecot.so.0(+0xd9fe1) [0x7fbc52ba7fe1] -> > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbc52b0cc54] -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78)[0x7fbc52f525e8] > -> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b)[0x7fbc52f3ac2b] > -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449)[0x7fbc52f1c969] > -> > /usr/lib/dovecot/libdovecot.so.0(+0xb6af9) [0x7fbc52b84af9] -> > /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a) [0x7fbc52bb531a] > -> > /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7fbc52bb565f] -> > /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d)[0x7fbc52bb604d] -> > /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68)[0x7fbc52b8b3f8] > -> > /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52)[0x7fbc52b8bdd2] -> > /usr/lib/dovecot/libdovecot-storage.so.0(+0xcadae) [0x7fbc52f26dae] -> > /usr/lib/dovecot/libdovecot-storage.so.0(+0xcc0ac) [0x7fbc52f280ac] -> > /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d)[0x7fbc52f288bd] > -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28)[0x7fbc52ea92e8] > -> > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d)[0x7fbc52ea934d] > -> > doveadm(+0x31443) [0x5635b4760443] -> > doveadm(+0x2bdb1) [0x5635b475adb1] -> > doveadm(+0x2caf9) [0x5635b475baf9] -> > doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x5635b475c9ce] -> > doveadm(doveadm_cmd_run_ver2+0x55e) [0x5635b476db7e] -> > doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5635b476dbd7] -> > doveadm(main+0x1d1) [0x5635b474aec1] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) > [0x7fbc5210fb97] -> doveadm(_start+0x2a) [0x5635b474b39a] > > > Version info: > > ii dovecot-core 2:2.3.6-2~bionic amd64secure POP3/IMAP server > - core files > ii dovecot-dbg 2:2.3.6-2~bionic amd64secure POP3/IMAP server > - debug symbols > ii dovecot-imapd 2:2.3.6-2~bionic amd64secure POP3/IMAP server > - IMAP daemon > ii dovecot-lmtpd 2:2.3.6-2~bionic amd64secure POP3/IMAP server > - LMTP server > > Backtrace: > > Program received signal SIGABRT, Aborted. > __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 > 51../sysdeps/unix/sysv/linux/raise.c: No such file or directory. > (gdb) bt > #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 > #1 0x768fa801 in __GI_abort () at abort.c:79 > #2 0x77373f51 in default_fatal_finish (status=0, > type=LOG_TYPE_PANIC) at failures.c:459 > #3 fatal_handler_real (ctx=, format=, > args=) at failures.c:471 > #4 0x77373fe1 in default_fatal_handler (ctx=, > format=, args=) at failures.c:479 > #5 0x772d8c54 in i_panic (format=format@entry=0x7772e440 "file > %s: line %d (%s): assertion failed: (%s)") at failures.c:523 > #6 0x7771e5e8 in mail_index_uint32_to_offset (offset= out>) at mail-index-util.c:10 > #7 0x77706c2b in mail_cache_header_fields_write (ctx=0x5583d960, > buffer=, buffer=) at > mail-cache-transaction.c:609 > #8 mail_cache_header_add_field (field_idx=15, ctx=0x5583d960) at > mail-cache-transaction.c:690 > #9 mail_cache_add (ctx=0x5583d960, seq=1, field_idx=field_idx@entry=15, > data=0x7773ba56, data_size=0) at mail-cache-transaction.c:739 > #10 0x776eafdc in index_mail_cache_add_idx > (mail=mail@entry=0x5583e2f8, field_idx=field_idx@entry=15, > data=data@entry=0x7773ba56, data_size=data_size@entry=0) at > index-mail.c:621 > #11 0x776e8969 in index_mail_parse_header_finish (mail= out>) at index-mail-headers.c:132 > #12 index_mail_parse_header (part=, hdr=, > mail=) at index-mail-headers.c:312 > #13 0x77350af9 in read_header (mstream=0x5584b7f0) at > istream-header-filter.c:357 > #14 i_stream_header_filter_read (stream=0x5584b7f0) at > istream-header-filter.c:447 > #15 0x7738131a in i_stream_read_memarea > (stream=stream@entry=0x5584b870) at istream.c:313 > #16 0x7738165f in i_stream_read (stream=stream@entry=0x5584b870) > at istream.c:271 > #17 0x7738204d in i_stream_read_data (stream=0x5584b870, > data_r=data_r@entry=0x7fffdbe8, size_r=size_r@entry=0x7fffdbf0, >
Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x40000000)
I'm encountering a crash which this command: % doveadm import -u restore@backup.invalid mdbox:/home/copymail2/mdbox '' mailbox INBOX header X-Spam Yes SAVEDBEFORE 2019-05-23 doveadm(restore@backup.invalid): Panic: file mail-index-util.c: line 10 (mail_index_uint32_to_offset): assertion failed: (offset < 0x4000) doveadm(restore@backup.invalid): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xd9f9e) [0x7fbc52ba7f9e] -> /usr/lib/dovecot/libdovecot.so.0(+0xd9fe1) [0x7fbc52ba7fe1] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7fbc52b0cc54] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_uint32_to_offset+0x78)[0x7fbc52f525e8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_cache_add+0x83b)[0x7fbc52f3ac2b] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_parse_header+0x449)[0x7fbc52f1c969] -> /usr/lib/dovecot/libdovecot.so.0(+0xb6af9) [0x7fbc52b84af9] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_memarea+0x7a) [0x7fbc52bb531a] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x2f) [0x7fbc52bb565f] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x3d)[0x7fbc52bb604d] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header_next+0x68)[0x7fbc52b8b3f8] -> /usr/lib/dovecot/libdovecot.so.0(message_parse_header+0x52)[0x7fbc52b8bdd2] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcadae) [0x7fbc52f26dae] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcc0ac) [0x7fbc52f280ac] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x11d)[0x7fbc52f288bd] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28)[0x7fbc52ea92e8] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next+0x3d)[0x7fbc52ea934d] -> doveadm(+0x31443) [0x5635b4760443] -> doveadm(+0x2bdb1) [0x5635b475adb1] -> doveadm(+0x2caf9) [0x5635b475baf9] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x20e) [0x5635b475c9ce] -> doveadm(doveadm_cmd_run_ver2+0x55e) [0x5635b476db7e] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5635b476dbd7] -> doveadm(main+0x1d1) [0x5635b474aec1] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fbc5210fb97] -> doveadm(_start+0x2a) [0x5635b474b39a] Version info: ii dovecot-core 2:2.3.6-2~bionic amd64secure POP3/IMAP server - core files ii dovecot-dbg 2:2.3.6-2~bionic amd64secure POP3/IMAP server - debug symbols ii dovecot-imapd 2:2.3.6-2~bionic amd64secure POP3/IMAP server - IMAP daemon ii dovecot-lmtpd 2:2.3.6-2~bionic amd64secure POP3/IMAP server - LMTP server Backtrace: Program received signal SIGABRT, Aborted. __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 51../sysdeps/unix/sysv/linux/raise.c: No such file or directory. (gdb) bt #0 __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51 #1 0x768fa801 in __GI_abort () at abort.c:79 #2 0x77373f51 in default_fatal_finish (status=0, type=LOG_TYPE_PANIC) at failures.c:459 #3 fatal_handler_real (ctx=, format=, args=) at failures.c:471 #4 0x77373fe1 in default_fatal_handler (ctx=, format=, args=) at failures.c:479 #5 0x772d8c54 in i_panic (format=format@entry=0x7772e440 "file %s: line %d (%s): assertion failed: (%s)") at failures.c:523 #6 0x7771e5e8 in mail_index_uint32_to_offset (offset=) at mail-index-util.c:10 #7 0x77706c2b in mail_cache_header_fields_write (ctx=0x5583d960, buffer=, buffer=) at mail-cache-transaction.c:609 #8 mail_cache_header_add_field (field_idx=15, ctx=0x5583d960) at mail-cache-transaction.c:690 #9 mail_cache_add (ctx=0x5583d960, seq=1, field_idx=field_idx@entry=15, data=0x7773ba56, data_size=0) at mail-cache-transaction.c:739 #10 0x776eafdc in index_mail_cache_add_idx (mail=mail@entry=0x5583e2f8, field_idx=field_idx@entry=15, data=data@entry=0x7773ba56, data_size=data_size@entry=0) at index-mail.c:621 #11 0x776e8969 in index_mail_parse_header_finish (mail=) at index-mail-headers.c:132 #12 index_mail_parse_header (part=, hdr=, mail=) at index-mail-headers.c:312 #13 0x77350af9 in read_header (mstream=0x5584b7f0) at istream-header-filter.c:357 #14 i_stream_header_filter_read (stream=0x5584b7f0) at istream-header-filter.c:447 #15 0x7738131a in i_stream_read_memarea (stream=stream@entry=0x5584b870) at istream.c:313 #16 0x7738165f in i_stream_read (stream=stream@entry=0x5584b870) at istream.c:271 #17 0x7738204d in i_stream_read_data (stream=0x5584b870, data_r=data_r@entry=0x7fffdbe8, size_r=size_r@entry=0x7fffdbf0, threshold=threshold@entry=1) at istream.c:745 #18 0x773573f8 in i_stream_read_bytes (wanted=2, size_r=0x7fffdbf0, data_r=0x7fffdbe8, stream=) at ../../src/lib/istream.h:217 #19 message_parse_header_next (ctx=0x5584ca70, hdr_r=hdr_r@entry=0x7fffdc50) at message-header-parser.c:85 #20 0x77357dd2 in message_parse_header
Re: Workaround for infinite loop in XCLIENT command bug
‐‐‐ Original Message ‐‐‐ On Friday, May 24, 2019 11:23 AM, Aki Tuomi wrote: > There is no maintainer for this package in OpenBSD? Not really, well AFAIK packages for OpenBSD are updated every 6 months with the new release of OpenBSD which is always around May and November. Exceptions are security related issues. There is more details here: https://www.openbsd.org/faq/faq15.html
Re: Workaround for infinite loop in XCLIENT command bug
On 24.5.2019 12.22, mabi via dovecot wrote: > ‐‐‐ Original Message ‐‐‐ > On Friday, May 24, 2019 10:40 AM, Aki Tuomi via dovecot > wrote: > >> Try setting login_trusted_networks= > Thank you Aki for your answer. Unfortunately on my Dovecot mailbox backend > servers I already have login_trusted_networks set to the IP of my Dovecot > LMTP proxy server. > >> or just upgrade to 2.3.6? > I was hoping not to have to compile and install manually 2.3.6 on OpenBSD > 6.5, that's why I was first looking for a more simple workaround... > There is no maintainer for this package in OpenBSD? Aki
Re: Workaround for infinite loop in XCLIENT command bug
‐‐‐ Original Message ‐‐‐ On Friday, May 24, 2019 10:40 AM, Aki Tuomi via dovecot wrote: > Try setting login_trusted_networks= Thank you Aki for your answer. Unfortunately on my Dovecot mailbox backend servers I already have login_trusted_networks set to the IP of my Dovecot LMTP proxy server. > or just upgrade to 2.3.6? I was hoping not to have to compile and install manually 2.3.6 on OpenBSD 6.5, that's why I was first looking for a more simple workaround...
Re: Workaround for infinite loop in XCLIENT command bug
> On 24 May 2019 10:52 mabi via dovecot wrote: > > > Hello, > > I am running Dovecot 2.3.5 package on OpenBSD 6.5 and it looks like this bug > which has been fixed in 2.3.6 is hitting me: > > lib-smtp: client: Fix infinite loop in XCLIENT command interaction with server > https://github.com/dovecot/core/commit/5d03f39b345127b80d145ee90772739baa7ab810 > > so I was wondering if there is any workarounds? Maybe like disabling the > XCLIENT command from the config file or something similar? > > My original post regarding this issue is here: > > https://www.mail-archive.com/misc@opensmtpd.org/msg04362.html > > I first thought this was an OpenSMTPD issue but it seems to be that Dovecot > bug. > > Cheers, > Mabi Try setting login_trusted_networks= or just upgrade to 2.3.6? Aki
Workaround for infinite loop in XCLIENT command bug
Hello, I am running Dovecot 2.3.5 package on OpenBSD 6.5 and it looks like this bug which has been fixed in 2.3.6 is hitting me: lib-smtp: client: Fix infinite loop in XCLIENT command interaction with server https://github.com/dovecot/core/commit/5d03f39b345127b80d145ee90772739baa7ab810 so I was wondering if there is any workarounds? Maybe like disabling the XCLIENT command from the config file or something similar? My original post regarding this issue is here: https://www.mail-archive.com/misc@opensmtpd.org/msg04362.html I first thought this was an OpenSMTPD issue but it seems to be that Dovecot bug. Cheers, Mabi
