Re: LMTP crashing heavily for my 2.2.36 installation (and now with 2.3.2.1)
Hi, I will try to create a coredump later but now I see version 2.3.2.1 also crashing in LMTP :-( 2018-07-12T10:09:57.336062+02:00 saruman dovecot: lmtp(an007498)<11814>: Fatal: master: service(lmtp): child 11814 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) 2018-07-12T10:09:57.382925+02:00 saruman dovecot: lmtp(an007498)<11819>: Panic: file imap-bodystructure.c: line 116 (part_write_body_multipart): assertion failed: (part->data != NULL) 2018-07-12T10:09:57.383835+02:00 saruman dovecot: lmtp(an007498)<11819>: Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xc9e06) [0x7ff42cac0e06] -> /usr/lib64/dovecot/libdovecot.so.0(+0xc9ebe) [0x7ff42cac0ebe] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff42ca35813] -> /usr/lib64/dovecot/libdovecot.so.0(imap_bodystructure_write+0x3b1) [0x7ff42ca95f81] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbd397) [0x7ff42ce2b397] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xc005c) [0x7ff42ce2e05c] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_get_special+0x20d) [0x7ff42ce2e4cd] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_get_special+0xd) [0x7ff42cdb0b6d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff42cdb0f42] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbdd25) [0x7ff42ce2bd25] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xbe10b) [0x7ff42ce2c10b] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_get_parts+0x60) [0x7ff42ce2dcd0] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_get_parts+0x28) [0x7ff42cdb04d8] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x2f11e) [0x7ff4285e611e] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_message_body_get_text+0x38) [0x7ff4285e76a8] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(ext_body_get_part_list+0x47) [0x7ff42861b187] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x648d2) [0x7ff42861b8d2] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x71) [0x7ff4285f8611] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_interpreter_run+0x2b) [0x7ff4285f886b] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x53fb2) [0x7ff42860afb2] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_multiscript_run+0x38) [0x7ff42860bd28] -> /usr/lib64/dovecot/modules/lib90_sieve_plugin.so(+0x3907) [0x7ff428873907] -> /usr/lib64/dovecot/libdovecot-lda.so.0(mail_deliver+0xdc) [0x7ff42d0c41cc] -> dovecot/lmtp(lmtp_local_data+0x6eb) [0x55d90309e95b] -> dovecot/lmtp(cmd_data_continue+0x23d) [0x55d90309d4ed] -> /usr/lib64/dovecot/libdovecot.so.0(+0x507f0) [0x7ff42ca477f0] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x55) [0x7ff42cad7b35] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe7) [0x7ff42cad9307] I'm still on maildir and my current setting about attachments is: mail_attachment_detection_options = add-flags-on-save exclude-inlined Wolfgang
Re: LMTP crashing heavily for my 2.2.36 installation
sorry for the empty mail. GMail UI confused me ;-) I finally did a short term update to 2.3.2.1 and it seems to work (at least no LMTP crashes to be seen). But one other thing: One of my other mailservers is still on 2.2.36 but I could not find any crash in the logs and also no other weird behaviour. While I also use maildir there one difference in configuration is that it's using mail_attachment_detection_options = add-flags-on-save exclude-inlined I also tested with an explicit mail including a file attachment because I was not sure if I received an attachment during log retention time (this server is just serving 5 personal accounts). That's fine for me but I do not totally understand why it works (or at least not crashes). I still have to verify if the flags are correctly applied though. In any case since I performed one upgrade to 2.3.x already I will be able to update the other servers soon anyway. Just wanted to give that feedback/observation. Wolfgang On Thu, Jul 12, 2018 at 6:47 AM, Wolfgang Rosenauer wrote: > > > On Wed, Jul 11, 2018 at 6:03 PM, Aki Tuomi wrote: > >> One alternative is to migrate into sdbox format, in which this is >> supported >> >> >> >> --- >> Aki Tuomi >> Dovecot oy >> >> Original message >> From: Wolfgang Rosenauer >> Date: 11/07/2018 18:14 (GMT+02:00) >> To: Timo Sirainen >> Cc: Dovecot Mailing List >> Subject: Re: LMTP crashing heavily for my 2.2.36 installation >> >> follow up question. >> >> Is there a commit which is reasonable to backport for me into the >> packages or is it too intrusive or based on heavily changed code? >> >> >> Thanks, >> Wolfgang >> >> On Wed, Jul 11, 2018 at 3:32 PM, Wolfgang Rosenauer > > wrote: >> >>> >>> On Wed, Jul 11, 2018 at 10:46 AM, Timo Sirainen wrote: >>> >>>> On 11 Jul 2018, at 8.41, Wolfgang Rosenauer >>>> wrote: >>>> > >>>> > I'm running 2.2.36 (as provided by openSUSE in their server:mail >>>> repository) and at least at one of my systems LMTP is crashing regularly on >>>> certain messages (apparently a lot of them). >>>> > >>>> > Sometimes (but not always a backtrace is posted to the logs: >>>> > >>>> > 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): >>>> Fatal: master: service(lmtp): child 14690 killed with signal 11 (core dumps >>>> disabled) >>>> > 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): >>>> Panic: file imap-bodystructure.c: line 116 (part_write_body_multipart): >>>> assertion failed: (part->data != NULL) >>>> .. >>>> > storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] >>>> >>>> Looks like it's because of the "mail_attachment_detection_options = >>>> add-flags-on-save" setting. What mailbox format do you use? It's currently >>>> broken with mbox and in v2.2.36 with Maildir (which was fixed in v2.3.2). >>>> >>>> I'm indeed using maildir so this is a known issue and yes I use >>> mail_attachment_detection_options=add-flags-on-save (or rather I tried >>> to but now have to disable it). Not sure when I get to upgrade to 2.3.x. >>> >>> >>> Thanks, >>> Wolfgang >>> >> >> >
Re: LMTP crashing heavily for my 2.2.36 installation
On Wed, Jul 11, 2018 at 6:03 PM, Aki Tuomi wrote: > One alternative is to migrate into sdbox format, in which this is supported > > > > --- > Aki Tuomi > Dovecot oy > > Original message > From: Wolfgang Rosenauer > Date: 11/07/2018 18:14 (GMT+02:00) > To: Timo Sirainen > Cc: Dovecot Mailing List > Subject: Re: LMTP crashing heavily for my 2.2.36 installation > > follow up question. > > Is there a commit which is reasonable to backport for me into the packages > or is it too intrusive or based on heavily changed code? > > > Thanks, > Wolfgang > > On Wed, Jul 11, 2018 at 3:32 PM, Wolfgang Rosenauer > wrote: > >> >> On Wed, Jul 11, 2018 at 10:46 AM, Timo Sirainen wrote: >> >>> On 11 Jul 2018, at 8.41, Wolfgang Rosenauer >>> wrote: >>> > >>> > I'm running 2.2.36 (as provided by openSUSE in their server:mail >>> repository) and at least at one of my systems LMTP is crashing regularly on >>> certain messages (apparently a lot of them). >>> > >>> > Sometimes (but not always a backtrace is posted to the logs: >>> > >>> > 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): Fatal: >>> master: service(lmtp): child 14690 killed with signal 11 (core dumps >>> disabled) >>> > 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): >>> Panic: file imap-bodystructure.c: line 116 (part_write_body_multipart): >>> assertion failed: (part->data != NULL) >>> .. >>> > storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] >>> >>> Looks like it's because of the "mail_attachment_detection_options = >>> add-flags-on-save" setting. What mailbox format do you use? It's currently >>> broken with mbox and in v2.2.36 with Maildir (which was fixed in v2.3.2). >>> >>> I'm indeed using maildir so this is a known issue and yes I use >> mail_attachment_detection_options=add-flags-on-save (or rather I tried >> to but now have to disable it). Not sure when I get to upgrade to 2.3.x. >> >> >> Thanks, >> Wolfgang >> > >
Re: LMTP crashing heavily for my 2.2.36 installation
One alternative is to migrate into sdbox format, in which this is supported ---Aki TuomiDovecot oy Original message From: Wolfgang Rosenauer Date: 11/07/2018 18:14 (GMT+02:00) To: Timo Sirainen Cc: Dovecot Mailing List Subject: Re: LMTP crashing heavily for my 2.2.36 installation follow up question. Is there a commit which is reasonable to backport for me into the packages or is it too intrusive or based on heavily changed code? Thanks, Wolfgang On Wed, Jul 11, 2018 at 3:32 PM, Wolfgang Rosenauer wrote: On Wed, Jul 11, 2018 at 10:46 AM, Timo Sirainen wrote: On 11 Jul 2018, at 8.41, Wolfgang Rosenauer wrote: > > I'm running 2.2.36 (as provided by openSUSE in their server:mail repository) > and at least at one of my systems LMTP is crashing regularly on certain > messages (apparently a lot of them). > > Sometimes (but not always a backtrace is posted to the logs: > > 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): Fatal: master: > service(lmtp): child 14690 killed with signal 11 (core dumps disabled) > 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): Panic: file > imap-bodystructure.c: line 116 (part_write_body_multipart): assertion failed: > (part->data != NULL) .. > storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] Looks like it's because of the "mail_attachment_detection_options = add-flags-on-save" setting. What mailbox format do you use? It's currently broken with mbox and in v2.2.36 with Maildir (which was fixed in v2.3.2). I'm indeed using maildir so this is a known issue and yes I use mail_attachment_detection_options=add-flags-on-save (or rather I tried to but now have to disable it). Not sure when I get to upgrade to 2.3.x. Thanks, Wolfgang
Re: LMTP crashing heavily for my 2.2.36 installation
follow up question. Is there a commit which is reasonable to backport for me into the packages or is it too intrusive or based on heavily changed code? Thanks, Wolfgang On Wed, Jul 11, 2018 at 3:32 PM, Wolfgang Rosenauer wrote: > > On Wed, Jul 11, 2018 at 10:46 AM, Timo Sirainen wrote: > >> On 11 Jul 2018, at 8.41, Wolfgang Rosenauer wrote: >> > >> > I'm running 2.2.36 (as provided by openSUSE in their server:mail >> repository) and at least at one of my systems LMTP is crashing regularly on >> certain messages (apparently a lot of them). >> > >> > Sometimes (but not always a backtrace is posted to the logs: >> > >> > 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): Fatal: >> master: service(lmtp): child 14690 killed with signal 11 (core dumps >> disabled) >> > 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): >> Panic: file imap-bodystructure.c: line 116 (part_write_body_multipart): >> assertion failed: (part->data != NULL) >> .. >> > storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] >> >> Looks like it's because of the "mail_attachment_detection_options = >> add-flags-on-save" setting. What mailbox format do you use? It's currently >> broken with mbox and in v2.2.36 with Maildir (which was fixed in v2.3.2). >> >> I'm indeed using maildir so this is a known issue and yes I use > mail_attachment_detection_options=add-flags-on-save (or rather I tried to > but now have to disable it). Not sure when I get to upgrade to 2.3.x. > > > Thanks, > Wolfgang >
Re: LMTP crashing heavily for my 2.2.36 installation
On Wed, Jul 11, 2018 at 10:46 AM, Timo Sirainen wrote: > On 11 Jul 2018, at 8.41, Wolfgang Rosenauer wrote: > > > > I'm running 2.2.36 (as provided by openSUSE in their server:mail > repository) and at least at one of my systems LMTP is crashing regularly on > certain messages (apparently a lot of them). > > > > Sometimes (but not always a backtrace is posted to the logs: > > > > 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): Fatal: > master: service(lmtp): child 14690 killed with signal 11 (core dumps > disabled) > > 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): > Panic: file imap-bodystructure.c: line 116 (part_write_body_multipart): > assertion failed: (part->data != NULL) > .. > > storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] > > Looks like it's because of the "mail_attachment_detection_options = > add-flags-on-save" setting. What mailbox format do you use? It's currently > broken with mbox and in v2.2.36 with Maildir (which was fixed in v2.3.2). > > I'm indeed using maildir so this is a known issue and yes I use mail_attachment_detection_options=add-flags-on-save (or rather I tried to but now have to disable it). Not sure when I get to upgrade to 2.3.x. Thanks, Wolfgang
Re: LMTP crashing heavily for my 2.2.36 installation
On 11 Jul 2018, at 8.41, Wolfgang Rosenauer wrote: > > Hi, > > I'm running 2.2.36 (as provided by openSUSE in their server:mail repository) > and at least at one of my systems LMTP is crashing regularly on certain > messages (apparently a lot of them). > > Sometimes (but not always a backtrace is posted to the logs: > > 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): Fatal: master: > service(lmtp): child 14690 killed with signal 11 (core dumps disabled) > 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): Panic: file > imap-bodystructure.c: line 116 (part_write_body_multipart): assertion failed: > (part->data != NULL) .. > storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] Looks like it's because of the "mail_attachment_detection_options = add-flags-on-save" setting. What mailbox format do you use? It's currently broken with mbox and in v2.2.36 with Maildir (which was fixed in v2.3.2).
Re: LMTP crashing heavily for my 2.2.36 installation
Can you try these instructions to get a backtrace of the crash?https://dovecot.org/bugreport.html ---Aki TuomiDovecot oy Original message From: Wolfgang Rosenauer Date: 11/07/2018 08:41 (GMT+02:00) To: Dovecot Mailing List Subject: LMTP crashing heavily for my 2.2.36 installation Hi, I'm running 2.2.36 (as provided by openSUSE in their server:mail repository) and at least at one of my systems LMTP is crashing regularly on certain messages (apparently a lot of them). Sometimes (but not always a backtrace is posted to the logs: 2018-07-11T07:34:56.741848+02:00 saruman dovecot: lmtp(14690): Fatal: master: service(lmtp): child 14690 killed with signal 11 (core dumps disabled) 2018-07-11T07:34:56.820474+02:00 saruman dovecot: lmtp(an007498): Panic: file imap-bodystructure.c: line 116 (part_write_body_multipart): assertion failed: (p art->data != NULL) 2018-07-11T07:34:56.821410+02:00 saruman dovecot: lmtp(an007498): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(+0xa0eb0) [0x7ff54949ceb0] -> /usr/ lib64/dovecot/libdovecot.so.0(+0xa0f8e) [0x7ff54949cf8e] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7ff549430f46] -> /usr/lib64/dovecot/libdovecot.so .0(imap_bodystructure_write+0x3b1) [0x7ff5494753b1] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb8ff5) [0x7ff5497e9ff5] -> /usr/lib64/dovecot/libdovecot- storage.so.0(+0xbbbdc) [0x7ff5497ecbdc] -> /usr/lib64/dovecot/libdovecot-storage.so.0(index_mail_get_special+0x20d) [0x7ff5497ed05d] -> /usr/lib64/dovecot/lib dovecot-storage.so.0(mail_get_special+0xd) [0x7ff54977325d] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_set_attachment_keywords+0x162) [0x7ff549773662] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb9995) [0x7ff5497ea995] -> /usr/lib64/dovecot/libdovecot-storage.so.0(+0xb9d6b) [0x7ff5497ead6b] -> /usr/lib 64/dovecot/libdovecot-storage.so.0(index_mail_get_parts+0x60) [0x7ff5497ec850] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_get_parts+0x23) [0x7ff549772 cb3] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x2ed1e) [0x7ff544fefd1e] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_message_body_get_text+0x33) [0x7 ff544ff1283] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(ext_body_get_part_list+0x47) [0x7ff545024ec7] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x64612) [ 0x7ff545025612] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(sieve_interpreter_continue+0x6c) [0x7ff545002e4c] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(siev e_interpreter_run+0x2b) [0x7ff54500309b] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(+0x543e2) [0x7ff5450153e2] -> /usr/lib64/dovecot/libdovecot-sieve.so.0(si eve_multiscript_run+0x38) [0x7ff545016018] -> /usr/lib64/dovecot/modules/lib90_sieve_plugin.so(+0x36a7) [0x7ff54527e6a7] -> /usr/lib64/dovecot/libdovecot-lda. so.0(mail_deliver+0xa2) [0x7ff549a81eb2] -> dovecot/lmtp(+0x79ca) [0x5574fc4519ca] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7ff5494b1fd2 ] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xe7) [0x7ff5494b3577] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x3c) [0 x7ff5494b206c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7ff5494b2228] Any idea? thanks, Wolfgang
