Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV
We can probably get rid of the tempory debug output code, can't we? -Patrick On 22.02.2021 13:17, s...@acts.hu wrote: Hello, thank you for both of your feedbacks. As much as I dislike systemd, it allows you to restart piler-smtp in case it crashes. But hopefully it won't happen in the future after this fix. Also I've merged it to the master branch, and I'll release a bugfix version 1.3.11, and I'll make a deb package. Janos On 2021-02-22 12:11, claudio.schnelldasi...@manrolandgoss.com wrote: Janos, Patrick, thanks for this. I also run piler on Ubuntu 18.04 and ran into the same issue. My 'solution' was to start piler-smtp automatically via monitoring if it goes down :-(. Janos, I wonder if you will provide updated .deb packages for dpkg-installs? Thanks and regards, Claudio -Ursprüngliche Nachricht- Von: Wagner, Patrick Gesendet: Montag, 22. Februar 2021 12:01 An: Piler User Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV Thanks Janos, I'd updated and replaced the piler-smtp binary on 2021-02-16, and while I can see that my monitoring still shows SMTP timeouts on the piler port sometimes between 02:30 and 02:40, no further outright crashes / SIGSEGV occur, so archiving continues without any need to restart the process manually. - Patrick On 15.02.2021 21:49, s...@acts.hu wrote: Hello Patrick, thank you for your feedback. I'd like you to update the smtpsegv branch, and recompile piler-smtp. I've refactored the timeout checks, and pushed the commit to the branch on bitbucket. Janos On 2021-02-15 14:34, Wagner, Patrick wrote: Hello Janos, happened Sa->So this time. Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see below, SIGSEGV follows right after free(session) done. It is also interesting to see that the piler daemon finishes processing a message 2 whole minutes after the smtp process has already segfaulted and and stopped supplying any new messages. Thanks, Patrick Feb 14 02:29:59 hostname piler-smtp[19066]: connected from 192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 02:29:59 hostname piler-smtp[19066]: received: Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6, fsync=1831 Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from 192.168.165.154 on fd=6, slot=0, reason=done (0 active connections) Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname piler[19070]: 1/Q056C70SAJJT9OFH: 400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0, reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>, retention=7350, folder=0, delay=0.0425, status=stored Feb 14 02:30:01 hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp -type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc -l > /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler) CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01 hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1 --rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD (/usr/local/libexec/piler/indexer.main.sh) Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed, discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info (No MTA installed, discarding output) Feb 14 02:30:01 hostname piler: INDEXER INFO: merging to main started Feb 14 02:30:40 hostname piler-smtp[19066]: connected from 192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 02:30:41 hostname piler-smtp[19066]: connected from 192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from 192.168.165.252 on fd=6, slot=0, reason=done (1 active connections) Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from 192.168.165.252 on fd=9, slot=1, reason=done (0 active connections) Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done Feb 14 02:31:44 hostname piler-smtp[19066]: connected from 192.168.165.252:405
Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV
On 2021-02-22 14:19, Wagner, Patrick wrote: We can probably get rid of the tempory debug output code, can't we? Yes. Either remove them for yourself or get the master branch, and recompile, then overwrite the piler-smtp binary. Janos On 22.02.2021 13:17, s...@acts.hu wrote: Hello, thank you for both of your feedbacks. As much as I dislike systemd, it allows you to restart piler-smtp in case it crashes. But hopefully it won't happen in the future after this fix. Also I've merged it to the master branch, and I'll release a bugfix version 1.3.11, and I'll make a deb package. Janos On 2021-02-22 12:11, claudio.schnelldasi...@manrolandgoss.com wrote: Janos, Patrick, thanks for this. I also run piler on Ubuntu 18.04 and ran into the same issue. My 'solution' was to start piler-smtp automatically via monitoring if it goes down :-(. Janos, I wonder if you will provide updated .deb packages for dpkg-installs? Thanks and regards, Claudio -Ursprüngliche Nachricht- Von: Wagner, Patrick Gesendet: Montag, 22. Februar 2021 12:01 An: Piler User Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV Thanks Janos, I'd updated and replaced the piler-smtp binary on 2021-02-16, and while I can see that my monitoring still shows SMTP timeouts on the piler port sometimes between 02:30 and 02:40, no further outright crashes / SIGSEGV occur, so archiving continues without any need to restart the process manually. - Patrick On 15.02.2021 21:49, s...@acts.hu wrote: Hello Patrick, thank you for your feedback. I'd like you to update the smtpsegv branch, and recompile piler-smtp. I've refactored the timeout checks, and pushed the commit to the branch on bitbucket. Janos On 2021-02-15 14:34, Wagner, Patrick wrote: Hello Janos, happened Sa->So this time. Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see below, SIGSEGV follows right after free(session) done. It is also interesting to see that the piler daemon finishes processing a message 2 whole minutes after the smtp process has already segfaulted and and stopped supplying any new messages. Thanks, Patrick Feb 14 02:29:59 hostname piler-smtp[19066]: connected from 192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 02:29:59 hostname piler-smtp[19066]: received: Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6, fsync=1831 Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from 192.168.165.154 on fd=6, slot=0, reason=done (0 active connections) Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname piler[19070]: 1/Q056C70SAJJT9OFH: 400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0, reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>, retention=7350, folder=0, delay=0.0425, status=stored Feb 14 02:30:01 hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp -type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc -l > /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler) CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01 hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1 --rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD (/usr/local/libexec/piler/indexer.main.sh) Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed, discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info (No MTA installed, discarding output) Feb 14 02:30:01 hostname piler: INDEXER INFO: merging to main started Feb 14 02:30:40 hostname piler-smtp[19066]: connected from 192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 02:30:41 hostname piler-smtp[19066]: connected from 192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from 192.168.165.252 on fd=6, slot=0, reason=done (1 active connections) Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from 192.168.165.252 on fd=9, slot=1, reason=done (0 active connections) Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostna
Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV
Hello, thank you for both of your feedbacks. As much as I dislike systemd, it allows you to restart piler-smtp in case it crashes. But hopefully it won't happen in the future after this fix. Also I've merged it to the master branch, and I'll release a bugfix version 1.3.11, and I'll make a deb package. Janos On 2021-02-22 12:11, claudio.schnelldasi...@manrolandgoss.com wrote: Janos, Patrick, thanks for this. I also run piler on Ubuntu 18.04 and ran into the same issue. My 'solution' was to start piler-smtp automatically via monitoring if it goes down :-(. Janos, I wonder if you will provide updated .deb packages for dpkg-installs? Thanks and regards, Claudio -Ursprüngliche Nachricht- Von: Wagner, Patrick Gesendet: Montag, 22. Februar 2021 12:01 An: Piler User Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV Thanks Janos, I'd updated and replaced the piler-smtp binary on 2021-02-16, and while I can see that my monitoring still shows SMTP timeouts on the piler port sometimes between 02:30 and 02:40, no further outright crashes / SIGSEGV occur, so archiving continues without any need to restart the process manually. - Patrick On 15.02.2021 21:49, s...@acts.hu wrote: Hello Patrick, thank you for your feedback. I'd like you to update the smtpsegv branch, and recompile piler-smtp. I've refactored the timeout checks, and pushed the commit to the branch on bitbucket. Janos On 2021-02-15 14:34, Wagner, Patrick wrote: Hello Janos, happened Sa->So this time. Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see below, SIGSEGV follows right after free(session) done. It is also interesting to see that the piler daemon finishes processing a message 2 whole minutes after the smtp process has already segfaulted and and stopped supplying any new messages. Thanks, Patrick Feb 14 02:29:59 hostname piler-smtp[19066]: connected from 192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 02:29:59 hostname piler-smtp[19066]: received: Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6, fsync=1831 Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from 192.168.165.154 on fd=6, slot=0, reason=done (0 active connections) Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname piler[19070]: 1/Q056C70SAJJT9OFH: 400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0, reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>, retention=7350, folder=0, delay=0.0425, status=stored Feb 14 02:30:01 hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp -type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc -l > /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler) CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01 hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1 --rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD (/usr/local/libexec/piler/indexer.main.sh) Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed, discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info (No MTA installed, discarding output) Feb 14 02:30:01 hostname piler: INDEXER INFO: merging to main started Feb 14 02:30:40 hostname piler-smtp[19066]: connected from 192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 02:30:41 hostname piler-smtp[19066]: connected from 192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from 192.168.165.252 on fd=6, slot=0, reason=done (1 active connections) Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from 192.168.165.252 on fd=9, slot=1, reason=done (0 active connections) Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done Feb 14 02:31:44 hostname piler-smtp[19066]: connected from 192.168.165.252:40584 on fd=6 (active connections: 1) Feb 14 02:31:53 hostname piler-smtp[19066]: connected from 192.168.165.252:40586 on fd=9