Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread Wagner, Patrick




We can probably get rid of the tempory debug output code, can't we?

-Patrick

On 22.02.2021 13:17, s...@acts.hu wrote:



Hello,

thank you for both of your feedbacks. As much as I dislike systemd,
it allows you to restart piler-smtp in case it crashes. But hopefully
it won't happen in the future after this fix.

Also I've merged it to the master branch, and I'll release a bugfix
version 1.3.11, and I'll make a deb package.

Janos


On 2021-02-22 12:11, claudio.schnelldasi...@manrolandgoss.com wrote:

Janos, Patrick,

thanks for this. I also run piler on Ubuntu 18.04 and ran into the 
same issue.

My 'solution' was to start piler-smtp automatically via monitoring if
it goes down :-(.

Janos, I wonder if you will provide updated .deb packages for 
dpkg-installs?


Thanks and regards,
Claudio

-Ursprüngliche Nachricht-
Von: Wagner, Patrick 
Gesendet: Montag, 22. Februar 2021 12:01
An: Piler User 
Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV



Thanks Janos,

I'd updated and replaced the piler-smtp binary on 2021-02-16, and
while I can see that my monitoring still shows SMTP timeouts on the
piler port sometimes between 02:30 and 02:40, no further outright
crashes / SIGSEGV occur, so archiving continues without any need to
restart the process manually.


- Patrick

On 15.02.2021 21:49, s...@acts.hu wrote:



Hello Patrick,

thank you for your feedback. I'd like you to update the smtpsegv
branch, and recompile piler-smtp. I've refactored the timeout checks,
and pushed the commit to the branch on bitbucket.

Janos


On 2021-02-15 14:34, Wagner, Patrick wrote:

Hello Janos,


happened Sa->So this time.


Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see
below, SIGSEGV follows right after free(session) done.

It is also interesting to see that the piler daemon finishes
processing a message 2 whole minutes after the smtp process has
already segfaulted and and stopped supplying any new messages.


Thanks, Patrick



Feb 14 02:29:59 hostname piler-smtp[19066]: connected from
192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 02:29:59
hostname piler-smtp[19066]: received:
Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6,
fsync=1831
Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from
192.168.165.154 on fd=6, slot=0, reason=done (0 active connections)
Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname
piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname
piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname
piler[19070]: 1/Q056C70SAJJT9OFH:
400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0,
reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>,
retention=7350, folder=0, delay=0.0425, status=stored Feb 14 02:30:01
hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp
-type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname
CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc -l
> /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler)
CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01
hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1
--rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD
(/usr/local/libexec/piler/indexer.main.sh)
Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed,
discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info
(No MTA installed, discarding output) Feb 14 02:30:01 hostname piler:
INDEXER INFO: merging to main started Feb 14 02:30:40 hostname
piler-smtp[19066]: connected from
192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 02:30:41
hostname piler-smtp[19066]: connected from
192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 02:30:41
hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname
piler-smtp[19066]: disconnected from
192.168.165.252 on fd=9, slot=1, reason=done (0 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
piler-smtp[19066]: free(session) done Feb 14 02:31:44 hostname
piler-smtp[19066]: connected from

AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread claudio.schnelldasilva
Janos, Patrick,

thanks for this. I also run piler on Ubuntu 18.04 and ran into the same issue.
My 'solution' was to start piler-smtp automatically via monitoring if it goes 
down :-(.

Janos, I wonder if you will provide updated .deb packages for dpkg-installs?

Thanks and regards,
Claudio

-Ursprüngliche Nachricht-
Von: Wagner, Patrick 
Gesendet: Montag, 22. Februar 2021 12:01
An: Piler User 
Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV



Thanks Janos,

I'd updated and replaced the piler-smtp binary on 2021-02-16, and while I can 
see that my monitoring still shows SMTP timeouts on the piler port sometimes 
between 02:30 and 02:40, no further outright crashes / SIGSEGV occur, so 
archiving continues without any need to restart the process manually.


- Patrick

On 15.02.2021 21:49, s...@acts.hu wrote:
>
>
> Hello Patrick,
>
> thank you for your feedback. I'd like you to update the smtpsegv
> branch, and recompile piler-smtp. I've refactored the timeout checks,
> and pushed the commit to the branch on bitbucket.
>
> Janos
>
>
> On 2021-02-15 14:34, Wagner, Patrick wrote:
>> Hello Janos,
>>
>>
>> happened Sa->So this time.
>>
>>
>> Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see
>> below, SIGSEGV follows right after free(session) done.
>>
>> It is also interesting to see that the piler daemon finishes
>> processing a message 2 whole minutes after the smtp process has
>> already segfaulted and and stopped supplying any new messages.
>>
>>
>> Thanks, Patrick
>>
>>
>>
>> Feb 14 02:29:59 hostname piler-smtp[19066]: connected from
>> 192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 02:29:59
>> hostname piler-smtp[19066]: received:
>> Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6,
>> fsync=1831
>> Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from
>> 192.168.165.154 on fd=6, slot=0, reason=done (0 active connections)
>> Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb
>> 14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
>> 02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59
>> hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname
>> piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname
>> piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname
>> piler[19070]: 1/Q056C70SAJJT9OFH:
>> 400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0,
>> reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>,
>> retention=7350, folder=0, delay=0.0425, status=stored Feb 14 02:30:01
>> hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp
>> -type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname
>> CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc -l
>> > /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler)
>> CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01
>> hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1
>> --rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD
>> (/usr/local/libexec/piler/indexer.main.sh)
>> Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed,
>> discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info
>> (No MTA installed, discarding output) Feb 14 02:30:01 hostname piler:
>> INDEXER INFO: merging to main started Feb 14 02:30:40 hostname
>> piler-smtp[19066]: connected from
>> 192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 02:30:41
>> hostname piler-smtp[19066]: connected from
>> 192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 02:30:41
>> hostname piler-smtp[19066]: disconnected from
>> 192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
>> Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
>> 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
>> 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
>> hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
>> piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
>> piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname
>> piler-smtp[19066]: disconnected from
>> 192.168.165.252 on fd=9, slot=1, reason=done (0 active connections)
>> Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
>> 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
>> 02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
>> hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
>> piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
>> piler-smtp[19066]: free(session) done Feb 14 02:31:44 hostname
>> piler-smtp[19066]: connected from
>> 192.168.165.252:40584 on fd=6 (active connections: 1) Feb 14 02:31:53
>> hostname piler-smtp[19066]: connected from
>> 192.168.165.252:40586 on fd=9 (active connections: 2) Feb 14 02:31:53
>> hostname piler-smtp[19066]: disconnected from
>> 192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
>> Feb 

Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread Wagner, Patrick




Thanks Janos,

I'd updated and replaced the piler-smtp binary on 2021-02-16, and while 
I can see that my monitoring still shows SMTP timeouts on the piler port 
sometimes between 02:30 and 02:40, no further outright crashes / SIGSEGV 
occur, so archiving continues without any need to restart the process 
manually.



- Patrick

On 15.02.2021 21:49, s...@acts.hu wrote:



Hello Patrick,

thank you for your feedback. I'd like you to update the smtpsegv branch,
and recompile piler-smtp. I've refactored the timeout checks, and pushed
the commit to the branch on bitbucket.

Janos


On 2021-02-15 14:34, Wagner, Patrick wrote:

Hello Janos,


happened Sa->So this time.


Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see
below, SIGSEGV follows right after free(session) done.

It is also interesting to see that the piler daemon finishes
processing a message 2 whole minutes after the smtp process has
already segfaulted and and stopped supplying any new messages.


Thanks, Patrick



Feb 14 02:29:59 hostname piler-smtp[19066]: connected from
192.168.165.154:9501 on fd=6 (active connections: 1)
Feb 14 02:29:59 hostname piler-smtp[19066]: received:
Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6,
fsync=1831
Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from
192.168.165.154 on fd=6, slot=0, reason=done (0 active connections)
Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session()
Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown()
Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_free()
Feb 14 02:29:59 hostname piler-smtp[19066]: SSL_CTX_free
Feb 14 02:29:59 hostname piler-smtp[19066]: freeing session
Feb 14 02:29:59 hostname piler-smtp[19066]: free(session) done
Feb 14 02:30:00 hostname piler[19070]: 1/Q056C70SAJJT9OFH:
400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0,
reference=, message-id=<4DdV5z0DlSz
5vfP@mailrelay.intern>, retention=7350, folder=0, delay=0.0425, 
status=stored

Feb 14 02:30:01 hostname CRON[7835]: (piler) CMD (/usr/bin/find
/var/www/piler/tmp -type f -name i.\* -exec rm -f {} \;)
Feb 14 02:30:01 hostname CRON[7836]: (piler) CMD (/usr/bin/find
/var/piler/error -type f|wc -l > /var/piler/stat/error)
Feb 14 02:30:01 hostname CRON[7842]: (piler) CMD (/usr/bin/indexer
--quiet note1 --rotate)
Feb 14 02:30:01 hostname CRON[7837]: (piler) CMD (/usr/bin/indexer
--quiet tag1 --rotate)
Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD
(/usr/local/libexec/piler/indexer.main.sh)
Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed,
discarding output)
Feb 14 02:30:01 hostname CRON[7832]: (CRON) info (No MTA installed,
discarding output)
Feb 14 02:30:01 hostname piler: INDEXER INFO: merging to main started
Feb 14 02:30:40 hostname piler-smtp[19066]: connected from
192.168.165.252:37934 on fd=6 (active connections: 1)
Feb 14 02:30:41 hostname piler-smtp[19066]: connected from
192.168.165.252:37936 on fd=9 (active connections: 2)
Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session()
Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown()
Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free()
Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free
Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session
Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done
Feb 14 02:30:41 hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=9, slot=1, reason=done (0 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session()
Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown()
Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_free()
Feb 14 02:30:41 hostname piler-smtp[19066]: SSL_CTX_free
Feb 14 02:30:41 hostname piler-smtp[19066]: freeing session
Feb 14 02:30:41 hostname piler-smtp[19066]: free(session) done
Feb 14 02:31:44 hostname piler-smtp[19066]: connected from
192.168.165.252:40584 on fd=6 (active connections: 1)
Feb 14 02:31:53 hostname piler-smtp[19066]: connected from
192.168.165.252:40586 on fd=9 (active connections: 2)
Feb 14 02:31:53 hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
Feb 14 02:31:53 hostname piler-smtp[19066]: free_smtp_session()
Feb 14 02:31:53 hostname piler-smtp[19066]: SSL_shutdown()
Feb 14 02:31:53 hostname piler-smtp[19066]: SSL_free()
Feb 14 02:31:53 hostname piler-smtp[19066]: SSL_CTX_free
Feb 14 02:31:53 hostname piler-smtp[19066]: freeing session
Feb 14 02:31:53 hostname piler-smtp[19066]: free(session) done
Feb 14 02:31:53 hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=9, slot=1, reason=done (0 active connections)
Feb 14 02:31:53 hostname piler-smtp[19066]: free_smtp_session()
Feb 14 02:31:53 hostname piler-smtp[19066]: SSL_shutdown()
Feb 14 02:31:53 hostname piler-smtp[19066]: SSL_free()
Feb 14 02:31:53 hostname 

Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread sj




On 2021-02-22 14:19, Wagner, Patrick wrote:

We can probably get rid of the tempory debug output code, can't we?


Yes. Either remove them for yourself or get the master branch,
and recompile, then overwrite the piler-smtp binary.

Janos


On 22.02.2021 13:17, s...@acts.hu wrote:



Hello,

thank you for both of your feedbacks. As much as I dislike systemd,
it allows you to restart piler-smtp in case it crashes. But hopefully
it won't happen in the future after this fix.

Also I've merged it to the master branch, and I'll release a bugfix
version 1.3.11, and I'll make a deb package.

Janos


On 2021-02-22 12:11, claudio.schnelldasi...@manrolandgoss.com wrote:

Janos, Patrick,

thanks for this. I also run piler on Ubuntu 18.04 and ran into the 
same issue.

My 'solution' was to start piler-smtp automatically via monitoring if
it goes down :-(.

Janos, I wonder if you will provide updated .deb packages for 
dpkg-installs?


Thanks and regards,
Claudio

-Ursprüngliche Nachricht-
Von: Wagner, Patrick 
Gesendet: Montag, 22. Februar 2021 12:01
An: Piler User 
Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV



Thanks Janos,

I'd updated and replaced the piler-smtp binary on 2021-02-16, and
while I can see that my monitoring still shows SMTP timeouts on the
piler port sometimes between 02:30 and 02:40, no further outright
crashes / SIGSEGV occur, so archiving continues without any need to
restart the process manually.


- Patrick

On 15.02.2021 21:49, s...@acts.hu wrote:



Hello Patrick,

thank you for your feedback. I'd like you to update the smtpsegv
branch, and recompile piler-smtp. I've refactored the timeout 
checks,

and pushed the commit to the branch on bitbucket.

Janos


On 2021-02-15 14:34, Wagner, Patrick wrote:

Hello Janos,


happened Sa->So this time.


Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) 
see

below, SIGSEGV follows right after free(session) done.

It is also interesting to see that the piler daemon finishes
processing a message 2 whole minutes after the smtp process has
already segfaulted and and stopped supplying any new messages.


Thanks, Patrick



Feb 14 02:29:59 hostname piler-smtp[19066]: connected from
192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 
02:29:59

hostname piler-smtp[19066]: received:
Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6,
fsync=1831
Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from
192.168.165.154 on fd=6, slot=0, reason=done (0 active connections)
Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname
piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname
piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname
piler[19070]: 1/Q056C70SAJJT9OFH:
400060287d2205ab9b5400229f77e67a, size=4944/1928, 
attachments=0,

reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>,
retention=7350, folder=0, delay=0.0425, status=stored Feb 14 
02:30:01

hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp
-type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname
CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc 
-l

> /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler)
CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01
hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1
--rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD
(/usr/local/libexec/piler/indexer.main.sh)
Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed,
discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info
(No MTA installed, discarding output) Feb 14 02:30:01 hostname 
piler:

INDEXER INFO: merging to main started Feb 14 02:30:40 hostname
piler-smtp[19066]: connected from
192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 
02:30:41

hostname piler-smtp[19066]: connected from
192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 
02:30:41

hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname
piler-smtp[19066]: disconnected from
192.168.165.252 on fd=9, slot=1, reason=done (0 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 

Re: AW: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV

2021-02-22 Thread sj




Hello,

thank you for both of your feedbacks. As much as I dislike systemd,
it allows you to restart piler-smtp in case it crashes. But hopefully
it won't happen in the future after this fix.

Also I've merged it to the master branch, and I'll release a bugfix
version 1.3.11, and I'll make a deb package.

Janos


On 2021-02-22 12:11, claudio.schnelldasi...@manrolandgoss.com wrote:

Janos, Patrick,

thanks for this. I also run piler on Ubuntu 18.04 and ran into the same 
issue.

My 'solution' was to start piler-smtp automatically via monitoring if
it goes down :-(.

Janos, I wonder if you will provide updated .deb packages for 
dpkg-installs?


Thanks and regards,
Claudio

-Ursprüngliche Nachricht-
Von: Wagner, Patrick 
Gesendet: Montag, 22. Februar 2021 12:01
An: Piler User 
Betreff: Re: Piler 1.35 on Ubuntu 18.04 - piler-smtp SIGSEGV



Thanks Janos,

I'd updated and replaced the piler-smtp binary on 2021-02-16, and
while I can see that my monitoring still shows SMTP timeouts on the
piler port sometimes between 02:30 and 02:40, no further outright
crashes / SIGSEGV occur, so archiving continues without any need to
restart the process manually.


- Patrick

On 15.02.2021 21:49, s...@acts.hu wrote:



Hello Patrick,

thank you for your feedback. I'd like you to update the smtpsegv
branch, and recompile piler-smtp. I've refactored the timeout checks,
and pushed the commit to the branch on bitbucket.

Janos


On 2021-02-15 14:34, Wagner, Patrick wrote:

Hello Janos,


happened Sa->So this time.


Logs (piler-smtp as compiled out of smtpsegv.tar.gz source code) see
below, SIGSEGV follows right after free(session) done.

It is also interesting to see that the piler daemon finishes
processing a message 2 whole minutes after the smtp process has
already segfaulted and and stopped supplying any new messages.


Thanks, Patrick



Feb 14 02:29:59 hostname piler-smtp[19066]: connected from
192.168.165.154:9501 on fd=6 (active connections: 1) Feb 14 02:29:59
hostname piler-smtp[19066]: received:
Q056C70SAJJT9OFH, from=, size=4944, client=192.168.165.154, fd=6,
fsync=1831
Feb 14 02:29:59 hostname piler-smtp[19066]: disconnected from
192.168.165.154 on fd=6, slot=0, reason=done (0 active connections)
Feb 14 02:29:59 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:29:59 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:29:59 hostname piler-smtp[19066]: SSL_free() Feb 14 02:29:59
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:29:59 hostname
piler-smtp[19066]: freeing session Feb 14 02:29:59 hostname
piler-smtp[19066]: free(session) done Feb 14 02:30:00 hostname
piler[19070]: 1/Q056C70SAJJT9OFH:
400060287d2205ab9b5400229f77e67a, size=4944/1928, attachments=0,
reference=, message-id=<4DdV5z0DlSz 5vfP@mailrelay.intern>,
retention=7350, folder=0, delay=0.0425, status=stored Feb 14 02:30:01
hostname CRON[7835]: (piler) CMD (/usr/bin/find /var/www/piler/tmp
-type f -name i.\* -exec rm -f {} \;) Feb 14 02:30:01 hostname
CRON[7836]: (piler) CMD (/usr/bin/find /var/piler/error -type f|wc -l
> /var/piler/stat/error) Feb 14 02:30:01 hostname CRON[7842]: (piler)
CMD (/usr/bin/indexer --quiet note1 --rotate) Feb 14 02:30:01
hostname CRON[7837]: (piler) CMD (/usr/bin/indexer --quiet tag1
--rotate) Feb 14 02:30:01 hostname CRON[7838]: (piler) CMD
(/usr/local/libexec/piler/indexer.main.sh)
Feb 14 02:30:01 hostname CRON[7833]: (CRON) info (No MTA installed,
discarding output) Feb 14 02:30:01 hostname CRON[7832]: (CRON) info
(No MTA installed, discarding output) Feb 14 02:30:01 hostname piler:
INDEXER INFO: merging to main started Feb 14 02:30:40 hostname
piler-smtp[19066]: connected from
192.168.165.252:37934 on fd=6 (active connections: 1) Feb 14 02:30:41
hostname piler-smtp[19066]: connected from
192.168.165.252:37936 on fd=9 (active connections: 2) Feb 14 02:30:41
hostname piler-smtp[19066]: disconnected from
192.168.165.252 on fd=6, slot=0, reason=done (1 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
piler-smtp[19066]: free(session) done Feb 14 02:30:41 hostname
piler-smtp[19066]: disconnected from
192.168.165.252 on fd=9, slot=1, reason=done (0 active connections)
Feb 14 02:30:41 hostname piler-smtp[19066]: free_smtp_session() Feb
14 02:30:41 hostname piler-smtp[19066]: SSL_shutdown() Feb 14
02:30:41 hostname piler-smtp[19066]: SSL_free() Feb 14 02:30:41
hostname piler-smtp[19066]: SSL_CTX_free Feb 14 02:30:41 hostname
piler-smtp[19066]: freeing session Feb 14 02:30:41 hostname
piler-smtp[19066]: free(session) done Feb 14 02:31:44 hostname
piler-smtp[19066]: connected from
192.168.165.252:40584 on fd=6 (active connections: 1) Feb 14 02:31:53
hostname piler-smtp[19066]: connected from
192.168.165.252:40586 on