To my (admittedly non-programmer's eyes) this does look like it might be related. Hopefully Rainer will weigh in.
Scot Kreienkamp |Senior Systems Engineer | La-Z-Boy Corporate One La-Z-Boy Drive| Monroe, Michigan 48162 | Office: 734-384-6403 | | Mobile: 7349151444 | Email: scot.kreienk...@la-z-boy.com > -----Original Message----- > From: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of Peter > Cullen > Sent: Wednesday, September 19, 2018 1:32 PM > To: rsyslog-users <rsyslog@lists.adiscon.com> > Subject: Re: [rsyslog] Rsyslog crashing repeatedly > > I wonder, could this be the same or related to > https://github.com/rsyslog/rsyslog/issues/3021 ? > > On Wed, Sep 19, 2018 at 1:03 PM, Scot Kreienkamp < > scot.kreienk...@la-z-boy.com> wrote: > > > I'm not using anything like that in my config. I have a bunch of if > > statements that compare values, nothing very complicated. It seems to be > > mostly complaining about imfile. > > > > > > Scot Kreienkamp |Senior Systems Engineer | La-Z-Boy Corporate > > One La-Z-Boy Drive| Monroe, Michigan 48162 | Office: 734-384-6403 | | > > Mobile: 7349151444 | Email: scot.kreienk...@la-z-boy.com > > > -----Original Message----- > > > From: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of > > John > > > Chivian > > > Sent: Wednesday, September 19, 2018 12:58 PM > > > To: rsyslog@lists.adiscon.com > > > Subject: Re: [rsyslog] Rsyslog crashing repeatedly > > > > > > I do not know if it relevant to this issue, but I have experienced an > > > rsyslog crash that I was able to attribute to... > > > > > > set $.mlen = strlen($msg) - 3; > > > set $.pmsg = substring($msg,2,$.mlen); > > > > > > ...when $msg wasn't long enough to support being stripped in that > manner. > > > > > > I would think this should not work, but not crash the application. > > > > > > > > > On 9/19/18 10:52 AM, Scot Kreienkamp wrote: > > > > OK, ran it under valgrind until it crashed, here's the logfile output > > from > > > valgrind: > > > > > > > > > > > > ==32102== Memcheck, a memory error detector > > > > ==32102== Copyright (C) 2002-2012, and GNU GPL'd, by Julian Seward > et > > al. > > > > ==32102== Using Valgrind-3.8.1 and LibVEX; rerun with -h for copyright > > info > > > > ==32102== Command: /sbin/rsyslogd -f /etc/rsyslog.conf > > > > ==32102== Parent PID: 3883 > > > > ==32102== > > > > ==32107== Warning: invalid file descriptor 65536 in syscall close() > > > > ==32102== > > > > ==32102== HEAP SUMMARY: > > > > ==32102== in use at exit: 199,617 bytes in 2,693 blocks > > > > ==32102== total heap usage: 5,889 allocs, 3,196 frees, 479,531 bytes > > > allocated > > > > ==32102== > > > > ==32102== LEAK SUMMARY: > > > > ==32102== definitely lost: 0 bytes in 0 blocks > > > > ==32102== indirectly lost: 0 bytes in 0 blocks > > > > ==32102== possibly lost: 0 bytes in 0 blocks > > > > ==32102== still reachable: 199,617 bytes in 2,693 blocks > > > > ==32102== suppressed: 0 bytes in 0 blocks > > > > ==32102== Rerun with --leak-check=full to see details of leaked > memory > > > > ==32102== > > > > ==32102== For counts of detected and suppressed errors, rerun with: - > v > > > > ==32102== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 40 > > > from 9) > > > > ==32107== Thread 4: > > > > ==32107== Invalid read of size 2 > > > > ==32107== at 0x168982: ratelimitMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x168DFA: ratelimitAddMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x6C3B4A5: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C65B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x64af2d8 is 8 bytes inside a block of size 104 > > free'd > > > > ==32107== at 0x4A06430: free (vg_replace_malloc.c:446) > > > > ==32107== by 0x6C3C641: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== > > > > ==32107== Invalid read of size 4 > > > > ==32107== at 0x168989: ratelimitMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x168DFA: ratelimitAddMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x6C3B4A5: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C65B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x64af2f8 is 40 bytes inside a block of size 104 > > free'd > > > > ==32107== at 0x4A06430: free (vg_replace_malloc.c:446) > > > > ==32107== by 0x6C3C641: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== > > > > ==32107== Invalid read of size 4 > > > > ==32107== at 0x144F57: getMSGLen (in /sbin/rsyslogd) > > > > ==32107== by 0x168BB4: ratelimitMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x168DFA: ratelimitAddMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x6C3B4A5: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C65B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0xe90d178 is 8 bytes inside a block of size 11 > > alloc'd > > > > ==32107== at 0x4A06A2E: malloc (vg_replace_malloc.c:270) > > > > ==32107== by 0x5F0AF41: strdup (in /lib64/libc-2.12.so) > > > > ==32107== by 0x5868797: fjson_object_object_add_ex > > > (json_object.c:456) > > > > ==32107== by 0x146C77: msgAddMultiMetadata (in /sbin/rsyslogd) > > > > ==32107== by 0x6C3B50B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C65B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== > > > > ==32107== Invalid read of size 4 > > > > ==32107== at 0x1497E1: msgDestruct (in /sbin/rsyslogd) > > > > ==32107== by 0x168BD6: ratelimitMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x168DFA: ratelimitAddMsg (in /sbin/rsyslogd) > > > > ==32107== by 0x6C3B4A5: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C65B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0xe90d160 is 16 bytes before a block of size 11 > > alloc'd > > > > ==32107== at 0x4A06A2E: malloc (vg_replace_malloc.c:270) > > > > ==32107== by 0x5F0AF41: strdup (in /lib64/libc-2.12.so) > > > > ==32107== by 0x5868797: fjson_object_object_add_ex > > > (json_object.c:456) > > > > ==32107== by 0x146C77: msgAddMultiMetadata (in /sbin/rsyslogd) > > > > ==32107== by 0x6C3B50B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C65B: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3CB18: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3857C: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C10F: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x6C3C54E: ??? (in /lib64/rsyslog/imfile.so) > > > > ==32107== by 0x170C36: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== > > > > ==32107== Thread 12: > > > > ==32107== Invalid read of size 2 > > > > ==32107== at 0x144F80: getPRIi (in /sbin/rsyslogd) > > > > ==32107== by 0x144FB4: getPRI (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBA8: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14ecce68 is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid read of size 2 > > > > ==32107== at 0x144F8C: getPRIi (in /sbin/rsyslogd) > > > > ==32107== by 0x144FB4: getPRI (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBA8: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14ecce66 is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid read of size 4 > > > > ==32107== at 0x4E3D470: pthread_mutex_lock (in /lib64/libpthread- > > > 2.12.so) > > > > ==32107== by 0x14800F: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14ecce48 is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid read of size 4 > > > > ==32107== at 0x4E3CF73: __pthread_mutex_lock_full (in > > > /lib64/libpthread-2.12.so) > > > > ==32107== by 0x14800F: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14ecce48 is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid read of size 8 > > > > ==32107== at 0x148010: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14ecceb8 is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid write of size 8 > > > > ==32107== at 0x148374: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14ecceb8 is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid read of size 1 > > > > ==32107== at 0x14F510: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x148383: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x14eccf3d is not stack'd, malloc'd or (recently) > > free'd > > > > ==32107== > > > > ==32107== Invalid read of size 1 > > > > ==32107== at 0x14F545: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x148383: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== Address 0x5 is not stack'd, malloc'd or (recently) free'd > > > > ==32107== > > > > ==32107== > > > > ==32107== Process terminating with default action of signal 11 > > (SIGSEGV) > > > > ==32107== Access not within mapped region at address 0x5 > > > > ==32107== at 0x14F545: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x148383: getTimeReported (in /sbin/rsyslogd) > > > > ==32107== by 0x12CBC5: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x17700B: tplToString (in /sbin/rsyslogd) > > > > ==32107== by 0x16EB51: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x16F2AA: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x163793: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x15FEE4: wtiWorker (in /sbin/rsyslogd) > > > > ==32107== by 0x15FB11: ??? (in /sbin/rsyslogd) > > > > ==32107== by 0x4E3BAA0: start_thread (in /lib64/libpthread-2.12.so) > > > > ==32107== by 0x5F72C4C: clone (in /lib64/libc-2.12.so) > > > > ==32107== If you believe this happened as a result of a stack > > > > ==32107== overflow in your program's main thread (unlikely but > > > > ==32107== possible), you can try to increase the size of the > > > > ==32107== main thread stack using the --main-stacksize= flag. > > > > ==32107== The main thread stack size used in this run was 10485760. > > > > ==32107== > > > > ==32107== HEAP SUMMARY: > > > > ==32107== in use at exit: 17,220,952 bytes in 26,819 blocks > > > > ==32107== total heap usage: 19,871,535 allocs, 19,844,716 frees, > > > 3,105,437,638 bytes allocated > > > > ==32107== > > > > ==32107== LEAK SUMMARY: > > > > ==32107== definitely lost: 666 bytes in 3 blocks > > > > ==32107== indirectly lost: 908 bytes in 7 blocks > > > > ==32107== possibly lost: 8,404,737 bytes in 29 blocks > > > > ==32107== still reachable: 8,814,641 bytes in 26,780 blocks > > > > ==32107== suppressed: 0 bytes in 0 blocks > > > > ==32107== Rerun with --leak-check=full to see details of leaked > memory > > > > ==32107== > > > > ==32107== For counts of detected and suppressed errors, rerun with: - > v > > > > ==32107== ERROR SUMMARY: 17502 errors from 12 contexts > (suppressed: > > > 43 from 9) > > > > > > > > > > > > > > > > Scot Kreienkamp |Senior Systems Engineer | La-Z-Boy Corporate > > > > One La-Z-Boy Drive| Monroe, Michigan 48162 | Office: 734-384-6403 | > | > > > Mobile: 7349151444 | Email: scot.kreienk...@la-z-boy.com > > > >> -----Original Message----- > > > >> From: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf > Of > > > >> Rainer Gerhards > > > >> Sent: Wednesday, September 19, 2018 9:53 AM > > > >> To: rsyslog-users <rsyslog@lists.adiscon.com> > > > >> Subject: Re: [rsyslog] Rsyslog crashing repeatedly > > > >> > > > >> Interesting! Version? Installed from? Distro? Can you run it under > > > valgrind? > > > >> > > > >> Rainer > > > >> > > > >> Sent from phone, thus brief. > > > >> > > > >> Scot Kreienkamp <scot.kreienk...@la-z-boy.com> schrieb am Mi., > 19. > > > Sep. > > > >> 2018, 15:47: > > > >> > > > >>> Hi everyone, > > > >>> > > > >>> I'm getting the following errors from dmesg on one of my servers > > where > > > >>> rsyslog is crashing several times per day at random. I have no idea > > how > > > to > > > >>> go about troubleshooting them though. I can't re-create the > > segfaults > > > on > > > >>> demand and it's not a config problem. I did try cleaning everything > > out > > > of > > > >>> the spool directory thinking it might be a corrupted file but it's > > still > > > >>> crashing. Any help in understanding what's going on would be > > > appreciated. > > > >>> > > > >>> traps: in:imfile[17113] general protection ip:7f44fbc01f57 > > > sp:7f44f8758278 > > > >>> error:0 in rsyslogd[7f44fbbc5000+9e000] > > > >>> rs:main Q:Reg[4788]: segfault at 7f780008 ip 00007f78700b3837 sp > > > >>> 00007f785f7fdc48 error 4 in rsyslogd[7f787005b000+9e000] > > > >>> rs:main Q:Reg[29904]: segfault at 7fb20000000a ip 00007fb2a0744837 > sp > > > >>> 00007fb28fffec48 error 4 in rsyslogd[7fb2a06ec000+9e000] > > > >>> rs:main Q:Reg[25467]: segfault at 7fed0000000a ip 00007fed90c43837 > sp > > > >>> 00007fed7fffec48 error 4 in rsyslogd[7fed90beb000+9e000] > > > >>> rs:main Q:Reg[20758]: segfault at 7f540000000a ip 00007f5502081837 > sp > > > >>> 00007f54fdbbdc48 error 4 in rsyslogd[7f5502029000+9e000] > > > >>> traps: in:imfile[2193] general protection ip:7f368f71df57 > > sp:7f368c274278 > > > >>> error:0 in rsyslogd[7f368f6e1000+9e000] > > > >>> rs:main Q:Reg[2712]: segfault at 7f020000000a ip 00007f02a5346837 > sp > > > >>> 00007f02a0e82c48 error 4 in rsyslogd[7f02a52ee000+9e000] > > > >>> rs:main Q:Reg[20098]: segfault at 7fe70008 ip 00007fe77af9b837 sp > > > >>> 00007fe776ad7c48 error 4 in rsyslogd[7fe77af43000+9e000] > > > >>> traps: in:imfile[1617] general protection ip:7f756db6ff57 > > sp:7f756a6c6278 > > > >>> error:0 in rsyslogd[7f756db33000+9e000] > > > >>> rs:main Q:Reg[26659]: segfault at 7fec0000000a ip 00007fece4c40837 > sp > > > >>> 00007fecd3ffec48 error 4 in rsyslogd[7fece4be8000+9e000] > > > >>> rs:main Q:Reg[29470]: segfault at 7fe40008 ip 00007fe4659c7837 sp > > > >>> 00007fe461503c48 error 4 in rsyslogd[7fe46596f000+9e000] > > > >>> rs:main Q:Reg[18733]: segfault at 7f720008 ip 00007f72253f5837 sp > > > >>> 00007f7220f31c48 error 4 in rsyslogd[7f722539d000+9e000] > > > >>> traps: in:imfile[9437] general protection ip:7f56b1a2cf57 > > sp:7f56ae583278 > > > >>> error:0 in rsyslogd[7f56b19f0000+9e000] > > > >>> traps: in:imfile[19045] general protection ip:7fd3bd5bdf57 > > > sp:7fd3ba114278 > > > >>> error:0 in rsyslogd[7fd3bd581000+9e000] > > > >>> rs:fwd-rslog_so[27949]: segfault at 180ca6d8 ip 00007f6a2925dc7f sp > > > >>> 00007f6a0f5fdb10 error 4 in rsyslogd[7f6a29239000+9e000] > > > >>> traps: in:imfile[12569] general protection ip:7f8f0ff85f57 > > sp:7f8f04adc278 > > > >>> error:0 in rsyslogd[7f8f0ff49000+9e000] > > > >>> traps: in:imfile[434] general protection ip:7f19f75daf57 > > sp:7f19efffa278 > > > >>> error:0 in rsyslogd[7f19f759e000+9e000] > > > >>> rs:main Q:Reg[32395]: segfault at 7fd60000000a ip 00007fd6d0970837 > sp > > > >>> 00007fd6bfffec48 error 4 in rsyslogd[7fd6d0918000+9e000] > > > >>> rs:main Q:Reg[30511]: segfault at 7fd20000000a ip 00007fd293518837 > sp > > > >>> 00007fd28b3fcc48 error 4 in rsyslogd[7fd2934c0000+9e000] > > > >>> traps: in:imfile[22900] general protection ip:7fd17fe5af57 > > > sp:7fd17c9b1278 > > > >>> error:0 in rsyslogd[7fd17fe1e000+9e000] > > > >>> rs:main Q:Reg[28304]: segfault at 7f3f0000000a ip 00007f3fc093d837 > sp > > > >>> 00007f3fb7ffec48 error 4 in rsyslogd[7f3fc08e5000+9e000] > > > >>> rs:main Q:Reg[2030]: segfault at 7fab0000000a ip 00007fabb1054837 > sp > > > >>> 00007fabacb90c48 error 4 in rsyslogd[7fabb0ffc000+9e000] > > > >>> rs:main Q:Reg[24618]: segfault at 7fce0008 ip 00007fce40c8f837 sp > > > >>> 00007fce2fffec48 error 4 in rsyslogd[7fce40c37000+9e000] > > > >>> rs:main Q:Reg[16219]: segfault at 7fa50000000a ip 00007fa5d36ca837 > sp > > > >>> 00007fa5cf206c48 error 4 in rsyslogd[7fa5d3672000+9e000] > > > >>> rs:main Q:Reg[7879]: segfault at 7fe80008 ip 00007fe824958837 sp > > > >>> 00007fe81bffec48 error 4 in rsyslogd[7fe824900000+9e000] > > > >>> rs:main Q:Reg[393]: segfault at 7f350000000a ip 00007f35f6890837 sp > > > >>> 00007f35f23ccc48 error 4 in rsyslogd[7f35f6838000+9e000] > > > >>> rs:main Q:Reg[20378]: segfault at 7fb60008 ip 00007fb6745b6837 sp > > > >>> 00007fb663ffec48 error 4 in rsyslogd[7fb67455e000+9e000] > > > >>> rs:main Q:Reg[13972]: segfault at 7f060000000a ip 00007f06c4818837 > sp > > > >>> 00007f06bbffec48 error 4 in rsyslogd[7f06c47c0000+9e000] > > > >>> traps: in:imfile[26105] general protection ip:7fa2efa93f57 > > > sp:7fa2ec5ea278 > > > >>> error:0 in rsyslogd[7fa2efa57000+9e000] > > > >>> rs:main Q:Reg[24709]: segfault at 7fe90000000a ip 00007fe9e4b0f837 > sp > > > >>> 00007fe9e0a4cc48 error 4 in rsyslogd[7fe9e4ab7000+9e000] > > > >>> traps: in:imfile[20097] general protection ip:7f6d13ba0f57 > > > sp:7f6d106f7278 > > > >>> error:0 in rsyslogd[7f6d13b64000+9e000] > > > >>> rs:main Q:Reg[15324]: segfault at 7fd50000000a ip 00007fd5bfd32837 > sp > > > >>> 00007fd5b77fdc48 error 4 in rsyslogd[7fd5bfcda000+9e000] > > > >>> rs:main Q:Reg[6091]: segfault at 7f9f0000000a ip 00007f9fe8968837 sp > > > >>> 00007f9fd7ffec48 error 4 in rsyslogd[7f9fe8910000+9e000] > > > >>> rs:main Q:Reg[9388]: segfault at 7fa30000000a ip 00007fa3b082e837 > sp > > > >>> 00007fa39fffec48 error 4 in rsyslogd[7fa3b07d6000+9e000] > > > >>> traps: in:imfile[3761] general protection ip:7f6a116d6f57 > > > sp:7f6a0e22d278 > > > >>> error:0 in rsyslogd[7f6a1169a000+9e000] > > > >>> traps: in:imfile[6576] general protection ip:7f83fab2ff57 > > sp:7f83f7686278 > > > >>> error:0 in rsyslogd[7f83faaf3000+9e000] > > > >>> rs:main Q:Reg[17824]: segfault at 7f600000000a ip 00007f60c4d8e837 > sp > > > >>> 00007f60b3ffec48 error 4 in rsyslogd[7f60c4d36000+9e000] > > > >>> rs:main Q:Reg[26912]: segfault at 7fa50008 ip 00007fa54ad92837 sp > > > >>> 00007fa5468cec48 error 4 in rsyslogd[7fa54ad3a000+9e000] > > > >>> rs:main Q:Reg[23958]: segfault at 7f830008 ip 00007f8383c6f837 sp > > > >>> 00007f837bbfdc48 error 4 in rsyslogd[7f8383c17000+9e000] > > > >>> rs:main Q:Reg[17899]: segfault at 7f2d00000002 ip 00007f2e0ded2e84 > sp > > > >>> 00007f2e09a0ebb0 error 4 in rsyslogd[7f2e0de7a000+9e000] > > > >>> traps: in:imfile[1482] general protection ip:7ff28d47ef57 > > sp:7ff289fd5278 > > > >>> error:0 in rsyslogd[7ff28d442000+9e000] > > > >>> rs:main Q:Reg[25618]: segfault at 7f740000000a ip 00007f74e8d95837 > sp > > > >>> 00007f74e48d1c48 error 4 in rsyslogd[7f74e8d3d000+9e000] > > > >>> traps: in:imfile[16407] trap stack segment ip:7f47c31b52fb > > > sp:7f47bfd08de0 > > > >>> error:0 in rsyslogd[7f47c3176000+9e000] > > > >>> rs:main Q:Reg[29778]: segfault at 7f610000000a ip 00007f61f2ba0837 > sp > > > >>> 00007f61ee6dcc48 error 4 in rsyslogd[7f61f2b48000+9e000] > > > >>> rs:main Q:Reg[6398]: segfault at 7f5200000002 ip 00007f52d2731e84 > sp > > > >>> 00007f52ce26dbb0 error 4 in rsyslogd[7f52d26d9000+9e000] > > > >>> > > > >>> Scot Kreienkamp | Senior Systems Engineer | La-Z-Boy Corporate > > > >>> One La-Z-Boy Drive | Monroe, Michigan 48162 | * 734-384-6403 | | * > > > >>> 7349151444 | * scot.kreienk...@la-z-boy.com<mailto:%7BE- > mail%7D> > > > >>> www<http://www.la-z-boy.com/>.la-z-boy.com<http://www.la-z- > > > >> boy.com/> | > > > >>> facebook.<https://www.facebook.com/lazboy>com< > > > >>> > > > >> > > > > https://www.facebook.com/lazboy>/<https://www.facebook.com/lazboy>l > > > >> azboy< > > > >>> http://facebook.com/lazboy> | twitter.com/lazboy< > > > >>> https://twitter.com/lazboy> | youtube.com/< > > > >>> https://www.youtube.com/user/lazboy>lazboy< > > > >>> https://www.youtube.com/user/lazboy> > > > >>> > > > >>> [cid:lzbVertical_hres.jpg] > > > >>> > > > >>> > > > >>> > > > >>> This message is intended only for the individual or entity to which > > it is > > > >>> addressed. It may contain privileged, confidential information > > which is > > > >>> exempt from disclosure under applicable laws. If you are not the > > > intended > > > >>> recipient, you are strictly prohibited from disseminating or > > distributing > > > >>> this information (other than to the intended recipient) or copying > > this > > > >>> information. If you have received this communication in error, > > please > > > >>> notify us immediately by e-mail or by telephone at the above > number. > > > >> Thank > > > >>> you. > > > >>> _______________________________________________ > > > >>> rsyslog mailing list > > > >>> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >>> http://www.rsyslog.com/professional-services/ > > > >>> What's up with rsyslog? Follow https://twitter.com/rgerhards > > > >>> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > > myriad > > > >>> of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST > if > > > you > > > >>> DON'T LIKE THAT. > > > >> _______________________________________________ > > > >> rsyslog mailing list > > > >> http://lists.adiscon.net/mailman/listinfo/rsyslog > > > >> http://www.rsyslog.com/professional-services/ > > > >> What's up with rsyslog? Follow https://twitter.com/rgerhards > > > >> NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > > myriad > > > of > > > >> sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if > you > > > >> DON'T LIKE THAT. > > > > This message is intended only for the individual or entity to which it > > is > > > addressed. It may contain privileged, confidential information which is > > > exempt from disclosure under applicable laws. If you are not the > > intended > > > recipient, you are strictly prohibited from disseminating or > > distributing this > > > information (other than to the intended recipient) or copying this > > > information. If you have received this communication in error, please > > notify > > > us immediately by e-mail or by telephone at the above number. Thank > you. > > > > _______________________________________________ > > > > rsyslog mailing list > > > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > > http://www.rsyslog.com/professional-services/ > > > > What's up with rsyslog? Follow https://twitter.com/rgerhards > > > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a > > myriad of > > > sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > > > DON'T LIKE THAT. > > > > > > > > > _______________________________________________ > > > rsyslog mailing list > > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > > http://www.rsyslog.com/professional-services/ > > > What's up with rsyslog? Follow https://twitter.com/rgerhards > > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > > of > > > sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > > > DON'T LIKE THAT. > > > > This message is intended only for the individual or entity to which it is > > addressed. It may contain privileged, confidential information which is > > exempt from disclosure under applicable laws. If you are not the intended > > recipient, you are strictly prohibited from disseminating or distributing > > this information (other than to the intended recipient) or copying this > > information. If you have received this communication in error, please > > notify us immediately by e-mail or by telephone at the above number. > Thank > > you. > > _______________________________________________ > > rsyslog mailing list > > http://lists.adiscon.net/mailman/listinfo/rsyslog > > http://www.rsyslog.com/professional-services/ > > What's up with rsyslog? Follow https://twitter.com/rgerhards > > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad > > of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > > DON'T LIKE THAT. > > > > > > -- > Peter Cullen > Principal Software Engineer > Reservoir Labs > cul...@reservoir.com > Office: (212) 780-0527 x160 > _______________________________________________ > rsyslog mailing list > http://lists.adiscon.net/mailman/listinfo/rsyslog > http://www.rsyslog.com/professional-services/ > What's up with rsyslog? Follow https://twitter.com/rgerhards > NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of > sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you > DON'T LIKE THAT. This message is intended only for the individual or entity to which it is addressed. It may contain privileged, confidential information which is exempt from disclosure under applicable laws. If you are not the intended recipient, you are strictly prohibited from disseminating or distributing this information (other than to the intended recipient) or copying this information. If you have received this communication in error, please notify us immediately by e-mail or by telephone at the above number. Thank you. _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.
