Rainer - I finally got an output with all of the references in it instead of the ??? markers.
I've posted the debug log here: http://pastebin.com/ZQeapLuh The section in question is at the bottom of the file. (Note this was done on the 7.5.5dev version. Though I'm experiencing the same issue on our instance of 7.4.4 as well. Let me know if you have anything else you would like to see or need. -- James -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Boylan, James Sent: Thursday, October 17, 2013 6:20 AM To: rsyslog-users Subject: Re: [rsyslog] Local Variables Usage Question Rainer - So I've been working on trying to get a better valgrind output for you. One thing I have noticed is they all seem to start by a reference back to a call in libestr. I tried upgrading from libestr 0.1.5 to 0.1.8 just to see if it would make a difference. Unfortunately it didn't. The best I've manager to grab is this: 7870.738873056:dae3700: rainerscript: var '$msg': 'logstats|2|0^Thu Oct 17 06:01:34 2013: [purgemgr]: starting purge' 7870.740340153:dae3700: eval expr 0x4ec0ce0, type 'N[78]' 7870.741601297:dae3700: eval expr 0x4ec0d30, type 'N[78]' 7870.797754955:dae3700: re_extract: regexec return is 1 7870.798557625:dae3700: re_extract: regex: end search, found 0 7870.799312749:dae3700: eval expr 0x4ec0dd0, type 'S[83]' ==27124== Thread 5: ==27124== Invalid read of size 4 ==27124== at 0x4C1B4A8: es_str2cstr (in /usr/lib64/libestr.so.0.0.0) ==27124== by 0x42C5D1: msgSetJSONFromVar (in /sbin/rsyslogd) ==27124== by 0x444EE4: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579b0 is 0 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== ==27124== Invalid read of size 1 ==27124== at 0x4C1B4C0: es_str2cstr (in /usr/lib64/libestr.so.0.0.0) ==27124== by 0x42C5D1: msgSetJSONFromVar (in /sbin/rsyslogd) ==27124== by 0x444EE4: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579b8 is 8 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== ==27124== Invalid read of size 1 ==27124== at 0x4C1B4CE: es_str2cstr (in /usr/lib64/libestr.so.0.0.0) ==27124== by 0x42C5D1: msgSetJSONFromVar (in /sbin/rsyslogd) ==27124== by 0x444EE4: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579ba is 10 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== ==27124== Invalid read of size 4 ==27124== at 0x4C1B5DD: es_str2cstr (in /usr/lib64/libestr.so.0.0.0) ==27124== by 0x42C5D1: msgSetJSONFromVar (in /sbin/rsyslogd) ==27124== by 0x444EE4: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579b0 is 0 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== ==27124== Invalid read of size 1 ==27124== at 0x4A08081: memcpy (mc_replace_strmem.c:628) ==27124== by 0x4C1B5FC: es_str2cstr (in /usr/lib64/libestr.so.0.0.0) ==27124== by 0x42C5D1: msgSetJSONFromVar (in /sbin/rsyslogd) ==27124== by 0x444EE4: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579be is 14 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== ==27124== Invalid read of size 4 ==27124== at 0x4C1B5FD: es_str2cstr (in /usr/lib64/libestr.so.0.0.0) ==27124== by 0x42C5D1: msgSetJSONFromVar (in /sbin/rsyslogd) ==27124== by 0x444EE4: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579b0 is 0 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== ==27124== Invalid free() / delete / delete[] ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x444EEC: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== Address 0x51579b0 is 0 bytes inside a block of size 16 free'd ==27124== at 0x4A0595D: free (vg_replace_malloc.c:366) ==27124== by 0x422C9C: ??? (in /sbin/rsyslogd) ==27124== by 0x423603: cnfexprEval (in /sbin/rsyslogd) ==27124== by 0x444ECB: ??? (in /sbin/rsyslogd) ==27124== by 0x445895: ??? (in /sbin/rsyslogd) ==27124== by 0x40E169: ??? (in /sbin/rsyslogd) ==27124== by 0x44434A: ??? (in /sbin/rsyslogd) ==27124== by 0x43F3C5: wtiWorker (in /sbin/rsyslogd) ==27124== by 0x43EEB1: ??? (in /sbin/rsyslogd) ==27124== by 0x3448007850: start_thread (in /lib64/libpthread-2.12.so) ==27124== by 0x34478E890C: clone (in /lib64/libc-2.12.so) ==27124== 7870.823186251:dae3700: eval expr 0x4ec1000, type 'F[70]' 7870.823359961:dae3700: rainerscript: executing function id 8 -- James -----Original Message----- From: [email protected] [mailto:[email protected]] On Behalf Of Boylan, James Sent: Monday, October 07, 2013 11:24 AM To: rsyslog-users Subject: Re: [rsyslog] Local Variables Usage Question Rainer - I'll see if I can get it to get the output with the details you are after. I don't suppose you have an example of what you are expecting? -- James _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT. _______________________________________________ rsyslog mailing list http://lists.adiscon.net/mailman/listinfo/rsyslog http://www.rsyslog.com/professional-services/ What's up with rsyslog? Follow https://twitter.com/rgerhards NOTE WELL: This is a PUBLIC mailing list, posts are ARCHIVED by a myriad of sites beyond our control. PLEASE UNSUBSCRIBE and DO NOT POST if you DON'T LIKE THAT.

