On 02.11.2011 08:32, Rainer Gerhards wrote:
>
> we had a public holiday over here yesterday. Thanks for your analysis, this
same here :)
> sounds very interesting (and probably explains why I haven't seen it so far).
> I need to review the code, it's quite a while since I looked at that place
> the last time, seems it has "worked" for a couple of years. I'll do so later
> today and let you know the findings. We may need to further instrument/try
> out some patches...
so save you some time: for my tests i already instrumented the code, basically
dbgprintf() around
the critical pthread_mutex_* calls.
the problem here is, the debug statements change the timing and make it a lot
harder to get a dead
lock. after a lot of runs i managed to get a dead lock with the instrumented
rsyslogd (patch and
complete log attached). the interesting part:
7592.695797000:2b073f035320: mutLoadUnload locked <- thread A got mutLoadUnload
7592.695806000:2b073f035320: loading module '/lib64/rsyslog/imfile.so'
7592.695840000:420bc940: mutLoadUnload released <- this a strange
7592.695862000:420bc940: source file netstrms.c requested reference for module
'lmnsd_ptcp',
reference count now 1
7592.695868000:420bc940: mutObjGlobalOp released
7592.695885000:420bc940: locking mutObjGlobalOp ...
7592.695890000:420bc940: mutObjGlobalOp locked
7592.695901000:420bc940: mutObjGlobalOp released
7592.696880000:420bc940: 10.10.0.254:514/tcp
7592.696989000:420bc940: TCP sent 181 bytes, requested 181
7592.696999000:420bc940: Action 0x2b0757efe5a0 transitioned to state: rdy
7592.697004000:420bc940: action 0x2b0757efe5a0 call returned 0
7592.697015000:420bc940: Action 0x2b0757efe5a0 transitioned to state: itx
7592.697143000:420bc940: entering actionCalldoAction(), state: itx
7592.697147000:420bc940: 10.10.0.254
7592.697152000:420bc940: 10.10.0.254:514/tcp
7592.697159000:420bc940: CheckConnection detected broken connection - closing it
7592.697173000:420bc940: locking mutObjGlobalOp ...
7592.697177000:420bc940: mutObjGlobalOp locked <- thread B got mutObjGlobalOp
7592.697184000:420bc940: file netstrms.c released module 'lmnsd_ptcp',
reference count now 0
7592.697188000:420bc940: module 'lmnsd_ptcp' has zero reference count,
unloading...
7592.697192000:420bc940: locking mutLoadUnload ... <- thread B wants
mutLoadUnload held by A
7592.703794000:2b073f035320: locking mutObjGlobalOp ... <- thread A wants
mutObjGlobalOp held by B
7608.246465000:2b073f035320: DoDie called. <- i did it :)
getting mutObjGlobalOp before mutLoadUnload and releasing it afterwards might
by a solution but
there may be better ones.
regards,
-ap
7592.584283000:2b073f035320: rsyslogd 5.8.6 startup, compatibility mode 5,
module path '', cwd:/var/spool
7592.584341000:2b073f035320: locking mutObjGlobalOp ...
7592.584346000:2b073f035320: mutObjGlobalOp locked
7592.584371000:2b073f035320: mutObjGlobalOp released
7592.584406000:2b073f035320: locking mutObjGlobalOp ...
7592.584411000:2b073f035320: mutObjGlobalOp locked
7592.584415000:2b073f035320: mutObjGlobalOp released
7592.584488000:2b073f035320: locking mutObjGlobalOp ...
7592.584493000:2b073f035320: mutObjGlobalOp locked
7592.584497000:2b073f035320: mutObjGlobalOp released
7592.584524000:2b073f035320: locking mutObjGlobalOp ...
7592.584529000:2b073f035320: mutObjGlobalOp locked
7592.584532000:2b073f035320: mutObjGlobalOp released
7592.584548000:2b073f035320: locking mutObjGlobalOp ...
7592.584553000:2b073f035320: mutObjGlobalOp locked
7592.584557000:2b073f035320: mutObjGlobalOp released
7592.584561000:2b073f035320: locking mutObjGlobalOp ...
7592.584564000:2b073f035320: mutObjGlobalOp locked
7592.584568000:2b073f035320: mutObjGlobalOp released
7592.584572000:2b073f035320: locking mutObjGlobalOp ...
7592.584575000:2b073f035320: mutObjGlobalOp locked
7592.584579000:2b073f035320: mutObjGlobalOp released
7592.584583000:2b073f035320: locking mutObjGlobalOp ...
7592.584586000:2b073f035320: mutObjGlobalOp locked
7592.584601000:2b073f035320: mutObjGlobalOp released
7592.584637000:2b073f035320: locking mutObjGlobalOp ...
7592.584642000:2b073f035320: mutObjGlobalOp locked
7592.584646000:2b073f035320: mutObjGlobalOp released
7592.584650000:2b073f035320: locking mutObjGlobalOp ...
7592.584654000:2b073f035320: mutObjGlobalOp locked
7592.584657000:2b073f035320: mutObjGlobalOp released
7592.584699000:2b073f035320: locking mutObjGlobalOp ...
7592.584703000:2b073f035320: mutObjGlobalOp locked
7592.584707000:2b073f035320: mutObjGlobalOp released
7592.584711000:2b073f035320: locking mutObjGlobalOp ...
7592.584714000:2b073f035320: mutObjGlobalOp locked
7592.584718000:2b073f035320: mutObjGlobalOp released
7592.584722000:2b073f035320: locking mutObjGlobalOp ...
7592.584725000:2b073f035320: mutObjGlobalOp locked
7592.584730000:2b073f035320: mutObjGlobalOp released
7592.584733000:2b073f035320: locking mutObjGlobalOp ...
7592.584737000:2b073f035320: mutObjGlobalOp locked
7592.584741000:2b073f035320: mutObjGlobalOp released
7592.584745000:2b073f035320: locking mutObjGlobalOp ...
7592.584749000:2b073f035320: mutObjGlobalOp locked
7592.584753000:2b073f035320: mutObjGlobalOp released
7592.584783000:2b073f035320: locking mutObjGlobalOp ...
7592.584788000:2b073f035320: mutObjGlobalOp locked
7592.584792000:2b073f035320: mutObjGlobalOp released
7592.584796000:2b073f035320: locking mutObjGlobalOp ...
7592.584800000:2b073f035320: mutObjGlobalOp locked
7592.584803000:2b073f035320: mutObjGlobalOp released
7592.584819000:2b073f035320: locking mutObjGlobalOp ...
7592.584824000:2b073f035320: mutObjGlobalOp locked
7592.584828000:2b073f035320: mutObjGlobalOp released
7592.584843000:2b073f035320: locking mutObjGlobalOp ...
7592.584848000:2b073f035320: mutObjGlobalOp locked
7592.584852000:2b073f035320: mutObjGlobalOp released
7592.584855000:2b073f035320: locking mutObjGlobalOp ...
7592.584859000:2b073f035320: mutObjGlobalOp locked
7592.584863000:2b073f035320: mutObjGlobalOp released
7592.584866000:2b073f035320: locking mutObjGlobalOp ...
7592.584870000:2b073f035320: mutObjGlobalOp locked
7592.584881000:2b073f035320: mutObjGlobalOp released
7592.584897000:2b073f035320: locking mutObjGlobalOp ...
7592.584902000:2b073f035320: mutObjGlobalOp locked
7592.584906000:2b073f035320: mutObjGlobalOp released
7592.584909000:2b073f035320: locking mutObjGlobalOp ...
7592.584913000:2b073f035320: mutObjGlobalOp locked
7592.584917000:2b073f035320: mutObjGlobalOp released
7592.584920000:2b073f035320: locking mutObjGlobalOp ...
7592.584924000:2b073f035320: mutObjGlobalOp locked
7592.584928000:2b073f035320: mutObjGlobalOp released
7592.584946000:2b073f035320: locking mutObjGlobalOp ...
7592.584951000:2b073f035320: mutObjGlobalOp locked
7592.584955000:2b073f035320: mutObjGlobalOp released
7592.584963000:2b073f035320: locking mutObjGlobalOp ...
7592.584966000:2b073f035320: mutObjGlobalOp locked
7592.584971000:2b073f035320: mutObjGlobalOp released
7592.584975000:2b073f035320: locking mutObjGlobalOp ...
7592.584979000:2b073f035320: mutObjGlobalOp locked
7592.584983000:2b073f035320: mutObjGlobalOp released
7592.584987000:2b073f035320: locking mutObjGlobalOp ...
7592.584991000:2b073f035320: mutObjGlobalOp locked
7592.584995000:2b073f035320: mutObjGlobalOp released
7592.584999000:2b073f035320: locking mutObjGlobalOp ...
7592.585002000:2b073f035320: mutObjGlobalOp locked
7592.585006000:2b073f035320: mutObjGlobalOp released
7592.585010000:2b073f035320: locking mutObjGlobalOp ...
7592.585013000:2b073f035320: mutObjGlobalOp locked
7592.585017000:2b073f035320: mutObjGlobalOp released
7592.585020000:2b073f035320: locking mutObjGlobalOp ...
7592.585024000:2b073f035320: mutObjGlobalOp locked
7592.585028000:2b073f035320: mutObjGlobalOp released
7592.585031000:2b073f035320: locking mutObjGlobalOp ...
7592.585035000:2b073f035320: mutObjGlobalOp locked
7592.585039000:2b073f035320: mutObjGlobalOp released
7592.585055000:2b073f035320: locking mutObjGlobalOp ...
7592.585060000:2b073f035320: mutObjGlobalOp locked
7592.585064000:2b073f035320: mutObjGlobalOp released
7592.585068000:2b073f035320: locking mutObjGlobalOp ...
7592.585071000:2b073f035320: mutObjGlobalOp locked
7592.585075000:2b073f035320: mutObjGlobalOp released
7592.585079000:2b073f035320: locking mutObjGlobalOp ...
7592.585082000:2b073f035320: mutObjGlobalOp locked
7592.585086000:2b073f035320: mutObjGlobalOp released
7592.585090000:2b073f035320: locking mutObjGlobalOp ...
7592.585093000:2b073f035320: mutObjGlobalOp locked
7592.585097000:2b073f035320: mutObjGlobalOp released
7592.585113000:2b073f035320: locking mutObjGlobalOp ...
7592.585117000:2b073f035320: mutObjGlobalOp locked
7592.585121000:2b073f035320: mutObjGlobalOp released
7592.585125000:2b073f035320: locking mutObjGlobalOp ...
7592.585128000:2b073f035320: mutObjGlobalOp locked
7592.585132000:2b073f035320: mutObjGlobalOp released
7592.585150000:2b073f035320: locking mutObjGlobalOp ...
7592.585154000:2b073f035320: mutObjGlobalOp locked
7592.585158000:2b073f035320: mutObjGlobalOp released
7592.585163000:2b073f035320: locking mutObjGlobalOp ...
7592.585166000:2b073f035320: mutObjGlobalOp locked
7592.585170000:2b073f035320: mutObjGlobalOp released
7592.585174000:2b073f035320: locking mutObjGlobalOp ...
7592.585178000:2b073f035320: mutObjGlobalOp locked
7592.585182000:2b073f035320: mutObjGlobalOp released
7592.585185000:2b073f035320: locking mutObjGlobalOp ...
7592.585189000:2b073f035320: mutObjGlobalOp locked
7592.585193000:2b073f035320: mutObjGlobalOp released
7592.585208000:2b073f035320: locking mutObjGlobalOp ...
7592.585212000:2b073f035320: mutObjGlobalOp locked
7592.585216000:2b073f035320: mutObjGlobalOp released
7592.585220000:2b073f035320: locking mutObjGlobalOp ...
7592.585223000:2b073f035320: mutObjGlobalOp locked
7592.585227000:2b073f035320: mutObjGlobalOp released
7592.585231000:2b073f035320: locking mutObjGlobalOp ...
7592.585234000:2b073f035320: mutObjGlobalOp locked
7592.585238000:2b073f035320: mutObjGlobalOp released
7592.585243000:2b073f035320: locking mutObjGlobalOp ...
7592.585247000:2b073f035320: mutObjGlobalOp locked
7592.585250000:2b073f035320: mutObjGlobalOp released
7592.585254000:2b073f035320: locking mutObjGlobalOp ...
7592.585258000:2b073f035320: mutObjGlobalOp locked
7592.585262000:2b073f035320: mutObjGlobalOp released
7592.585265000:2b073f035320: locking mutObjGlobalOp ...
7592.585269000:2b073f035320: mutObjGlobalOp locked
7592.585272000:2b073f035320: mutObjGlobalOp released
7592.585276000:2b073f035320: locking mutObjGlobalOp ...
7592.585280000:2b073f035320: mutObjGlobalOp locked
7592.585284000:2b073f035320: mutObjGlobalOp released
7592.585287000:2b073f035320: locking mutObjGlobalOp ...
7592.585291000:2b073f035320: mutObjGlobalOp locked
7592.585294000:2b073f035320: mutObjGlobalOp released
7592.585298000:2b073f035320: locking mutObjGlobalOp ...
7592.585301000:2b073f035320: mutObjGlobalOp locked
7592.585310000:2b073f035320: caller requested object 'net', not found (iRet
-3003)
7592.585344000:2b073f035320: Requested to load module 'lmnet'
7592.585349000:2b073f035320: locking mutLoadUnload ...
7592.585353000:2b073f035320: mutLoadUnload locked
7592.585358000:2b073f035320: loading module '/lib64/rsyslog/lmnet.so'
7592.603805000:2b073f035320: locking mutObjGlobalOp ...
7592.603812000:2b073f035320: mutObjGlobalOp locked
7592.603818000:2b073f035320: mutObjGlobalOp released
7592.603823000:2b073f035320: locking mutObjGlobalOp ...
7592.603826000:2b073f035320: mutObjGlobalOp locked
7592.603832000:2b073f035320: mutObjGlobalOp released
7592.603838000:2b073f035320: module of type 2 being loaded.
7592.603842000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.603846000:2b073f035320: mutLoadUnload released
7592.603866000:2b073f035320: source file conf.c requested reference for module
'lmnet', reference count now 1
7592.603880000:2b073f035320: mutObjGlobalOp released
7592.603885000:2b073f035320: locking mutObjGlobalOp ...
7592.603889000:2b073f035320: mutObjGlobalOp locked
7592.603894000:2b073f035320: mutObjGlobalOp released
7592.603898000:2b073f035320: locking mutObjGlobalOp ...
7592.603901000:2b073f035320: mutObjGlobalOp locked
7592.603911000:2b073f035320: mutObjGlobalOp released
7592.603935000:2b073f035320: locking mutObjGlobalOp ...
7592.603940000:2b073f035320: mutObjGlobalOp locked
7592.603944000:2b073f035320: mutObjGlobalOp released
7592.603947000:2b073f035320: locking mutObjGlobalOp ...
7592.603951000:2b073f035320: mutObjGlobalOp locked
7592.603955000:2b073f035320: mutObjGlobalOp released
7592.603959000:2b073f035320: locking mutObjGlobalOp ...
7592.603962000:2b073f035320: mutObjGlobalOp locked
7592.603966000:2b073f035320: mutObjGlobalOp released
7592.603970000:2b073f035320: locking mutObjGlobalOp ...
7592.603974000:2b073f035320: mutObjGlobalOp locked
7592.603978000:2b073f035320: mutObjGlobalOp released
7592.604009000:2b073f035320: locking mutObjGlobalOp ...
7592.604014000:2b073f035320: mutObjGlobalOp locked
7592.604018000:2b073f035320: mutObjGlobalOp released
7592.604022000:2b073f035320: locking mutObjGlobalOp ...
7592.604025000:2b073f035320: mutObjGlobalOp locked
7592.604029000:2b073f035320: mutObjGlobalOp released
7592.604033000:2b073f035320: locking mutObjGlobalOp ...
7592.604036000:2b073f035320: mutObjGlobalOp locked
7592.604040000:2b073f035320: mutObjGlobalOp released
7592.604045000:2b073f035320: rsyslog runtime initialized, version 5.8.6,
current users 1
7592.604050000:2b073f035320: locking mutObjGlobalOp ...
7592.604053000:2b073f035320: mutObjGlobalOp locked
7592.604063000:2b073f035320: mutObjGlobalOp released
7592.604068000:2b073f035320: locking mutObjGlobalOp ...
7592.604071000:2b073f035320: mutObjGlobalOp locked
7592.604075000:2b073f035320: mutObjGlobalOp released
7592.604079000:2b073f035320: locking mutObjGlobalOp ...
7592.604082000:2b073f035320: mutObjGlobalOp locked
7592.604086000:2b073f035320: mutObjGlobalOp released
7592.604090000:2b073f035320: locking mutObjGlobalOp ...
7592.604093000:2b073f035320: mutObjGlobalOp locked
7592.604097000:2b073f035320: mutObjGlobalOp released
7592.604101000:2b073f035320: locking mutObjGlobalOp ...
7592.604105000:2b073f035320: mutObjGlobalOp locked
7592.604109000:2b073f035320: mutObjGlobalOp released
7592.604112000:2b073f035320: locking mutObjGlobalOp ...
7592.604116000:2b073f035320: mutObjGlobalOp locked
7592.604120000:2b073f035320: mutObjGlobalOp released
7592.604124000:2b073f035320: locking mutObjGlobalOp ...
7592.604127000:2b073f035320: mutObjGlobalOp locked
7592.604131000:2b073f035320: mutObjGlobalOp released
7592.604135000:2b073f035320: locking mutObjGlobalOp ...
7592.604139000:2b073f035320: mutObjGlobalOp locked
7592.604143000:2b073f035320: mutObjGlobalOp released
7592.604146000:2b073f035320: locking mutObjGlobalOp ...
7592.604150000:2b073f035320: mutObjGlobalOp locked
7592.604154000:2b073f035320: mutObjGlobalOp released
7592.604158000:2b073f035320: locking mutObjGlobalOp ...
7592.604161000:2b073f035320: mutObjGlobalOp locked
7592.604170000:2b073f035320: mutObjGlobalOp released
7592.604190000:2b073f035320: locking mutObjGlobalOp ...
7592.604195000:2b073f035320: mutObjGlobalOp locked
7592.604199000:2b073f035320: mutObjGlobalOp released
7592.604203000:2b073f035320: locking mutObjGlobalOp ...
7592.604206000:2b073f035320: mutObjGlobalOp locked
7592.604210000:2b073f035320: mutObjGlobalOp released
7592.604214000:2b073f035320: locking mutObjGlobalOp ...
7592.604217000:2b073f035320: mutObjGlobalOp locked
7592.604221000:2b073f035320: mutObjGlobalOp released
7592.604309000:2b073f035320: locking mutObjGlobalOp ...
7592.604314000:2b073f035320: mutObjGlobalOp locked
7592.604318000:2b073f035320: mutObjGlobalOp released
7592.604322000:2b073f035320: locking mutObjGlobalOp ...
7592.604325000:2b073f035320: mutObjGlobalOp locked
7592.604330000:2b073f035320: mutObjGlobalOp released
7592.604333000:2b073f035320: locking mutObjGlobalOp ...
7592.604337000:2b073f035320: mutObjGlobalOp locked
7592.604342000:2b073f035320: source file syslogd.c requested reference for
module 'lmnet', reference count now 2
7592.604346000:2b073f035320: mutObjGlobalOp released
7592.625755000:2b073f035320: GenerateLocalHostName uses 'gold-centos5-x86_64'
7592.625791000:2b073f035320: locking mutObjGlobalOp ...
7592.625796000:2b073f035320: mutObjGlobalOp locked
7592.625803000:2b073f035320: mutObjGlobalOp released
7592.625807000:2b073f035320: locking mutObjGlobalOp ...
7592.625811000:2b073f035320: mutObjGlobalOp locked
7592.625816000:2b073f035320: mutObjGlobalOp released
7592.625822000:2b073f035320: omfile: using transactional output interface.
7592.625885000:2b073f035320: module of type 1 being loaded.
7592.625911000:2b073f035320: locking mutObjGlobalOp ...
7592.625916000:2b073f035320: mutObjGlobalOp locked
7592.625921000:2b073f035320: mutObjGlobalOp released
7592.625925000:2b073f035320: module of type 1 being loaded.
7592.625932000:2b073f035320: entry point 'beginTransaction' not present in
module
7592.625937000:2b073f035320: entry point 'endTransaction' not present in module
7592.625953000:2b073f035320: locking mutObjGlobalOp ...
7592.625958000:2b073f035320: mutObjGlobalOp locked
7592.625962000:2b073f035320: mutObjGlobalOp released
7592.625966000:2b073f035320: locking mutObjGlobalOp ...
7592.625970000:2b073f035320: mutObjGlobalOp locked
7592.625974000:2b073f035320: mutObjGlobalOp released
7592.625977000:2b073f035320: locking mutObjGlobalOp ...
7592.625981000:2b073f035320: mutObjGlobalOp locked
7592.625986000:2b073f035320: source file omfwd.c requested reference for module
'lmnet', reference count now 3
7592.625991000:2b073f035320: mutObjGlobalOp released
7592.626011000:2b073f035320: module of type 1 being loaded.
7592.626018000:2b073f035320: entry point 'doHUP' not present in module
7592.626022000:2b073f035320: entry point 'beginTransaction' not present in
module
7592.626026000:2b073f035320: entry point 'endTransaction' not present in module
7592.626031000:2b073f035320: locking mutObjGlobalOp ...
7592.626034000:2b073f035320: mutObjGlobalOp locked
7592.626039000:2b073f035320: mutObjGlobalOp released
7592.626043000:2b073f035320: module of type 1 being loaded.
7592.626050000:2b073f035320: entry point 'doHUP' not present in module
7592.626054000:2b073f035320: entry point 'beginTransaction' not present in
module
7592.626058000:2b073f035320: entry point 'endTransaction' not present in module
7592.626075000:2b073f035320: module of type 1 being loaded.
7592.626083000:2b073f035320: entry point 'doHUP' not present in module
7592.626087000:2b073f035320: entry point 'beginTransaction' not present in
module
7592.626091000:2b073f035320: entry point 'endTransaction' not present in module
7592.626096000:2b073f035320: locking mutObjGlobalOp ...
7592.626100000:2b073f035320: mutObjGlobalOp locked
7592.626104000:2b073f035320: mutObjGlobalOp released
7592.626109000:2b073f035320: module of type 1 being loaded.
7592.626115000:2b073f035320: entry point 'doHUP' not present in module
7592.626119000:2b073f035320: entry point 'beginTransaction' not present in
module
7592.626124000:2b073f035320: entry point 'endTransaction' not present in module
7592.626146000:2b073f035320: locking mutObjGlobalOp ...
7592.626151000:2b073f035320: mutObjGlobalOp locked
7592.626156000:2b073f035320: mutObjGlobalOp released
7592.626159000:2b073f035320: locking mutObjGlobalOp ...
7592.626163000:2b073f035320: mutObjGlobalOp locked
7592.626167000:2b073f035320: mutObjGlobalOp released
7592.626171000:2b073f035320: locking mutObjGlobalOp ...
7592.626174000:2b073f035320: mutObjGlobalOp locked
7592.626179000:2b073f035320: mutObjGlobalOp released
7592.626183000:2b073f035320: locking mutObjGlobalOp ...
7592.626186000:2b073f035320: mutObjGlobalOp locked
7592.626191000:2b073f035320: mutObjGlobalOp released
7592.626194000:2b073f035320: rfc5424 parser init called
7592.626198000:2b073f035320: GetParserName addr 0x2b073de2a420
7592.626203000:2b073f035320: module of type 3 being loaded.
7592.626207000:2b073f035320: locking mutObjGlobalOp ...
7592.626211000:2b073f035320: mutObjGlobalOp locked
7592.626221000:2b073f035320: mutObjGlobalOp released
7592.626228000:2b073f035320: Parser 'rsyslog.rfc5424' added to list of
available parsers.
7592.626233000:2b073f035320: locking mutObjGlobalOp ...
7592.626237000:2b073f035320: mutObjGlobalOp locked
7592.626241000:2b073f035320: mutObjGlobalOp released
7592.626244000:2b073f035320: locking mutObjGlobalOp ...
7592.626248000:2b073f035320: mutObjGlobalOp locked
7592.626252000:2b073f035320: mutObjGlobalOp released
7592.626255000:2b073f035320: locking mutObjGlobalOp ...
7592.626259000:2b073f035320: mutObjGlobalOp locked
7592.626263000:2b073f035320: mutObjGlobalOp released
7592.626267000:2b073f035320: locking mutObjGlobalOp ...
7592.626270000:2b073f035320: mutObjGlobalOp locked
7592.626274000:2b073f035320: mutObjGlobalOp released
7592.626278000:2b073f035320: rfc3164 parser init called
7592.626283000:2b073f035320: module of type 3 being loaded.
7592.626287000:2b073f035320: locking mutObjGlobalOp ...
7592.626290000:2b073f035320: mutObjGlobalOp locked
7592.626294000:2b073f035320: mutObjGlobalOp released
7592.626299000:2b073f035320: Parser 'rsyslog.rfc3164' added to list of
available parsers.
7592.626303000:2b073f035320: Parser 'rsyslog.rfc5424' added to default parser
set.
7592.626308000:2b073f035320: Parser 'rsyslog.rfc3164' added to default parser
set.
7592.626324000:2b073f035320: rsyslog standard file format strgen init called,
compiled with version 5.8.6
7592.626330000:2b073f035320: module of type 4 being loaded.
7592.626334000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.626338000:2b073f035320: locking mutObjGlobalOp ...
7592.626342000:2b073f035320: mutObjGlobalOp locked
7592.626347000:2b073f035320: mutObjGlobalOp released
7592.626352000:2b073f035320: Strgen 'RSYSLOG_FileFormat' added to list of
available strgens.
7592.626357000:2b073f035320: traditional file format strgen init called,
compiled with version 5.8.6
7592.626362000:2b073f035320: module of type 4 being loaded.
7592.626366000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.626370000:2b073f035320: locking mutObjGlobalOp ...
7592.626374000:2b073f035320: mutObjGlobalOp locked
7592.626377000:2b073f035320: mutObjGlobalOp released
7592.626382000:2b073f035320: Strgen 'RSYSLOG_TraditionalFileFormat' added to
list of available strgens.
7592.626387000:2b073f035320: rsyslog standard (network) forward format strgen
init called, compiled with version 5.8.6
7592.626391000:2b073f035320: module of type 4 being loaded.
7592.626396000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.626400000:2b073f035320: locking mutObjGlobalOp ...
7592.626403000:2b073f035320: mutObjGlobalOp locked
7592.626407000:2b073f035320: mutObjGlobalOp released
7592.626412000:2b073f035320: Strgen 'RSYSLOG_ForwardFormat' added to list of
available strgens.
7592.626416000:2b073f035320: rsyslog traditional (network) forward format
strgen init called, compiled with version 5.8.6
7592.626421000:2b073f035320: module of type 4 being loaded.
7592.626425000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.626429000:2b073f035320: locking mutObjGlobalOp ...
7592.626472000:2b073f035320: mutObjGlobalOp locked
7592.626476000:2b073f035320: mutObjGlobalOp released
7592.626494000:2b073f035320: Strgen 'RSYSLOG_TraditionalForwardFormat' added to
list of available strgens.
7592.626615000:2b073f035320: deque option n, optarg ''
7592.626620000:2b073f035320: deque option f, optarg '/etc/rsyslog.conf'
7592.626648000:2b073f035320: Writing pidfile /var/run/syslogd.pid.
7592.626902000:2b073f035320: template bound to strgen 'RSYSLOG_FileFormat'
7592.626909000:2b073f035320: template bound to strgen
'RSYSLOG_TraditionalFileFormat'
7592.626933000:2b073f035320: template bound to strgen 'RSYSLOG_ForwardFormat'
7592.626939000:2b073f035320: template bound to strgen
'RSYSLOG_TraditionalForwardFormat'
7592.627025000:2b073f035320: rsyslog 5.8.6 - called init()
7592.633628000:2b073f035320: cfline: '$ModLoad imuxsock'
7592.633691000:2b073f035320: Requested to load module 'imuxsock'
7592.633697000:2b073f035320: locking mutLoadUnload ...
7592.633701000:2b073f035320: mutLoadUnload locked
7592.633706000:2b073f035320: loading module '/lib64/rsyslog/imuxsock.so'
7592.636273000:2b073f035320: locking mutObjGlobalOp ...
7592.636280000:2b073f035320: mutObjGlobalOp locked
7592.636286000:2b073f035320: mutObjGlobalOp released
7592.636290000:2b073f035320: locking mutObjGlobalOp ...
7592.636295000:2b073f035320: mutObjGlobalOp locked
7592.636300000:2b073f035320: mutObjGlobalOp released
7592.636304000:2b073f035320: locking mutObjGlobalOp ...
7592.636307000:2b073f035320: mutObjGlobalOp locked
7592.636311000:2b073f035320: mutObjGlobalOp released
7592.636315000:2b073f035320: locking mutObjGlobalOp ...
7592.636319000:2b073f035320: mutObjGlobalOp locked
7592.636323000:2b073f035320: mutObjGlobalOp released
7592.636326000:2b073f035320: locking mutObjGlobalOp ...
7592.636330000:2b073f035320: mutObjGlobalOp locked
7592.636334000:2b073f035320: mutObjGlobalOp released
7592.636338000:2b073f035320: locking mutObjGlobalOp ...
7592.636341000:2b073f035320: mutObjGlobalOp locked
7592.636358000:2b073f035320: mutObjGlobalOp released
7592.636374000:2b073f035320: imuxsock version 5.8.6 initializing
7592.636519000:2b073f035320: module of type 0 being loaded.
7592.636532000:2b073f035320: mutLoadUnload released
7592.636557000:2b073f035320: cfline: '$ModLoad imklog'
7592.636565000:2b073f035320: Requested to load module 'imklog'
7592.636568000:2b073f035320: locking mutLoadUnload ...
7592.636572000:2b073f035320: mutLoadUnload locked
7592.636577000:2b073f035320: loading module '/lib64/rsyslog/imklog.so'
7592.637090000:2b073f035320: locking mutObjGlobalOp ...
7592.637096000:2b073f035320: mutObjGlobalOp locked
7592.637101000:2b073f035320: mutObjGlobalOp released
7592.637105000:2b073f035320: locking mutObjGlobalOp ...
7592.637109000:2b073f035320: mutObjGlobalOp locked
7592.637113000:2b073f035320: mutObjGlobalOp released
7592.637117000:2b073f035320: locking mutObjGlobalOp ...
7592.637120000:2b073f035320: mutObjGlobalOp locked
7592.637124000:2b073f035320: mutObjGlobalOp released
7592.637199000:2b073f035320: module of type 0 being loaded.
7592.637205000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.637216000:2b073f035320: mutLoadUnload released
7592.637223000:2b073f035320: cfline: '$ModLoad immark'
7592.637229000:2b073f035320: Requested to load module 'immark'
7592.637233000:2b073f035320: locking mutLoadUnload ...
7592.637236000:2b073f035320: mutLoadUnload locked
7592.637241000:2b073f035320: loading module '/lib64/rsyslog/immark.so'
7592.637571000:2b073f035320: locking mutObjGlobalOp ...
7592.637577000:2b073f035320: mutObjGlobalOp locked
7592.637582000:2b073f035320: mutObjGlobalOp released
7592.637599000:2b073f035320: module of type 0 being loaded.
7592.637606000:2b073f035320: mutLoadUnload released
7592.637618000:2b073f035320: cfline: '$MarkMessagePeriod 1200'
7592.637627000:2b073f035320: cfline: '$SystemLogRateLimitInterval 0'
7592.637642000:2b073f035320: cfline: '$ActionFileDefaultTemplate
RSYSLOG_FileFormat'
7592.637651000:2b073f035320: doGetWord: get newval 'RSYSLOG_FileFormat' (len
18), hdlr (nil)
7592.637663000:2b073f035320: cfline:
'*.info;mail.none;authpriv.none;cron.none;local6.none;local0.none
/var/log/messages'
7592.637668000:2b073f035320: - traditional PRI filter
7592.637673000:2b073f035320: symbolic name: info ==> 6
7592.637680000:2b073f035320: symbolic name: none ==> 16
7592.637686000:2b073f035320: symbolic name: mail ==> 16
7592.637691000:2b073f035320: symbolic name: none ==> 16
7592.637697000:2b073f035320: symbolic name: authpriv ==> 80
7592.637702000:2b073f035320: symbolic name: none ==> 16
7592.637708000:2b073f035320: symbolic name: cron ==> 72
7592.637713000:2b073f035320: symbolic name: none ==> 16
7592.637719000:2b073f035320: symbolic name: local6 ==> 176
7592.637724000:2b073f035320: symbolic name: none ==> 16
7592.637729000:2b073f035320: symbolic name: local0 ==> 128
7592.650848000:2b073f035320: file stream messages params: flush interval 0,
async write 0
7592.650855000:2b073f035320: tried selector action for builtin-file: 0
7592.650860000:2b073f035320: Module builtin-file processed this config line.
7592.650899000:2b073f035320: template: 'RSYSLOG_FileFormat' assigned
7592.650920000:2b073f035320: action 1 queue: save on shutdown 1, max disk space
allowed 0
7592.650949000:2b073f035320: action 1 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.650956000:2b073f035320: Action 0x2b0757ef85f0: queue 0x2b0757ef86e0 created
7592.650964000:2b073f035320: cfline: 'authpriv.*
/var/log/secure'
7592.650968000:2b073f035320: selector line successfully processed
7592.650972000:2b073f035320: - traditional PRI filter
7592.650976000:2b073f035320: symbolic name: * ==> 255
7592.650982000:2b073f035320: symbolic name: authpriv ==> 80
7592.651007000:2b073f035320: file stream secure params: flush interval 0, async
write 0
7592.651027000:2b073f035320: tried selector action for builtin-file: 0
7592.651032000:2b073f035320: Module builtin-file processed this config line.
7592.651038000:2b073f035320: template: 'RSYSLOG_FileFormat' assigned
7592.651044000:2b073f035320: action 2 queue: save on shutdown 1, max disk space
allowed 0
7592.651051000:2b073f035320: action 2 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.651056000:2b073f035320: Action 0x2b0757ef9210: queue 0x2b0757ef9320 created
7592.651063000:2b073f035320: cfline: 'mail.*
-/var/log/mail'
7592.651067000:2b073f035320: selector line successfully processed
7592.651071000:2b073f035320: - traditional PRI filter
7592.651075000:2b073f035320: symbolic name: * ==> 255
7592.651081000:2b073f035320: symbolic name: mail ==> 16
7592.651106000:2b073f035320: file stream mail params: flush interval 0, async
write 0
7592.651111000:2b073f035320: tried selector action for builtin-file: 0
7592.651115000:2b073f035320: Module builtin-file processed this config line.
7592.651121000:2b073f035320: template: 'RSYSLOG_FileFormat' assigned
7592.651140000:2b073f035320: action 3 queue: save on shutdown 1, max disk space
allowed 0
7592.651149000:2b073f035320: action 3 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.651154000:2b073f035320: Action 0x2b0757ef9ea0: queue 0x2b0757ef9fb0 created
7592.651160000:2b073f035320: cfline: 'cron.*
/var/log/cron'
7592.651164000:2b073f035320: selector line successfully processed
7592.651168000:2b073f035320: - traditional PRI filter
7592.651172000:2b073f035320: symbolic name: * ==> 255
7592.651178000:2b073f035320: symbolic name: cron ==> 72
7592.651204000:2b073f035320: file stream cron params: flush interval 0, async
write 0
7592.651210000:2b073f035320: tried selector action for builtin-file: 0
7592.651214000:2b073f035320: Module builtin-file processed this config line.
7592.651219000:2b073f035320: template: 'RSYSLOG_FileFormat' assigned
7592.651225000:2b073f035320: action 4 queue: save on shutdown 1, max disk space
allowed 0
7592.651236000:2b073f035320: action 4 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.651242000:2b073f035320: Action 0x2b0757efaaf0: queue 0x2b0757efac30 created
7592.651248000:2b073f035320: cfline: '*.emerg
*'
7592.651252000:2b073f035320: selector line successfully processed
7592.651256000:2b073f035320: - traditional PRI filter
7592.651261000:2b073f035320: symbolic name: emerg ==> 0
7592.651267000:2b073f035320: tried selector action for builtin-file: -2001
7592.651271000:2b073f035320: tried selector action for builtin-pipe: -2001
7592.651276000:2b073f035320: tried selector action for builtin-fwd: -2001
7592.651281000:2b073f035320: tried selector action for builtin-shell: -2001
7592.651285000:2b073f035320: tried selector action for builtin-discard: -2001
7592.651304000:2b073f035320: write-alltried selector action for builtin-usrmsg: 0
7592.651312000:2b073f035320: Module builtin-usrmsg processed this config line.
7592.651317000:2b073f035320: template: ' WallFmt' assigned
7592.651323000:2b073f035320: action 5 queue: save on shutdown 1, max disk space
allowed 0
7592.651330000:2b073f035320: action 5 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.651335000:2b073f035320: Action 0x2b0757efb0e0: queue 0x2b0757efb1f0 created
7592.651342000:2b073f035320: cfline: 'uucp,news.crit
/var/log/spooler'
7592.651346000:2b073f035320: selector line successfully processed
7592.651350000:2b073f035320: - traditional PRI filter
7592.651354000:2b073f035320: symbolic name: crit ==> 2
7592.651359000:2b073f035320: symbolic name: uucp ==> 64
7592.651365000:2b073f035320: symbolic name: news ==> 56
7592.651389000:2b073f035320: file stream spooler params: flush interval 0,
async write 0
7592.651394000:2b073f035320: tried selector action for builtin-file: 0
7592.651398000:2b073f035320: Module builtin-file processed this config line.
7592.651404000:2b073f035320: template: 'RSYSLOG_FileFormat' assigned
7592.651423000:2b073f035320: action 6 queue: save on shutdown 1, max disk space
allowed 0
7592.651432000:2b073f035320: action 6 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.651470000:2b073f035320: Action 0x2b0757efbd90: queue 0x2b0757efbe80 created
7592.651477000:2b073f035320: cfline: 'local7.*
/var/log/boot'
7592.651481000:2b073f035320: selector line successfully processed
7592.651485000:2b073f035320: - traditional PRI filter
7592.651489000:2b073f035320: symbolic name: * ==> 255
7592.651495000:2b073f035320: symbolic name: local7 ==> 184
7592.651520000:2b073f035320: file stream boot params: flush interval 0, async
write 0
7592.651525000:2b073f035320: tried selector action for builtin-file: 0
7592.651529000:2b073f035320: Module builtin-file processed this config line.
7592.651535000:2b073f035320: template: 'RSYSLOG_FileFormat' assigned
7592.651540000:2b073f035320: action 7 queue: save on shutdown 1, max disk space
allowed 0
7592.651548000:2b073f035320: action 7 queue: type 3, enq-only 0, disk assisted
0, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 970, light delay
700, deq batch size 16 starting
7592.651553000:2b073f035320: Action 0x2b0757efc9c0: queue 0x2b0757efcb00 created
7592.651559000:2b073f035320: cfline: '$IncludeConfig /etc/rsyslog.d/*.conf'
7592.668651000:2b073f035320: requested to include config file
'/etc/rsyslog.d/forwarder.conf'
7592.685404000:2b073f035320: cfline: '$ActionForwardDefaultTemplate
RSYSLOG_ForwardFormat'
7592.685419000:2b073f035320: doGetWord: get newval 'RSYSLOG_ForwardFormat' (len
21), hdlr (nil)
7592.685425000:2b073f035320: cfline: '$WorkDirectory /var/spool/rsyslog'
7592.685431000:2b073f035320: doGetWord: get newval '/var/spool/rsyslog' (len
18), hdlr 0x2b073de2d2e0
7592.685472000:2b073f035320: cfline: '$ActionQueueType LinkedList'
7592.685483000:2b073f035320: doGetWord: get newval 'LinkedList' (len 10), hdlr
0x2b073de4da90
7592.685488000:2b073f035320: action queue type set to LINKEDLIST
7592.685493000:2b073f035320: cfline: '$ActionQueueMaxDiskSpace 1024m'
7592.685500000:2b073f035320: cfline: '$ActionQueueCheckpointInterval 10'
7592.685507000:2b073f035320: cfline: '$ActionQueueFileName forward'
7592.685513000:2b073f035320: doGetWord: get newval 'forward' (len 7), hdlr (nil)
7592.685518000:2b073f035320: cfline: '$ActionQueueMaxFileSize 1m'
7592.685524000:2b073f035320: cfline: '$ActionResumeRetryCount -1'
7592.685532000:2b073f035320: cfline: '$ActionQueueSaveOnShutdown on'
7592.685539000:2b073f035320: cfline: '$ActionWriteAllMarkMessages on'
7592.685545000:2b073f035320: cfline: '*.*
@@10.10.0.254:514;RSYSLOG_ForwardFormat'
7592.685551000:2b073f035320: - traditional PRI filter
7592.685555000:2b073f035320: symbolic name: * ==> 255
7592.685563000:2b073f035320: tried selector action for builtin-file: -2001
7592.685568000:2b073f035320: tried selector action for builtin-pipe: -2001
7592.685573000:2b073f035320: locking mutObjGlobalOp ...
7592.685577000:2b073f035320: mutObjGlobalOp locked
7592.685582000:2b073f035320: caller requested object 'netstrms', not found
(iRet -3003)
7592.685612000:2b073f035320: Requested to load module 'lmnetstrms'
7592.685618000:2b073f035320: locking mutLoadUnload ...
7592.685621000:2b073f035320: mutLoadUnload locked
7592.685628000:2b073f035320: loading module '/lib64/rsyslog/lmnetstrms.so'
7592.686143000:2b073f035320: locking mutObjGlobalOp ...
7592.686149000:2b073f035320: mutObjGlobalOp locked
7592.686155000:2b073f035320: mutObjGlobalOp released
7592.686161000:2b073f035320: doing nsselClassInit
7592.686166000:2b073f035320: locking mutObjGlobalOp ...
7592.686170000:2b073f035320: mutObjGlobalOp locked
7592.686175000:2b073f035320: mutObjGlobalOp released
7592.686179000:2b073f035320: doing nspollClassInit
7592.686183000:2b073f035320: locking mutObjGlobalOp ...
7592.686187000:2b073f035320: mutObjGlobalOp locked
7592.686191000:2b073f035320: mutObjGlobalOp released
7592.686195000:2b073f035320: locking mutObjGlobalOp ...
7592.686199000:2b073f035320: mutObjGlobalOp locked
7592.686203000:2b073f035320: mutObjGlobalOp released
7592.686208000:2b073f035320: module of type 2 being loaded.
7592.686213000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.686217000:2b073f035320: mutLoadUnload released
7592.686236000:2b073f035320: source file omfwd.c requested reference for module
'lmnetstrms', reference count now 1
7592.686241000:2b073f035320: mutObjGlobalOp released
7592.686251000:2b073f035320: locking mutObjGlobalOp ...
7592.686256000:2b073f035320: mutObjGlobalOp locked
7592.686261000:2b073f035320: source file omfwd.c requested reference for module
'lmnetstrms', reference count now 2
7592.686265000:2b073f035320: mutObjGlobalOp released
7592.686269000:2b073f035320: locking mutObjGlobalOp ...
7592.686272000:2b073f035320: mutObjGlobalOp locked
7592.686277000:2b073f035320: caller requested object 'tcpclt', not found (iRet
-3003)
7592.686282000:2b073f035320: Requested to load module 'lmtcpclt'
7592.686285000:2b073f035320: locking mutLoadUnload ...
7592.686289000:2b073f035320: mutLoadUnload locked
7592.686295000:2b073f035320: loading module '/lib64/rsyslog/lmtcpclt.so'
7592.686948000:2b073f035320: module of type 2 being loaded.
7592.686955000:2b073f035320: entry point 'isCompatibleWithFeature' not present
in module
7592.686959000:2b073f035320: mutLoadUnload released
7592.686964000:2b073f035320: source file omfwd.c requested reference for module
'lmtcpclt', reference count now 1
7592.686968000:2b073f035320: mutObjGlobalOp released
7592.686984000:2b073f035320: tried selector action for builtin-fwd: 0
7592.686990000:2b073f035320: Module builtin-fwd processed this config line.
7592.686997000:2b073f035320: template: 'RSYSLOG_ForwardFormat' assigned
7592.687006000:2b073f035320: action 8 queue: save on shutdown 1, max disk space
allowed 1073741824
7592.687012000:2b073f035320: action 8 queue: is disk-assisted, disk will be
used on demand
7592.687023000:2b073f035320: action 8 queue: type 1, enq-only 0, disk assisted
1, maxFileSz 1048576, lqsize 0, pqsize 0, child 0, full delay 400, light delay
700, deq batch size 16 starting
7592.687032000:2b073f035320: action 8 queue:Reg: finalizing construction of
worker thread pool
7592.687037000:2b073f035320: action 8 queue:Reg/w0: finalizing construction of
worker instance data
7592.687064000:2b073f035320: action 8 queue:DAwpool: finalizing construction of
worker thread pool
7592.687070000:2b073f035320: action 8 queue:DAwpool/w0: finalizing construction
of worker instance data
7592.687076000:2b073f035320: action 8 queue[DA]: I am a child
7592.687089000:2b073f035320: file stream /var/spool/rsyslog/forward.qi params:
flush interval 0, async write 0
7592.687129000:2b073f035320: file '/var/spool/rsyslog/forward.qi' opened as #5
with mode 384
7592.687138000:2b073f035320: strm 0x2b0757eff8d0: opened file
'/var/spool/rsyslog/forward.qi' for READ as 5
7592.687168000:2b073f035320: strm 0x2b0757eff8d0: file 5 read 480 bytes
7592.687190000:2b073f035320: file stream forward params: flush interval 0,
async write 0
7592.687240000:2b073f035320: file stream forward params: flush interval 0,
async write 0
7592.687265000:2b073f035320: file stream forward params: flush interval 0,
async write 0
7592.687285000:2b073f035320: file '/var/spool/rsyslog/forward.00000001' opened
as #6 with mode 384
7592.687292000:2b073f035320: strm 0x2b0757f00c70: opened file
'/var/spool/rsyslog/forward.00000001' for WRITE as 6
7592.687297000:2b073f035320: strm 0x2b0757f00c70: file 6 seek, pos 981
7592.687307000:2b073f035320: file '/var/spool/rsyslog/forward.00000001' opened
as #7 with mode 384
7592.687313000:2b073f035320: strm 0x2b0757f01ff0: opened file
'/var/spool/rsyslog/forward.00000001' for READ as 7
7592.687318000:2b073f035320: strm 0x2b0757f01ff0: file 7 seek, pos 0
7592.687327000:2b073f035320: file '/var/spool/rsyslog/forward.00000001' opened
as #8 with mode 384
7592.687333000:2b073f035320: strm 0x2b0757f03220: opened file
'/var/spool/rsyslog/forward.00000001' for READ as 8
7592.687337000:2b073f035320: strm 0x2b0757f03220: file 8 seek, pos 0
7592.687343000:2b073f035320: strm 0x2b0757eff8d0: file
5(/var/spool/rsyslog/forward.qi) closing
7592.687352000:2b073f035320: action 8 queue[DA]: type 2, enq-only 0, disk
assisted 0, maxFileSz 1048576, lqsize 2, pqsize 2, child 1, full delay 0, light
delay 0, deq batch size 8 starting
7592.687359000:2b073f035320: action 8 queue[DA]:Reg: finalizing construction of
worker thread pool
7592.687365000:2b073f035320: action 8 queue[DA]:Reg/w0: finalizing construction
of worker instance data
7592.687369000:2b073f035320: action 8 queue[DA]: queue finished initialization
7592.687374000:2b073f035320: action 8 queue[DA]:Reg: high activity - starting 1
additional worker thread(s).
7592.687585000:2b073f035320: action 8 queue[DA]:Reg: started with state 0, num
workers now 1
7592.687604000:2b073f035320: action 8 queue: DA queue initialized, disk queue
0x2b0757eff5e0
7592.687615000:2b073f035320: action 8 queue: queue finished initialization
7592.687625000:2b073f035320: Action 0x2b0757efe5a0: queue 0x2b0757efe6b0 created
7592.687666000:2b073f035320: selector line successfully processed
7592.687722000:2b073f035320: requested to include config file
'/etc/rsyslog.d/pickup.conf'
7592.687830000:420bc940: we deleted 0 objects and enqueued 0 objects
7592.687837000:420bc940: delete batch from store, new sizes: log 2, phys 2
7592.687860000:420bc940: strm 0x2b0757f03220: file 8 read 981 bytes
7592.688126000:420bc940: MsgSetTAG in: len 9, pszBuf: rsyslogd:
7592.688138000:420bc940: MsgSetTAG exit: pMsg->iLenTAG 9, pMsg->TAG.szBuf:
rsyslogd:
7592.688175000:420bc940: MsgSetTAG in: len 7, pszBuf: kernel:
7592.688180000:420bc940: MsgSetTAG exit: pMsg->iLenTAG 7, pMsg->TAG.szBuf:
kernel:
7592.688233000:420bc940: XXXXX: tryDoAction 0x2b0757efe5a0, pnElem 2, nElem 2
7592.688241000:420bc940: Action 0x2b0757efe5a0 transitioned to state: itx
7592.688245000:420bc940: entering actionCalldoAction(), state: itx
7592.688269000:420bc940: 10.10.0.254
7592.688312000:420bc940: locking mutObjGlobalOp ...
7592.688317000:420bc940: mutObjGlobalOp locked
7592.688324000:420bc940: caller requested object 'nsd_ptcp', not found (iRet
-3003)
7592.688376000:420bc940: Requested to load module 'lmnsd_ptcp'
7592.688381000:420bc940: locking mutLoadUnload ...
7592.688385000:420bc940: mutLoadUnload locked
7592.688393000:420bc940: loading module '/lib64/rsyslog/lmnsd_ptcp.so'
7592.694962000:2b073f035320: cfline: '$ModLoad imfile'
7592.694975000:2b073f035320: Requested to load module 'imfile'
7592.694980000:2b073f035320: locking mutLoadUnload ...
7592.695623000:420bc940: locking mutObjGlobalOp ...
7592.695630000:420bc940: mutObjGlobalOp locked
7592.695636000:420bc940: mutObjGlobalOp released
7592.695640000:420bc940: locking mutObjGlobalOp ...
7592.695644000:420bc940: mutObjGlobalOp locked
7592.695651000:420bc940: mutObjGlobalOp released
7592.695655000:420bc940: locking mutObjGlobalOp ...
7592.695659000:420bc940: mutObjGlobalOp locked
7592.695665000:420bc940: mutObjGlobalOp released
7592.695669000:420bc940: locking mutObjGlobalOp ...
7592.695673000:420bc940: mutObjGlobalOp locked
7592.695684000:420bc940: source file nsd_ptcp.c requested reference for module
'lmnetstrms', reference count now 3
7592.695689000:420bc940: mutObjGlobalOp released
7592.695694000:420bc940: locking mutObjGlobalOp ...
7592.695698000:420bc940: mutObjGlobalOp locked
7592.695703000:420bc940: mutObjGlobalOp released
7592.695720000:420bc940: locking mutObjGlobalOp ...
7592.695725000:420bc940: mutObjGlobalOp locked
7592.695730000:420bc940: mutObjGlobalOp released
7592.695734000:420bc940: locking mutObjGlobalOp ...
7592.695737000:420bc940: mutObjGlobalOp locked
7592.695742000:420bc940: mutObjGlobalOp released
7592.695747000:420bc940: locking mutObjGlobalOp ...
7592.695751000:420bc940: mutObjGlobalOp locked
7592.695755000:420bc940: mutObjGlobalOp released
7592.695759000:420bc940: locking mutObjGlobalOp ...
7592.695762000:420bc940: mutObjGlobalOp locked
7592.695767000:420bc940: mutObjGlobalOp released
7592.695772000:420bc940: module of type 2 being loaded.
7592.695777000:420bc940: entry point 'isCompatibleWithFeature' not present in
module
7592.695797000:2b073f035320: mutLoadUnload locked
7592.695806000:2b073f035320: loading module '/lib64/rsyslog/imfile.so'
7592.695840000:420bc940: mutLoadUnload released
7592.695862000:420bc940: source file netstrms.c requested reference for module
'lmnsd_ptcp', reference count now 1
7592.695868000:420bc940: mutObjGlobalOp released
7592.695885000:420bc940: locking mutObjGlobalOp ...
7592.695890000:420bc940: mutObjGlobalOp locked
7592.695901000:420bc940: mutObjGlobalOp released
7592.696880000:420bc940: 10.10.0.254:514/tcp
7592.696989000:420bc940: TCP sent 181 bytes, requested 181
7592.696999000:420bc940: Action 0x2b0757efe5a0 transitioned to state: rdy
7592.697004000:420bc940: action 0x2b0757efe5a0 call returned 0
7592.697015000:420bc940: Action 0x2b0757efe5a0 transitioned to state: itx
7592.697143000:420bc940: entering actionCalldoAction(), state: itx
7592.697147000:420bc940: 10.10.0.254
7592.697152000:420bc940: 10.10.0.254:514/tcp
7592.697159000:420bc940: CheckConnection detected broken connection - closing it
7592.697173000:420bc940: locking mutObjGlobalOp ...
7592.697177000:420bc940: mutObjGlobalOp locked
7592.697184000:420bc940: file netstrms.c released module 'lmnsd_ptcp',
reference count now 0
7592.697188000:420bc940: module 'lmnsd_ptcp' has zero reference count,
unloading...
7592.697192000:420bc940: locking mutLoadUnload ...
7592.703794000:2b073f035320: locking mutObjGlobalOp ...
7608.246465000:2b073f035320: DoDie called.
7609.839943000:2b073f035320: DoDie called.
7610.031746000:2b073f035320: DoDie called.
7612.126252000:2b073f035320: DoDie called.
7613.413387000:2b073f035320: DoDie called.
7613.413421000:2b073f035320:
Signal 6 (SIGABRT) occured, execution must be terminated.
7613.413427000:2b073f035320: Mutex log for all known mutex operations:
7613.413431000:2b073f035320: If the call trace is empty, you may want to
./configure --enable-rtinst
7613.413436000:2b073f035320:
To submit bug reports, visit http://www.rsyslog.com/bugs
7613.413448000:2b073f035320:
To submit bug reports, visit http://www.rsyslog.com/bugs
_______________________________________________
rsyslog mailing list
http://lists.adiscon.net/mailman/listinfo/rsyslog
http://www.rsyslog.com
