This rings a bell, not from AOLServer, but from using threaded tcl in general.
I'm sorry it's a bit fuzzy but I seem to recall it happening from some kind of
race condition causing a teardown procedure to happen more than once (and the
second one causes the core dump because all the things it's trying to free are
gone). I was using a threaded tclkit at the time that I saw this a lot and I
think it largely went away when I upgraded to a newer version of tcl, but it's
been a couple years since I dealt with it, so I really don't remember.
If you google "called Tcl_FindHashEntry on deleted table" you will find a LOT
of stuff.
Rusty
On Mar 1, 2012, at 8:08 AM, Porter, Caroline wrote:
> We are shutting down aolserver via the control port using the ns_shutdown
> command. We are getting intermittent coredumps during the shutdown process.
> Does anyone have any ideas as to how to resolve this?
>
> Here’s some more info…
>
> webserver log:
>
> [29/Feb/2012:08:20:02][30350.82082672][-nscp:1-] Notice: nscp: 127.0.0.1
> connected
> [29/Feb/2012:08:20:03][30350.82082672][-nscp:1-] Notice: nscp: nsadmin logged
> in
> [29/Feb/2012:08:20:04][30350.4151592640][-main-] Notice: nsmain:
> AOLserver/4.5.1 stopping
> [29/Feb/2012:08:20:04][30350.4151592640][-main-] Notice: driver: stopping:
> nssock
> [29/Feb/2012:08:20:04][30350.4151592640][-main-] Notice: sched: shutdown
> pending
> [29/Feb/2012:08:20:04][30350.131660656][-socks-] Notice: socks: shutdown
> pending
> [29/Feb/2012:08:20:04][30350.4141099888][-sched-] Notice: sched: shutdown
> started
> [29/Feb/2012:08:20:04][30350.4141099888][-sched-] Notice: sched: waiting for
> event threads...
> [29/Feb/2012:08:20:04][30350.131660656][-socks-] Notice: nscp: shutdown
> [29/Feb/2012:08:20:04][30350.66386800][-sched:idle1-] Notice: exiting
> [29/Feb/2012:08:20:04][30350.148007792][-sched:idle0-] Notice: exiting
> [29/Feb/2012:08:20:04][30350.131660656][-socks-] Notice: socks: shutdown
> complete
> [29/Feb/2012:08:20:04][30350.56376176][-nssock:driver-] Notice: exiting
> [29/Feb/2012:08:20:04][30350.4141099888][-sched-] Notice: sched: shutdown
> complete
> [29/Feb/2012:08:20:04][30350.4151592640][-main-] Notice: driver: stopped:
> nssock
> [29/Feb/2012:08:20:05][30350.82082672][-nscp:1-] Notice: nscp: 127.0.0.1
> disconnected
> [29/Feb/2012:08:20:05][30350.56376176][-shutdown-] Notice: Shutdown called
> for server bwd
> [29/Feb/2012:08:20:05][30350.56376176][-shutdown-] Notice: nslog: closing
> '/data/bwd/logs/httpd_access_stg_delray.bna.com_5000.log'
> [29/Feb/2012:08:20:05][30350.4151592640][-main-] Notice: nsmain:
> AOLserver/4.5.1 exiting
> called Tcl_FindHashEntry on deleted table
>
> Here’s what is in the coredump…
>
> Program terminated with signal 6, Aborted.
> #0 0x0071d430 in __kernel_vsyscall ()
> #0 0x0071d430 in __kernel_vsyscall ()
> #1 0x0036ab71 in raise (sig=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:64
> #2 0x0036c44a in abort () at abort.c:92
> #3 0x002e8ddf in Tcl_PanicVA () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #4 0x002e8e04 in Tcl_Panic () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #5 0x002bccea in BogusFind () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #6 0x00304de1 in ThreadStorageGetHashTable () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #7 0x00304f0c in TclpThreadDataKeyGet () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #8 0x00303d28 in Tcl_GetThreadData () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #9 0x002e8545 in TclFreeObj () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #10 0x0030f8b0 in FreeVarEntry () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #11 0x002bc845 in Tcl_DeleteHashTable () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #12 0x0031052e in UnsetVarStruct () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #13 0x0031080f in TclDeleteNamespaceVars () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #14 0x002dfda8 in TclTeardownNamespace () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #15 0x002e0045 in Tcl_DeleteNamespace () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #16 0x002dfeab in TclTeardownNamespace () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #17 0x002e0045 in Tcl_DeleteNamespace () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #18 0x002dfeab in TclTeardownNamespace () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #19 0x002647a7 in DeleteInterpProc () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #20 0x002f47a4 in Tcl_EventuallyFree () from
> /apps/bos-dev/bwd/lib/libtcl8.5.so
> #21 0x00264702 in Tcl_DeleteInterp () from /apps/bos-dev/bwd/lib/libtcl8.5.so
> #22 0x0014dd2f in Ns_TclDestroyInterp () from /apps/bos-dev/bwd/lib/libnsd.so
> #23 0x0014e508 in DeleteData () from /apps/bos-dev/bwd/lib/libnsd.so
> #24 0x00ca6479 in NsCleanupTls () from /apps/bos-dev/bwd/lib/libnsthread.so
> #25 0x00ca81e2 in FreeThread () from /apps/bos-dev/bwd/lib/libnsthread.so
> #26 0x00174a8a in __nptl_deallocate_tsd (arg=0x4e47b70) at
> pthread_create.c:154
> #27 start_thread (arg=0x4e47b70) at pthread_create.c:308
> #28 0x0041cc2e in clone () at ../sysdeps/unix/sysv/linux/i386/clone.S:133
>
>
>
> ------------------------------------------------------------------------------
> Virtualization & Cloud Management Using Capacity Planning
> Cloud computing makes use of virtualization - but cloud computing
> also focuses on allowing computing to be delivered as a service.
> http://www.accelacomm.com/jaw/sfnl/114/51521223/_______________________________________________
> aolserver-talk mailing list
> aolserver-talk@lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/aolserver-talk
------------------------------------------------------------------------------
Virtualization & Cloud Management Using Capacity Planning
Cloud computing makes use of virtualization - but cloud computing
also focuses on allowing computing to be delivered as a service.
http://www.accelacomm.com/jaw/sfnl/114/51521223/
_______________________________________________
aolserver-talk mailing list
aolserver-talk@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/aolserver-talk
