Kingsley Foreman wrote:
I've been getting some crashes in squid, anything ranging from 1 per day to
about 5
So far I have this information.
From debugging cache.log i've replaced the url's with ......
<snip>
2010/01/28 22:35:08.202| comm_calliocallback: 0
2010/01/28 22:35:08.202| commio_call_callback: called for 20
2010/01/28 22:35:08.202| client_side.cc(1299) clientWriteBodyComplete schedules
clientWriteComplete
2010/01/28 22:35:08.202| clientWriteComplete: FD 20, sz 1878, err 0, off
1159773875, len 0x7f7d1d8afa50
2010/01/28 22:35:08.202| client_side_reply.cc(944) storeOKTransferDone
out.offset=1159773605 objectLen()=1159773870 headers_sz=265
2010/01/28 22:35:08.202| clientReplyStatus: transfer is DONE
2010/01/28 22:35:08.202| clientReplyStatus: stream was not expected to complete!
2010/01/28 22:35:08.202| client_side.cc(1566) initiateClose: closing for
STREAM_UNPLANNED_COMPLETE|STREAM_FAILED
2010/01/28 22:35:08.202| comm_close: FD 20
2010/01/28 22:35:08.202| commSetTimeout: FD 20 timeout -1
2010/01/28 22:35:08.202| commio_complete_callback: called for 20 (-10, 11)
2010/01/28 22:35:08.202| commio_call_callback: called for 20
2010/01/28 22:35:08.202| client_side.cc(2541) clientReadRequest FD 20 size 0
2010/01/28 22:35:08.202| commCallCloseHandlers: FD 20
2010/01/28 22:35:08.202| commCallCloseHandlers: ch->handler=1 data=0xbcb1c8
2010/01/28 22:35:08.202| ConnStateData::close: FD 20
2010/01/28 22:35:08.202| clientStreamDetach: Detaching node 0xbdbf68
2010/01/28 22:35:08.202| Freeing clientStreamNode 0xbdbf68
2010/01/28 22:35:08.202| clientStreamDetach: Calling 1 with cbdata
0x7f7d1efd8620
2010/01/28 22:35:08.202| clientStreamDetach: Detaching node 0xbdbee8
2010/01/28 22:35:08.202| Freeing clientStreamNode 0xbdbee8
2010/01/28 22:35:08.202| storeUnregister: called for
'239DA444F4446A2B976F900A9B348824'
2010/01/28 22:35:08.202| storePendingNClients: returning 0
2010/01/28 22:35:08.202| StoreEntry::unlock: key
'239DA444F4446A2B976F900A9B348824' count=1
2010/01/28 22:35:08.202| httpRequestFree: http://.....
2010/01/28 22:35:08.203| ACLChecklist::~ACLChecklist: destroyed 0xbe7dc8
2010/01/28 22:35:08.203| cleaning hdr: 0x2530eae0 owner: 3
2010/01/28 22:35:08.203| cleaning hdr: 0x2530eae0 owner: 3
2010/01/28 22:35:08.203| StoreEntry::unlock: key
'239DA444F4446A2B976F900A9B348824' count=0
2010/01/28 22:35:08.203| storePendingNClients: returning 0
2010/01/28 22:35:08.203| UFSSwapDir::dereference: referencing 0x7f7d1d8afa50
1/4125
2010/01/28 22:35:08.203| HeapKeyGen_StoreEntry_LRU:
239DA444F4446A2B976F900A9B348824 heap_age=1.00 lastref=1264672683.00
2010/01/28 22:35:08.203| HeapKeyGen_StoreEntry_LRU: url=http://.........
2010/01/28 22:35:08.203| StoreEntry::purgeMem: Freeing memory-copy of
239DA444F4446A2B976F900A9B348824
2010/01/28 22:35:08.203| store.cc(378) destroyMemObject 0x1d3a9b10
2010/01/28 22:35:08.203| MemObject.cc(97) del MemObject 0x1d3a9b10
________________________________________________________________________________________
And a coredump
Yay!
<snip>
Core was generated by `/usr/sbin/squid -NCd1 -f /etc/squid/squid-fe-8084.conf'.
Program terminated with signal 11, Segmentation fault.
#0 0x00000000004b2170 in ?? ()
(gdb) bt
#0 0x00000000004b2170 in ?? ()
#1 0x00000000004b2197 in ?? ()
#2 0x00000000004b2197 in ?? ()
#3 0x00000000004b2197 in ?? ()
#4 0x00000000004b2197 in ?? ()
#5 0x00000000004b2197 in ?? ()
#6 0x00000000004b2197 in ?? ()
#7 0x00000000004b2197 in ?? ()
#8 0x00000000004b2197 in ?? ()
#9 0x00000000004b2197 in ?? ()
#10 0x00000000004b2197 in ?? ()
<snip>
Oh fudge. Absolutely useless.
Does look to be a very deep recursion problem somewhere though..
Any suggestions would be great
Kingsley
Step 1) will be to build or get a binary of Squid which includes both
the core dumping and debug symbols. Run that through at least one crash
to get a usable core.
Then the stack trace in the core will provide info to use for step (2).
http://wiki.squid-cache.org/SquidFaq/BugReporting
Amos
--
Please be using
Current Stable Squid 2.7.STABLE7 or 3.0.STABLE21
Current Beta Squid 3.1.0.15
