[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-07-12 Thread Zhao Yongming (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063760#comment-13063760
 ] 

Zhao Yongming commented on TS-833:
--

we have testing the patch in trunk for 24hours without any crash, I'd like 
conclude that we have fix the issue. I will call for more testing.

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Fix For: 3.1.0

 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
  Saved registers:
   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
 (gdb) p this-handler
 $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
 {code}

--

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-21 Thread Zhao Yongming (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13053038#comment-13053038
 ] 

Zhao Yongming commented on TS-833:
--

John:
I got the case you comment on 17/Jun/11 22:07, the gdb shows:

{code}

[New process 12674]
#0  0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
752 if (e-once_written_flag)
(gdb) bt
#0  0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
#1  0x00643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, 
len=159) at DNS.cc:1170
#2  0x00645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, 
e=0x18e7df50) at DNS.cc:690
#3  0x0064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, 
e=0x18e7df50) at DNS.cc:703
#4  0x004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, 
data=0x18e7df50) at I_Continuation.h:146
#5  0x006f9978 in EThread::process_event (this=0x2ae29010, 
e=0x18e7df50, calling_code=5) at UnixEThread.cc:140
#6  0x006f9e96 in EThread::execute (this=0x2ae29010) at 
UnixEThread.cc:262
#7  0x004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958
(gdb) print e
$1 = (DNSEntry *) 0xefbeaddeefbeadde
(gdb) print h-in_flight
$2 = 4
(gdb) 
{code}

and the traffic.out looks
{code}
[TrafficServer] using root directory '/usr'
[Jun 20 10:47:48.118] Manager {47791815218176} NOTE: 
[LocalManager::pollMgmtProcessServer] New process connecting fd '9'
[Jun 20 10:47:48.118] Manager {47791815218176} NOTE: [Alarms::signalAlarm] 
Server Process born
[Jun 20 10:47:49.141] {47286116713584} STATUS: opened 
/var/log/trafficserver/diags.log
[Jun 20 10:47:49.142] {47286116713584} NOTE: updated diags config
[Jun 20 10:47:49.146] Server {47286116713584} NOTE: cache clustering disabled
[Jun 20 10:47:49.169] Server {47286116713584} NOTE: cache clustering disabled
[Jun 20 10:47:49.639] Server {47286116713584} NOTE: logging initialized[7], 
logging_mode = 3
[Jun 20 10:47:49.680] Server {47286116713584} NOTE: traffic server running
[Jun 20 10:47:49.735] Server {1099794752} WARNING: failover: connection to DNS 
server 127.0.0.1 lost, move to 121.14.89.156
[Jun 20 10:47:50.243] Server {1124858176} WARNING: Access logging to local log 
directory suspended - configured space allocation exhausted.
[Jun 20 10:47:55.446] Server {47286116713584} NOTE: cache enabled
[Jun 20 10:47:56.001] Server {47286116713584} NOTE: [log-coll] host up 
[121.14.89.156:8085]
[Jun 21 00:00:00.001] Server {1124858176} STATUS: The logfile 
/var/log/trafficserver/error.log was rolled to 
/var/log/trafficserver/error.log_cache174.cn62.20110620.10h47m49s-20110621.00h00m00s.old.
[Jun 21 00:00:05.001] Server {1124858176} STATUS: The rolled logfile, 
/var/log/trafficserver/error.log_cache174.cn62.20110620.10h47m49s-20110621.00h00m00s.old,
 was auto-deleted; 0 bytes were reclaimed.
NOTE: Traffic Server received Sig 11: Segmentation fault
/usr/bin/traffic_server - STACK TRACE: 
/usr/bin/traffic_server[0x51ba3e]
/lib64/libpthread.so.0[0x36af20e7c0]
[0x2aaab015ac70]
/usr/bin/traffic_server(_ZN10DNSHandler8recv_dnsEiP5Event+0x6a0)[0x645cfc]
/usr/bin/traffic_server(_ZN10DNSHandler9mainEventEiP5Event+0x39)[0x64655f]
/usr/bin/traffic_server(_ZN12Continuation11handleEventEiPv+0x6f)[0x4d302f]
/usr/bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0x11e)[0x6f9978]
/usr/bin/traffic_server(_ZN7EThread7executeEv+0x3c0)[0x6f9e96]
/usr/bin/traffic_server(main+0x10c7)[0x4ff74d]
/lib64/libc.so.6(__libc_start_main+0xf4)[0x36ae61d994]
/usr/bin/traffic_server(__gxx_personality_v0+0x491)[0x4b2149]
/usr/bin/traffic_server(__gxx_personality_v0+0x491)[0x4b2149]
[Jun 21 01:02:34.760] Manager {47791815218176} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Jun 21 01:02:36.778] Manager {47791815218176} FATAL:  (last system error 104: 
Connection reset by peer)
[Jun 21 01:02:36.778] Manager {47791815218176} NOTE: 
[LocalManager::mgmtShutdown] Executing shutdown request.
[Jun 21 01:02:36.778] Manager {47791815218176} NOTE: 
[LocalManager::processShutdown] Executing process shutdown request.
[Jun 21 01:02:36.784] Manager {47791815218176} ERROR: 
[LocalManager::sendMgmtMsgToProcesses] Error writing message
[Jun 21 01:02:36.785] Manager {47791815218176} ERROR:  (last system error 32: 
Broken pipe)
[E. Mgmt] log == [TrafficManager] using root directory '/usr'
[Jun 21 01:02:40.791] {46942772802560} NOTE: updated diags config
[Jun 21 01:02:51.503] Manager {46942772802560} NOTE: [ClusterCom::ClusterCom] 
Node running on OS: 'Linux' Release: '2.6.18-164.11.1.el5'
[Jun 21 01:02:51.531] Manager {46942772802560} NOTE: 
[LocalManager::listenForProxy] Listening on port: 8080
[Jun 21 01:02:51.531] Manager {46942772802560} NOTE: 
[LocalManager::listenForProxy] Listening on port: 80
[Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [TrafficManager] Setup 
complete
[Jun 21 01:02:52.594] Manager 

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-20 Thread mohan_zl (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13052302#comment-13052302
 ] 

mohan_zl commented on TS-833:
-

{code}
#0  0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
752 if (e-once_written_flag)
(gdb) bt
#0  0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752
#1  0x00643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, 
len=159) at DNS.cc:1170
#2  0x00645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, 
e=0x18e7df50) at DNS.cc:690
#3  0x0064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, 
e=0x18e7df50) at DNS.cc:703
#4  0x004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, 
data=0x18e7df50) at I_Continuation.h:146
#5  0x006f9978 in EThread::process_event (this=0x2ae29010, 
e=0x18e7df50, calling_code=5) at UnixEThread.cc:140
#6  0x006f9e96 in EThread::execute (this=0x2ae29010) at 
UnixEThread.cc:262
#7  0x004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958
(gdb) info f
Stack level 0, frame at 0x7fff214382c0:
 rip = 0x63f9f5 in get_dns (DNS.cc:752); saved rip 0x643e33
 called by frame at 0x7fff214390a0
 source language c++.
 Arglist at 0x7fff214382b0, args: h=0x18ea3070, id=27816
 Locals at 0x7fff214382b0, Previous frame's sp is 0x7fff214382c0
 Saved registers:
  rbp at 0x7fff214382b0, rip at 0x7fff214382b8
(gdb) info args
h = (DNSHandler *) 0x18ea3070
id = 27816
(gdb) p h
$1 = (DNSHandler *) 0x18ea3070
(gdb) p h-handler_name
$2 = 0x755f55 DNSHandler::mainEvent
{code}

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Fix For: 3.1.0

 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-19 Thread mohan_zl (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051784#comment-13051784
 ] 

mohan_zl commented on TS-833:
-

By the way, now we found an interesting problem, we use 20 machines for 
testing, and each node use single mode. We found if the nodes have run for a 
while, then some machine have a very very low qps, but not crash, and if one 
node crashed, then when it restart, it can run well as before. I think maybe 
this problem is not caused by cache, but the proxy or net module.

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Fix For: 3.1.0

 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-17 Thread Zhao Yongming (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050947#comment-13050947
 ] 

Zhao Yongming commented on TS-833:
--

we have got another rare Seg Fault, not sure if it is this bug related, here is 
the stack trace:

traffic.out:
{code}
NOTE: Traffic Server received Sig 11: Segmentation fault
/usr/bin/traffic_server - STACK TRACE:
/usr/bin/traffic_server[0x51ba3e]
/lib64/libpthread.so.0[0x30ec20e7c0]
[0x122802e65b371fd0]
/usr/bin/traffic_server(DNSEntry::mainEvent(int, Event*)+0x595)[0x643b65]
/usr/bin/traffic_server(Continuation::handleEvent(int, void*)+0x6f)[0x4d302f]
/usr/bin/traffic_server(DNSProcessor::getby(char const*, int, int, 
Continuation*, DNSHandler*, int)+0x250)[0x641472]
/usr/bin/traffic_server(DNSProcessor::gethostbyname(Continuation*, char const*, 
DNSHandler*, int)+0x47)[0x6378c7]
/usr/bin/traffic_server(HostDBContinuation::do_dns()+0x2b9)[0x630125]
/usr/bin/traffic_server(HostDBContinuation::probeEvent(int, 
Event*)+0x341)[0x6313b3]
/usr/bin/traffic_server(Continuation::handleEvent(int, void*)+0x6f)[0x4d302f]
/usr/bin/traffic_server(EThread::process_event(Event*, int)+0x11e)[0x6f9978]
/usr/bin/traffic_server(EThread::execute()+0x1e4)[0x6f9cba]
/usr/bin/traffic_server[0x6f92c9]
/lib64/libpthread.so.0[0x30ec2064a7]
/lib64/libc.so.6(clone+0x6d)[0x30eb6d3c2d]
/lib64/libc.so.6(clone+0x6d)[0x30eb6d3c2d]
[Jun 17 16:22:52.570] Manager {47840561255424} FATAL: 
[LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
{code}

gdb:
{code}
(gdb) bt
#0  0x006424b0 in write_dns_event (h=0x1e3c1fb0, e=0x2aaab006a690) at 
DNS.cc:898
#1  0x006427b6 in write_dns (h=0x1e3c1fb0) at DNS.cc:804
#2  0x00643b65 in DNSEntry::mainEvent (this=0x2aaab006ba50, event=1, 
e=0x0) at DNS.cc:965
#3  0x004d302f in Continuation::handleEvent (this=0x2aaab006ba50, 
event=1, data=0x0) at I_Continuation.h:146
#4  0x00641472 in DNSProcessor::getby (this=0xac22e0, x=0x1e3dda14 
img04.taobaocdn.com, len=0, type=1, cont=0x1e3dd960, adnsH=0x0, timeout=0)
at DNS.cc:999
#5  0x006378c7 in DNSProcessor::gethostbyname (this=0xac22e0, 
cont=0x1e3dd960, name=0x1e3dda14 img04.taobaocdn.com, adnsH=0x0, timeout=0)
at I_DNSProcessor.h:123
#6  0x00630125 in HostDBContinuation::do_dns (this=0x1e3dd960) at 
HostDB.cc:1771
#7  0x006313b3 in HostDBContinuation::probeEvent (this=0x1e3dd960, 
event=2, e=0x215c9980) at HostDB.cc:1696
#8  0x004d302f in Continuation::handleEvent (this=0x1e3dd960, event=2, 
data=0x215c9980) at I_Continuation.h:146
#9  0x006f9978 in EThread::process_event (this=0x2af2a010, 
e=0x215c9980, calling_code=2) at UnixEThread.cc:140
#10 0x006f9cba in EThread::execute (this=0x2af2a010) at 
UnixEThread.cc:217
#11 0x006f92c9 in spawn_thread_internal (a=0x1e393b40) at Thread.cc:88
#12 0x0030ec2064a7 in start_thread () from /lib64/libpthread.so.0
#13 0x0030eb6d3c2d in clone () from /lib64/libc.so.6
(gdb) info f
Stack level 0, frame at 0x40ee0a70:
 rip = 0x6424b0 in write_dns_event (DNS.cc:898); saved rip 0x6427b6
 called by frame at 0x40ee0ac0
 source language c++.
 Arglist at 0x40ee0a60, args: h=0x1e3c1fb0, e=0x2aaab006a690
 Locals at 0x40ee0a60, Previous frame's sp is 0x40ee0a70
 Saved registers:
  rbx at 0x40ee0a48, rbp at 0x40ee0a60, r12 at 0x40ee0a50, r13 at 0x40ee0a58, 
rip at 0x40ee0a68

{code}

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-16 Thread John Plevyak (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050620#comment-13050620
 ] 

John Plevyak commented on TS-833:
-

mohan_zl, this latest crash is with TS-833-3.diff ??

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
  Saved registers:
   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
 (gdb) p this-handler
 $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
 {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-16 Thread mohan_zl (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050836#comment-13050836
 ] 

mohan_zl commented on TS-833:
-

@John yeah, i use TS-833-3.diff with the latest trunk.

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
  Saved registers:
   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
 (gdb) p this-handler
 $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
 {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

  

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-16 Thread mohan_zl (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050861#comment-13050861
 ] 

mohan_zl commented on TS-833:
-

@John, is there any possibilities that these problem is caused by some deep bug?

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
  Saved registers:
   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
 (gdb) p this-handler
 $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
 {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: 

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-15 Thread mohan_zl (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050173#comment-13050173
 ] 

mohan_zl commented on TS-833:
-

{quote}

#0  0x004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, 
data=0xdb212d0) at I_Continuation.h:146
146 return (this-*handler) (event, data);
(gdb) bt
#0  0x004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, 
data=0xdb212d0) at I_Continuation.h:146
#1  0x006f58c8 in EThread::process_event (this=0x2ae29010, 
e=0xdb212d0, calling_code=2) at UnixEThread.cc:140
#2  0x006f5c0a in EThread::execute (this=0x2ae29010) at 
UnixEThread.cc:217
#3  0x004ff37d in main (argc=3, argv=0x7fff0e981f48) at Main.cc:1958
(gdb) x/40x this
0xda48180:  0x0da477a1  0x  0xefbeadde  0xefbeadde
0xda48190:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda481a0:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda481b0:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda481c0:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda481d0:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda481e0:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda481f0:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda48200:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
0xda48210:  0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
(gdb) info f
Stack level 0, frame at 0x7fff0e981860:
 rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
(I_Continuation.h:146); saved rip 0x6f58c8
 called by frame at 0x7fff0e9818d0
 source language c++.
 Arglist at 0x7fff0e981850, args: this=0xda48180, event=2, data=0xdb212d0
 Locals at 0x7fff0e981850, Previous frame's sp is 0x7fff0e981860
 Saved registers:
  rbp at 0x7fff0e981850, rip at 0x7fff0e981858
(gdb) info args
this = (Continuation * const) 0xda48180
event = 2
data = (void *) 0xdb212d0
(gdb) p this-handler_name
$1 = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds
(gdb) p *this
$2 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0xda477a1}, handler = 
0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
  handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, 
mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = {
  next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
{quote}

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  

[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-15 Thread mohan_zl (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050174#comment-13050174
 ] 

mohan_zl commented on TS-833:
-

@John I think this bug has not been fixed yet.

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist
 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff


 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
  Saved registers:
   rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8
 (gdb) p this-handler
 $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338
 {code}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related

2011-06-13 Thread John Plevyak (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13048750#comment-13048750
 ] 

John Plevyak commented on TS-833:
-

I have a theory about this, but I am not sure why the problem has only manifest 
now as it seems to have been in the codebase for a while.  The theory is that 
the vc_next is bad because it has been closed as a result of the inactivity 
callback.   This could be checked by walking down nh-open_list in the debugger 
(or code) to see if next_vc is in the list.

 Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, 
 ink_freelist_free related
 ---

 Key: TS-833
 URL: https://issues.apache.org/jira/browse/TS-833
 Project: Traffic Server
  Issue Type: Bug
  Components: Core
Affects Versions: 3.1.0
 Environment: current trunk, with --enable-debug
Reporter: Zhao Yongming
  Labels: freelist

 bt #1
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x19581df0, 
 event=2, data=0x197c4fc0) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff76c40e40:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff76c40eb0
  source language c++.
  Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0
  Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40
  Saved registers:
   rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38
 (gdb) x/40x this
 0x19581df0: 0x19581901  0x  0xefbeadde  0xefbeadde
 0x19581e00: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e10: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e20: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e30: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e40: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e50: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e60: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e70: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 0x19581e80: 0xefbeadde  0xefbeadde  0xefbeadde  0xefbeadde
 {code}
 bt #2
 {code}
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, 
 data=0xc4408a0) at I_Continuation.h:146
 #1  0x0070364c in EThread::process_event (this=0x2ae29010, 
 e=0xc4408a0, calling_code=2) at UnixEThread.cc:140
 #2  0x0070398e in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961
 (gdb) p *this
 $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, 
 handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, 
   handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of 
 bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation 
 = {
   next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}}
 (gdb) 
 {code}
 bt #3
 {code}
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 146 return (this-*handler) (event, data);
 (gdb) bt
 #0  0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, 
 event=2, data=0x2aaab00d1570) at I_Continuation.h:146
 #1  0x006f5830 in EThread::process_event (this=0x2ae29010, 
 e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140
 #2  0x006f5b72 in EThread::execute (this=0x2ae29010) at 
 UnixEThread.cc:217
 #3  0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958
 (gdb) info f
 Stack level 0, frame at 0x7fff421f01f0:
  rip = 0x4d2c5c in Continuation::handleEvent(int, void*) 
 (I_Continuation.h:146); saved rip 0x6f5830
  called by frame at 0x7fff421f0260
  source language c++.
  Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, 
 data=0x2aaab00d1570
  Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0
  Saved registers:
   rbp at 0x7fff421f01e0,