[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255340#comment-14255340 ] Qiang Li commented on TS-3248: -- it wroks will :) 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.3.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255013#comment-14255013 ] bettydramit commented on TS-3248: - With this patch,it has been running in production with no crashes for over 24 hours. 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255021#comment-14255021 ] ASF subversion and git services commented on TS-3248: - Commit 9115cb6d4716ada0c66d5b6970d2674592cb2355 in trafficserver's branch refs/heads/master from [~sudheerv] [ https://git-wip-us.apache.org/repos/asf?p=trafficserver.git;h=9115cb6 ] [TS-3248]: Fix with Susan's help to resolve crash introduced in TS-3189 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255023#comment-14255023 ] bettydramit commented on TS-3248: - Perfect! 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.3.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14255025#comment-14255025 ] bettydramit commented on TS-3248: - Good job 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.3.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253540#comment-14253540 ] Sudheer Vinukonda commented on TS-3248: --- Debugged this further and it looks to me that this may be caused by TS-3189 (a34bebbe5bf432c9d27052a31c68dadef46e32c7). The changes in TS-3189 call {{do_io_read}} with NULL MIOBuffer, which would result in clearing the writer {{read.vio.buffer}}. Testing now by reverting this commit - don't see the core dump so far. Will monitor further and update. 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253799#comment-14253799 ] Sudheer Vinukonda commented on TS-3248: --- Discussed with [~shinrich] on the IRC and trying a fix for the crash with the below diff: {code} diff --git a/proxy/http/HttpSM.cc b/proxy/http/HttpSM.cc index 5f07f8c..c8a011d 100644 --- a/proxy/http/HttpSM.cc +++ b/proxy/http/HttpSM.cc @@ -575,7 +575,7 @@ HttpSM::attach_client_session(HttpClientSession * client_vc, IOBufferReader * bu // this hook maybe asynchronous, we need to disable IO on // client but set the continuation to be the state machine // so if we get an timeout events the sm handles them - ua_entry-read_vio = client_vc-do_io_read(this, 0, NULL); + ua_entry-read_vio = client_vc-do_io_read(this, 0, buffer_reader-mbuf); / // set up timeouts // {code} 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253862#comment-14253862 ] Sudheer Vinukonda commented on TS-3248: --- The above patch didn't seem to help. So, trying a new patch as below: {code} diff --git a/proxy/http/HttpSM.cc b/proxy/http/HttpSM.cc index 5f07f8c..e88ed43 100644 --- a/proxy/http/HttpSM.cc +++ b/proxy/http/HttpSM.cc @@ -575,7 +575,7 @@ HttpSM::attach_client_session(HttpClientSession * client_vc, IOBufferReader * bu // this hook maybe asynchronous, we need to disable IO on // client but set the continuation to be the state machine // so if we get an timeout events the sm handles them - ua_entry-read_vio = client_vc-do_io_read(this, 0, NULL); + ua_entry-read_vio = client_vc-do_io_read(this, 0, buffer_reader-mbuf); / // set up timeouts // @@ -1989,6 +1989,10 @@ HttpSM::state_send_server_request_header(int event, void *data) handle_server_setup_error(event, data); break; + case VC_EVENT_READ_COMPLETE: +// new event expected due to TS-3189 +break; + default: ink_release_assert(0); break; @@ -5658,7 +5662,7 @@ HttpSM::attach_server_session(HttpServerSession * s) // first tunnel instead of the producer of the second tunnel. // The real read is setup in setup_server_read_response_header() // - server_entry-read_vio = server_session-do_io_read(this, 0, NULL); + server_entry-read_vio = server_session-do_io_read(this, 0, server_session-read_buffer); // Transfer control of the write side as well server_session-do_io_write(this, 0, NULL); {code} 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14253991#comment-14253991 ] Sudheer Vinukonda commented on TS-3248: --- The above patch looks good, no crashes so far. 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14254394#comment-14254394 ] Qiang Li commented on TS-3248: -- thank you, i will test the above patch :) 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14254436#comment-14254436 ] Sudheer Vinukonda commented on TS-3248: --- Thanks, [~tufang14] - that would be great! 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14251885#comment-14251885 ] Sudheer Vinukonda commented on TS-3248: --- I wonder if the fix for TS-3226 would address this (3c1aee78b46282f91e7f92369a2ff3231304117c). 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Reporter: Qiang Li Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252143#comment-14252143 ] Sudheer Vinukonda commented on TS-3248: --- I am seeing this core (both via UnixNetVConnection.cc and SSLNetVConnection.cc) also in 5.2 on our cache production hosts and it seems to happen with/without the fix in TS-3226. {code} (gdb) bt full #0 0x004ee4b4 in PtrIOBufferBlock::operator IOBufferBlock* (this=0x10) at ../lib/ts/Ptr.h:326 No locals. #1 0x0052a190 in MIOBuffer::first_write_block (this=0x0) at ../iocore/eventsystem/I_IOBuffer.h:920 No locals. #2 0x0073cba4 in ssl_read_from_net (sslvc=0x2b3bdc018790, lthread=0x2b3b71448010, ret=@0x2b3b72d5fb40) at SSLNetVConnection.cc:184 s = 0x2b3bdc0188a0 buf = @0x2b3bdc0188c8 bytes_read = 8192 block_write_avail = 0 __func__ = ssl_read_from_net b = 0x2b3b72d5fab0 event = 11068 sslErr = 11067 nread = 47537243037472 #3 0x0073dd28 in SSLNetVConnection::net_read_io (this=0x2b3bdc018790, nh=0x2b3b7144bad0, lthread=0x2b3b71448010) at SSLNetVConnection.cc:547 ret = 0 bytes = 0 s = 0x2b3bdc0188a0 __func__ = net_read_io buf = @0x2b3bdc0188c8 r = 0 lock = {m = {m_ptr = 0x2be4930}, lock_acquired = true} ntodo = 9223372036854775807 #4 0x0074c429 in NetHandler::mainNetEvent (this=0x2b3b7144bad0, event=5, e=0x2710130) at UnixNet.cc:399 epd = 0x2b3bdc0189a0 pd = 0x2b3b7810 __func__ = mainNetEvent poll_timeout = 10 vc = 0x2b3bdc018790 #5 0x00502eae in Continuation::handleEvent (this=0x2b3b7144bad0, event=5, data=0x2710130) at ../iocore/eventsystem/I_Continuation.h:146 No locals. #6 0x00773062 in EThread::process_event (this=0x2b3b71448010, e=0x2710130, calling_code=5) at UnixEThread.cc:144 c_temp = 0x2b3b7144bad0 lock = {m = {m_ptr = 0x2be5510}, lock_acquired = true} #7 0x0077356c in EThread::execute (this=0x2b3b71448010) at UnixEThread.cc:268 done_one = false e = 0x2710130 NegativeQueue = {DLLEvent, Event::Link_link = {head = 0x0}, tail = 0x0} next_time = 1418930647029084374 #8 0x0077261d in spawn_thread_internal (a=0x2ca60e0) at Thread.cc:88 p = 0x2ca60e0 #9 0x2b3ac42ed851 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #10 0x003296ee890d in clone () from /lib64/libc.so.6 No symbol table info available. {code} 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Reporter: Qiang Li Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252580#comment-14252580 ] Leif Hedstrom commented on TS-3248: --- Is this new in v5.2.0, or in older versions too ? 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Reporter: Qiang Li Fix For: 5.3.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252581#comment-14252581 ] Leif Hedstrom commented on TS-3248: --- Sudheer: Please make a judgement call if this is a show stopper for v5.2.0. 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Reporter: Qiang Li Assignee: Sudheer Vinukonda Labels: crash Fix For: 5.3.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252621#comment-14252621 ] Sudheer Vinukonda commented on TS-3248: --- Hi [~zwoop] - unfortunately, this looks like a blocker for v5.2.0. I saw this every few min on our production host in the short duration I ran 5.2.0 for. 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Labels: crash Fix For: 5.3.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252723#comment-14252723 ] Qiang Li commented on TS-3248: -- i just find this in 5.2.0, and i will test the pacth in TS-3226 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (TS-3248) 5.2.0 Segmentation fault
[ https://issues.apache.org/jira/browse/TS-3248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14252748#comment-14252748 ] Sudheer Vinukonda commented on TS-3248: --- Analyzing the core further, it seems that the {{buf.writer()}} is not null {{https://github.com/apache/trafficserver/blob/5.2.x/iocore/net/UnixNetVConnection.cc#L235}}, but becomes null in {{https://github.com/apache/trafficserver/blob/5.2.x/iocore/net/UnixNetVConnection.cc#L244}}, which makes me wonder if some other thread is corrupting/modifying the {{buf.writer()}}. 5.2.0 Segmentation fault Key: TS-3248 URL: https://issues.apache.org/jira/browse/TS-3248 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 5.2.0 Reporter: Qiang Li Assignee: Sudheer Vinukonda Priority: Blocker Labels: crash Fix For: 5.2.0 Segmentation fault sometime {code} (gdb) bt #0 0x0073334a in operator IOBufferBlock* (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../lib/ts/Ptr.h:326 #1 first_write_block (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at ../../iocore/eventsystem/I_IOBuffer.h:920 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 #3 0x00727a62 in NetHandler::mainNetEvent (this=0x2b4d9e1e8b50, event=value optimized out, e=value optimized out) at UnixNet.cc:399 #4 0x007538f5 in handleEvent (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at I_Continuation.h:146 #5 EThread::process_event (this=0x2b4d9e1e5010, e=0x2b4d9f806d80, calling_code=5) at UnixEThread.cc:144 #6 0x0075404b in EThread::execute (this=0x2b4d9e1e5010) at UnixEThread.cc:268 #7 0x00752d3a in spawn_thread_internal (a=0x157a1b0) at Thread.cc:88 #8 0x2b4d9b0fa9d1 in start_thread () from /lib64/libpthread.so.0 #9 0x2b4d9c0f19dd in clone () from /lib64/libc.so.6 (gdb) f 2 #2 read_from_net (nh=0x2b4d9e1e8b50, vc=0x2aaac4d0, thread=0x2b4d9e1e5010) at UnixNetVConnection.cc:244 244 IOBufferBlock *b = buf.writer()-first_write_block(); (gdb) l 239 // read data 240 int64_t rattempted = 0, total_read = 0; 241 int niov = 0; 242 IOVec tiovec[NET_MAX_IOV]; 243 if (toread) { 244 IOBufferBlock *b = buf.writer()-first_write_block(); 245 do { 246 niov = 0; 247 rattempted = 0; 248 while (b niov NET_MAX_IOV) { (gdb) p buf $1 = (MIOBufferAccessor ) @0x2aaac608: {mbuf = 0x0, entry = 0x0} (gdb) p toread $2 = 7768 (gdb) {code} at line 244 ,mbuf = 0x0, so buf.writer() return NULL -- This message was sent by Atlassian JIRA (v6.3.4#6332)