[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-09-03 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14729021#comment-14729021
 ] 

Susan Hinrichs commented on TS-3486:


Should be fine.  The change of the server_session_sharing_pool from overridable 
to not was a clean up side-effect of the great server_session_sharing 
specification debate (specifically TS-3712).  

For this crash fix, we need to determine the whether the pool is global or per 
thread.  That it is read from the override config in 5.3 is not a big issue as 
long as we are reading it from the correct location for the build.

> Segfault in do_io_write with plugin (??)
> 
>
> Key: TS-3486
> URL: https://issues.apache.org/jira/browse/TS-3486
> Project: Traffic Server
>  Issue Type: Bug
>Affects Versions: 5.2.0, 5.3.0
>Reporter: Qiang Li
>Assignee: Susan Hinrichs
>  Labels: crash
> Fix For: 5.3.2, 6.0.0
>
> Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
> ts3486-ptrace.txt.gz
>
>
> {code}
> (gdb) bt
> #0  0x005bdb8b in HttpServerSession::do_io_write (this= optimized out>, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
> at HttpServerSession.cc:104
> #1  0x005acc1d in HttpSM::setup_server_send_request 
> (this=0x2aaadccc4bf0) at HttpSM.cc:5686
> #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1520
> #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
> #6  0x2ba118441c89 in cachefun (contp=, event= optimized out>, edata=0x2aaadccc4bf0) at main.cpp:1876
> #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=, data=) at HttpSM.cc:1381
> #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
> raw=) at HttpSM.cc:4639
> #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:7021
> #10 0x005b25a3 in HttpSM::state_cache_open_write 
> (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
> #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
> event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
> #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at 
> ../../iocore/eventsystem/I_Continuation.h:145
> #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
> #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event= optimized out>) at ../../iocore/eventsystem/I_Continuation.h:145
> #15 CacheVC::callcont (this=0x2aab1c3b6800, event=) at 
> ../../iocore/cache/P_CacheInternal.h:662
> #16 0x00715940 in Cache::open_write (this=, 
> cont=, key=0x2ba0ff762d70, info=, 
> apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
> hostname=0x2aaadd281078 
> "www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=count=4=12;,
>  host_len=16) at CacheWrite.cc:1788
> #17 0x006e5765 in open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
> P_CacheInternal.h:1093
> #18 CacheProcessor::open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
> #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
> url=, request=, old_info= optimized out>, 
> pin_in_cache=, retry=, 
> allow_multiple=false) at HttpCacheSM.cc:298
> #20 0x005a022e in HttpSM::do_cache_prepare_action 
> (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
> allow_multiple=false) at HttpSM.cc:4511
> #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
> HttpSM.cc:4436
> #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
> #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=0, data=0x0) at HttpSM.cc:1455
> #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6876
> #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6919
> #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #28 0x005b45f8 in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-09-02 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14727739#comment-14727739
 ] 

Susan Hinrichs commented on TS-3486:


 server_session_sharing_pool is overridable in 5.3, but not in master

 Should be able to change the reference to 
sm->t_state.txn_conf->server_session_sharing_pool

> Segfault in do_io_write with plugin (??)
> 
>
> Key: TS-3486
> URL: https://issues.apache.org/jira/browse/TS-3486
> Project: Traffic Server
>  Issue Type: Bug
>Affects Versions: 5.2.0, 5.3.0
>Reporter: Qiang Li
>Assignee: Susan Hinrichs
>  Labels: crash
> Fix For: 6.0.0
>
> Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
> ts3486-ptrace.txt.gz
>
>
> {code}
> (gdb) bt
> #0  0x005bdb8b in HttpServerSession::do_io_write (this= optimized out>, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
> at HttpServerSession.cc:104
> #1  0x005acc1d in HttpSM::setup_server_send_request 
> (this=0x2aaadccc4bf0) at HttpSM.cc:5686
> #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1520
> #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
> #6  0x2ba118441c89 in cachefun (contp=, event= optimized out>, edata=0x2aaadccc4bf0) at main.cpp:1876
> #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=, data=) at HttpSM.cc:1381
> #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
> raw=) at HttpSM.cc:4639
> #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:7021
> #10 0x005b25a3 in HttpSM::state_cache_open_write 
> (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
> #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
> event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
> #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at 
> ../../iocore/eventsystem/I_Continuation.h:145
> #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
> #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event= optimized out>) at ../../iocore/eventsystem/I_Continuation.h:145
> #15 CacheVC::callcont (this=0x2aab1c3b6800, event=) at 
> ../../iocore/cache/P_CacheInternal.h:662
> #16 0x00715940 in Cache::open_write (this=, 
> cont=, key=0x2ba0ff762d70, info=, 
> apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
> hostname=0x2aaadd281078 
> "www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=count=4=12;,
>  host_len=16) at CacheWrite.cc:1788
> #17 0x006e5765 in open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
> P_CacheInternal.h:1093
> #18 CacheProcessor::open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
> #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
> url=, request=, old_info= optimized out>, 
> pin_in_cache=, retry=, 
> allow_multiple=false) at HttpCacheSM.cc:298
> #20 0x005a022e in HttpSM::do_cache_prepare_action 
> (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
> allow_multiple=false) at HttpSM.cc:4511
> #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
> HttpSM.cc:4436
> #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
> #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=0, data=0x0) at HttpSM.cc:1455
> #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6876
> #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6919
> #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #29 0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #30 0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-09-02 Thread Phil Sorber (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728379#comment-14728379
 ] 

Phil Sorber commented on TS-3486:
-

I assume that was changed for a reason. Is that going to have a negative impact 
on this feature in 5.3?

> Segfault in do_io_write with plugin (??)
> 
>
> Key: TS-3486
> URL: https://issues.apache.org/jira/browse/TS-3486
> Project: Traffic Server
>  Issue Type: Bug
>Affects Versions: 5.2.0, 5.3.0
>Reporter: Qiang Li
>Assignee: Susan Hinrichs
>  Labels: crash
> Fix For: 6.0.0
>
> Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
> ts3486-ptrace.txt.gz
>
>
> {code}
> (gdb) bt
> #0  0x005bdb8b in HttpServerSession::do_io_write (this= optimized out>, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
> at HttpServerSession.cc:104
> #1  0x005acc1d in HttpSM::setup_server_send_request 
> (this=0x2aaadccc4bf0) at HttpSM.cc:5686
> #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1520
> #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
> #6  0x2ba118441c89 in cachefun (contp=, event= optimized out>, edata=0x2aaadccc4bf0) at main.cpp:1876
> #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=, data=) at HttpSM.cc:1381
> #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
> raw=) at HttpSM.cc:4639
> #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:7021
> #10 0x005b25a3 in HttpSM::state_cache_open_write 
> (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
> #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
> event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
> #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at 
> ../../iocore/eventsystem/I_Continuation.h:145
> #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
> #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event= optimized out>) at ../../iocore/eventsystem/I_Continuation.h:145
> #15 CacheVC::callcont (this=0x2aab1c3b6800, event=) at 
> ../../iocore/cache/P_CacheInternal.h:662
> #16 0x00715940 in Cache::open_write (this=, 
> cont=, key=0x2ba0ff762d70, info=, 
> apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
> hostname=0x2aaadd281078 
> "www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=count=4=12;,
>  host_len=16) at CacheWrite.cc:1788
> #17 0x006e5765 in open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
> P_CacheInternal.h:1093
> #18 CacheProcessor::open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
> #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
> url=, request=, old_info= optimized out>, 
> pin_in_cache=, retry=, 
> allow_multiple=false) at HttpCacheSM.cc:298
> #20 0x005a022e in HttpSM::do_cache_prepare_action 
> (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
> allow_multiple=false) at HttpSM.cc:4511
> #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
> HttpSM.cc:4436
> #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
> #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=0, data=0x0) at HttpSM.cc:1455
> #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6876
> #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6919
> #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #29 0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #30 0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
> #31 0x2ba11844215d 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-09-02 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728417#comment-14728417
 ] 

ASF subversion and git services commented on TS-3486:
-

Commit 6cf09155441765c6388fda924a46598499cbbb95 in trafficserver's branch 
refs/heads/5.3.x from [~psudaemon]
[ https://git-wip-us.apache.org/repos/asf?p=trafficserver.git;h=6cf0915 ]

TS-3486: Update CHANGES


> Segfault in do_io_write with plugin (??)
> 
>
> Key: TS-3486
> URL: https://issues.apache.org/jira/browse/TS-3486
> Project: Traffic Server
>  Issue Type: Bug
>Affects Versions: 5.2.0, 5.3.0
>Reporter: Qiang Li
>Assignee: Susan Hinrichs
>  Labels: crash
> Fix For: 5.3.2, 6.0.0
>
> Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
> ts3486-ptrace.txt.gz
>
>
> {code}
> (gdb) bt
> #0  0x005bdb8b in HttpServerSession::do_io_write (this= optimized out>, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
> at HttpServerSession.cc:104
> #1  0x005acc1d in HttpSM::setup_server_send_request 
> (this=0x2aaadccc4bf0) at HttpSM.cc:5686
> #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1520
> #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
> #6  0x2ba118441c89 in cachefun (contp=, event= optimized out>, edata=0x2aaadccc4bf0) at main.cpp:1876
> #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=, data=) at HttpSM.cc:1381
> #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
> raw=) at HttpSM.cc:4639
> #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:7021
> #10 0x005b25a3 in HttpSM::state_cache_open_write 
> (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
> #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
> event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
> #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at 
> ../../iocore/eventsystem/I_Continuation.h:145
> #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
> #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event= optimized out>) at ../../iocore/eventsystem/I_Continuation.h:145
> #15 CacheVC::callcont (this=0x2aab1c3b6800, event=) at 
> ../../iocore/cache/P_CacheInternal.h:662
> #16 0x00715940 in Cache::open_write (this=, 
> cont=, key=0x2ba0ff762d70, info=, 
> apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
> hostname=0x2aaadd281078 
> "www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=count=4=12;,
>  host_len=16) at CacheWrite.cc:1788
> #17 0x006e5765 in open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
> P_CacheInternal.h:1093
> #18 CacheProcessor::open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
> #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
> url=, request=, old_info= optimized out>, 
> pin_in_cache=, retry=, 
> allow_multiple=false) at HttpCacheSM.cc:298
> #20 0x005a022e in HttpSM::do_cache_prepare_action 
> (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
> allow_multiple=false) at HttpSM.cc:4511
> #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
> HttpSM.cc:4436
> #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
> #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=0, data=0x0) at HttpSM.cc:1455
> #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6876
> #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6919
> #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #29 0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-09-02 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14728416#comment-14728416
 ] 

ASF subversion and git services commented on TS-3486:
-

Commit 7e0fafd0584cefa7b088a1b522235e9b4b81ed15 in trafficserver's branch 
refs/heads/5.3.x from shinrich
[ https://git-wip-us.apache.org/repos/asf?p=trafficserver.git;h=7e0fafd ]

TS-3486: Crashes due to race condition on server sessions moving between 
threads. This closes #235

(cherry picked from commit a638d97019e1b3ef4e6ec53b93d81a96885cbb6e)
(cherry picked from commit 1a160e13e4931fbaa522339c99abfad1ce9d638c)

Conflicts:
proxy/http/HttpSessionManager.cc


> Segfault in do_io_write with plugin (??)
> 
>
> Key: TS-3486
> URL: https://issues.apache.org/jira/browse/TS-3486
> Project: Traffic Server
>  Issue Type: Bug
>Affects Versions: 5.2.0, 5.3.0
>Reporter: Qiang Li
>Assignee: Susan Hinrichs
>  Labels: crash
> Fix For: 5.3.2, 6.0.0
>
> Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
> ts3486-ptrace.txt.gz
>
>
> {code}
> (gdb) bt
> #0  0x005bdb8b in HttpServerSession::do_io_write (this= optimized out>, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
> at HttpServerSession.cc:104
> #1  0x005acc1d in HttpSM::setup_server_send_request 
> (this=0x2aaadccc4bf0) at HttpSM.cc:5686
> #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1520
> #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1455
> #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
> event=6, data=0x0) at HttpSM.cc:1275
> #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
> event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
> #6  0x2ba118441c89 in cachefun (contp=, event= optimized out>, edata=0x2aaadccc4bf0) at main.cpp:1876
> #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=, data=) at HttpSM.cc:1381
> #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
> raw=) at HttpSM.cc:4639
> #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:7021
> #10 0x005b25a3 in HttpSM::state_cache_open_write 
> (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
> #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
> event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
> #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at 
> ../../iocore/eventsystem/I_Continuation.h:145
> #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event= optimized out>, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
> #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event= optimized out>) at ../../iocore/eventsystem/I_Continuation.h:145
> #15 CacheVC::callcont (this=0x2aab1c3b6800, event=) at 
> ../../iocore/cache/P_CacheInternal.h:662
> #16 0x00715940 in Cache::open_write (this=, 
> cont=, key=0x2ba0ff762d70, info=, 
> apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
> hostname=0x2aaadd281078 
> "www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=count=4=12;,
>  host_len=16) at CacheWrite.cc:1788
> #17 0x006e5765 in open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
> P_CacheInternal.h:1093
> #18 CacheProcessor::open_write (this=, 
> cont=0x2aaadccc6618, expected_size=, url=0x2aaadccc5310, 
> cluster_cache_local=, request=, 
> old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
> #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
> url=, request=, old_info= optimized out>, 
> pin_in_cache=, retry=, 
> allow_multiple=false) at HttpCacheSM.cc:298
> #20 0x005a022e in HttpSM::do_cache_prepare_action 
> (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
> allow_multiple=false) at HttpSM.cc:4511
> #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
> HttpSM.cc:4436
> #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
> #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
> HttpSM.cc:1517
> #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
> event=0, data=0x0) at HttpSM.cc:1455
> #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6876
> #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
> HttpSM.cc:6919
> #27 0x005b3f5f in HttpSM::handle_api_return 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-08-27 Thread Phil Sorber (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717076#comment-14717076
 ] 

Phil Sorber commented on TS-3486:
-

I attempted back-porting this, but build failed. Looks like this depends upon 
some other changes?

{noformat}
HttpSessionManager.cc: In member function ‘HSMresult_t 
HttpSessionManager::acquire_session(Continuation*, const sockaddr*, const 
char*, HttpClientSession*, HttpSM*)’:
HttpSessionManager.cc:269:101: error: ‘struct HttpConfigParams’ has no member 
named ‘server_session_sharing_pool’
   ProxyMutex *pool_mutex = (TS_SERVER_SESSION_SHARING_POOL_THREAD == 
sm-t_state.http_config_param-server_session_sharing_pool) ?

 ^
HttpSessionManager.cc:274:81: error: ‘struct HttpConfigParams’ has no member 
named ‘server_session_sharing_pool’
 if (TS_SERVER_SESSION_SHARING_POOL_THREAD == 
sm-t_state.http_config_param-server_session_sharing_pool) {

 ^
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-07-10 Thread bettydramit (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14621988#comment-14621988
 ] 

bettydramit commented on TS-3486:
-

why not backport to 5.3.1?

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-07-10 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14622152#comment-14622152
 ] 

Susan Hinrichs commented on TS-3486:


I think the plan was to get a 5.3.2 out pretty quickly with this fix and one 
other.  I don't think we back point to already released point releases.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-07-06 Thread bettydramit (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615987#comment-14615987
 ] 

bettydramit commented on TS-3486:
-

it has been running for 10 days on last patch build. 
Great!

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-07-06 Thread Bryan Call (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615223#comment-14615223
 ] 

Bryan Call commented on TS-3486:


Backported to 6.0.x

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-07-06 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14615219#comment-14615219
 ] 

ASF subversion and git services commented on TS-3486:
-

Commit 7b4c78527e6dc2061c79e1b442f37b176c0930f4 in trafficserver's branch 
refs/heads/6.0.x from [~psudaemon]
[ https://git-wip-us.apache.org/repos/asf?p=trafficserver.git;h=7b4c785 ]

TS-3486: clang-format

(cherry picked from commit 1a160e13e4931fbaa522339c99abfad1ce9d638c)


 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-30 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608502#comment-14608502
 ] 

Eric Sproul commented on TS-3486:
-

Our system with the ts-3266-complete diff has been running without a crash for 
almost 24 hours.  This looks good.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.1.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-29 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606454#comment-14606454
 ] 

ASF GitHub Bot commented on TS-3486:


Github user asfgit closed the pull request at:

https://github.com/apache/trafficserver/pull/235


 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-29 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606452#comment-14606452
 ] 

ASF subversion and git services commented on TS-3486:
-

Commit a638d97019e1b3ef4e6ec53b93d81a96885cbb6e in trafficserver's branch 
refs/heads/master from shinrich
[ https://git-wip-us.apache.org/repos/asf?p=trafficserver.git;h=a638d97 ]

TS-3486: Crashes due to race condition on server sessions moving between 
threads. This closes #235


 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.0.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-29 Thread ASF subversion and git services (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606536#comment-14606536
 ] 

ASF subversion and git services commented on TS-3486:
-

Commit 1a160e13e4931fbaa522339c99abfad1ce9d638c in trafficserver's branch 
refs/heads/master from [~psudaemon]
[ https://git-wip-us.apache.org/repos/asf?p=trafficserver.git;h=1a160e1 ]

TS-3486: clang-format


 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: 6.1.0

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-26 Thread ASF GitHub Bot (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603354#comment-14603354
 ] 

ASF GitHub Bot commented on TS-3486:


GitHub user shinrich opened a pull request:

https://github.com/apache/trafficserver/pull/235

TS-3486: Crashes due to race condition on server sessions moving betw…

…een threads.

Addressing crash issues disucssed in TS-3266 and TS-3486.  This fix has 
been running on Y! 5.3.x on one production machine for over a day and on three 
other production machines for several hours.

There is a race condition when server sessions reused from a global pool 
are moved between threads.  This patch addresses the issue by holding both the 
session pool lock and the activating state machine lock while setting up the 
first read.vio on the reactivated server.  This prevents conflicting IO using 
one lock or the other on another thread.

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/shinrich/trafficserver ts-3486

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/trafficserver/pull/235.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #235


commit 8c1a8631b92f8c7b1bbe2e47835575524f1fba8c
Author: shinrich shinr...@yahoo-inc.com
Date:   2015-06-26T18:11:40Z

TS-3486: Crashes due to race condition on server sessions moving between 
threads.




 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-26 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14603415#comment-14603415
 ] 

Susan Hinrichs commented on TS-3486:


Note, that the ts-3266-complete.diff is the 5.3.x version of the pull request.  
The session_sharing config variable moved from being overrideable in 5.3 to not 
being overrideable on master (so it appears).

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Susan Hinrichs
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts-3266-complete.diff, 
 ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-25 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601199#comment-14601199
 ] 

Eric Sproul commented on TS-3486:
-

[~shinrich] Have seen a couple of crashes since deploying.  Below is the first.

{noformat}
(gdb) thread 8
[Switching to thread 8 (LWP8)]
#0  0x00800687 in operator IOBufferBlock* (this=0x12058d00) at 
../../lib/ts/Ptr.h:300
300   operator T *() const { return (m_ptr); }

(gdb) bt full
#0  0x00800687 in operator IOBufferBlock* (this=0x12058d00) at 
../../lib/ts/Ptr.h:300
No locals.
#1  first_write_block (this=0x12058cf0) at 
../../iocore/eventsystem/I_IOBuffer.h:926
No locals.
#2  read_from_net (nh=0x165e760, vc=0x1fe56a10, thread=optimized out) at 
UnixNetVConnection.cc:275
b = optimized out
buf = @0x1fe56b50: {mbuf = 0x12058cf0, entry = 0x0}
toread = optimized out
total_read = optimized out
r = 0
lock = {m = {m_ptr = 0x1d7b80d0}, lock_acquired = true}
rattempted = optimized out
__FUNCTION__ = read_from_net
s = 0x1fe56b28
mutex = 0xfc95d0
ntodo = 9223372036854775807
niov = optimized out
tiovec = {{iov_base = 0x187ca0d6, iov_len = 3882}, {iov_base = 
0x31876000, iov_len = 32768}, {iov_base = 0x165e760, iov_len = 16763984}, 
{iov_base = 0x11, iov_len = 644902944}, {
iov_base = 0xdd7ffe6bae40, iov_len = 18446706140541555064}, 
{iov_base = 0x0, iov_len = 325825}, {iov_base = 0x1, iov_len = 3}, {iov_base = 
0x0, iov_len = 8323579}, {
iov_base = 0xdd7ffe6bae40, iov_len = 8372075}, {iov_base = 0x0, 
iov_len = 463521516}, {iov_base = 0xdd7ffe6bae00, iov_len = 
18446706140542042283}, {iov_base = 0x0, 
iov_len = 57252368}, {iov_base = 0x0, iov_len = 463521504}, 
{iov_base = 0x165e760, iov_len = 1435219220224819912}, {iov_base = 0x10357f0, 
iov_len = 18446706140541555235}, {
iov_base = 0xdd7ffe6bae40, iov_len = 16763984}}
#3  0x007f09b7 in NetHandler::mainNetEvent (this=0x165e760, 
event=optimized out, e=optimized out) at UnixNet.cc:546
epd = optimized out
pd = 0x3b48010
retval = optimized out
nget = 1
__FUNCTION__ = mainNetEvent
poll_timeout = 747651072
vc = optimized out
ptimeout = {tv_sec = 0, tv_nsec = 1000}
#4  0x00821af0 in handleEvent (data=0x3699a70, event=5, this=optimized 
out) at I_Continuation.h:145
No locals.
#5  process_event (e=0x3699a70, this=0x165b010, calling_code=optimized out) 
at UnixEThread.cc:128
c_temp = optimized out
lock = {m = {m_ptr = 0xfc8910}, lock_acquired = true}
calling_code = 5
#6  EThread::execute (this=0x165b010) at UnixEThread.cc:252
done_one = optimized out
e = optimized out
NegativeQueue = optimized out
next_time = 1435219134815957937
#7  0x008202aa in spawn_thread_internal (a=0x3693f10) at Thread.cc:85
p = 0x3693f10
#8  0xdd7fff070dba in _thrp_setup () from /lib/64/libc.so.1
No symbol table info available.
#9  0xdd7fff0710d0 in ?? () from /lib/64/libc.so.1
No symbol table info available.
#10 0x in ?? ()
No symbol table info available.
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-24 Thread bettydramit (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599358#comment-14599358
 ] 

bettydramit commented on TS-3486:
-

I've been running with this patch in production for 10 hours without a crash.
I will continue to focus on this bug


 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-24 Thread bettydramit (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600441#comment-14600441
 ] 

bettydramit commented on TS-3486:
-

Crashed after 15 hours.
{code}
traffic_server: Segmentation fault (Address not mapped to object 
[(nil)])traffic_server - STACK TRACE: 
/usr/bin/traffic_server(crash_logger_invoke(int, siginfo*, 
void*)+0x99)[0x4aaab9]
/lib64/libpthread.so.0(+0xf710)[0x2abb33fdd710]
/usr/bin/traffic_server(HttpServerSession::do_io_write(Continuation*, long, 
IOBufferReader*, bool)+0xb)[0x5b95eb]
/usr/bin/traffic_server(HttpSM::setup_server_send_request()+0x32d)[0x5ab64d]
/usr/bin/traffic_server(HttpSM::handle_api_return()+0x385)[0x5b4a25]
/usr/bin/traffic_server(HttpSM::state_api_callout(int, void*)+0x2b0)[0x5ac4e0]
/usr/bin/traffic_server(HttpSM::state_api_callback(int, void*)+0x8b)[0x5b259b]
/usr/bin/traffic_server(TSHttpTxnReenable+0x24b)[0x4d31eb]
{code}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-24 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599604#comment-14599604
 ] 

Eric Sproul commented on TS-3486:
-

I deployed the ts-3266-2 diff about 2 hours ago.  So far so good.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-24 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599520#comment-14599520
 ] 

Susan Hinrichs commented on TS-3486:


Did run into a crash after installing our official build.  Same stack but 
different condition.  The mutex that was held via lock is from the VC.  The 
mutex in the read.vio is from a HttpSM.  So the same issue of drifting mutexes 
on io operators, but different from the server pool scenario.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts-3266-2.diff, ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-23 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598099#comment-14598099
 ] 

Susan Hinrichs commented on TS-3486:


We are seeing a similar core in production.  On one set of boxes it drops the 
core at a high frequency.  I'm suspecting that the LAZY_BUF_ALLOC is not 
working quite right.  I'm building an image with that disabled.  It attempts to 
delay allocating buffer space until it is needed, but I don't think checks like 
buf.writer() check the lazy correctly. 

There are two spots where the LAZY_BUF_ALLOC is used.  One spot immediately 
allocates a buffer.  The other one in HttpServerSession appears to be the 
source of the buffer for our core.  It does not allocate a buffer. 

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593433#comment-14593433
 ] 

Eric Sproul commented on TS-3486:
-

We saw some crashes overnight as well, but they are different from the previous 
ones.  All the stacks look like this:
{noformat}
read_from_net(NetHandler*, UnixNetVConnection*, EThread*)+0x2d7()
NetHandler::mainNetEvent+0x1f7()
EThread::execute+0x8d0()
spawn_thread_internal(void*)+0x4a()
libc.so.1`_thrp_setup+0x8a(dd7ffecdc280)
libc.so.1`_lwp_start()
{noformat}

So, possibly something else.  Didn't see any open issues that looked related.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593501#comment-14593501
 ] 

Eric Sproul commented on TS-3486:
-

[~shinrich] We had to disable our Backtrace crash logger because the way it is 
implemented it breaks service management (meaning the service won't 
stop/restart properly).  I do have core files.  Once it started crashing, there 
were 5 crashes in about 8 hours, but we've gone about 9 hours now with no 
crashes.

I can't share the core file but I can try to extract whatever you need; I'm not 
all that good with a debugger though so no promises. :)

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593493#comment-14593493
 ] 

Susan Hinrichs commented on TS-3486:


Bummer.  It looks like we still have a freed netvc lingering in the event 
processing queue. 

[~bettydreamit] and [~esproul] is the crash frequency lower?  [~esproul] do you 
have some trace information on your crash?

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593620#comment-14593620
 ] 

Susan Hinrichs commented on TS-3486:


[~esproul] a line number in read_from_net would be helpful.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593717#comment-14593717
 ] 

Eric Sproul commented on TS-3486:
-

[~shinrich] I see; gdb is sometimes wonky on illumos, but appears to have 
worked well enough here:

{noformat}
(gdb) bt
#0  0xdd7fff07758a in _portfs () from /lib/64/libc.so.1
#1  0xdd7ffeff1223 in port_getn () from /lib/64/libc.so.1
#2  0x007f0bad in NetHandler::mainNetEvent (this=0x1137760, 
event=optimized out, e=optimized out) at UnixNet.cc:472
#3  0x00821e40 in handleEvent (data=0x36a8e30, event=5, this=optimized 
out) at I_Continuation.h:145
#4  process_event (e=0x36a8e30, this=0x1134010, calling_code=optimized out) 
at UnixEThread.cc:128
#5  EThread::execute (this=0x1134010) at UnixEThread.cc:252
#6  0x00824d0b in main ()
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593733#comment-14593733
 ] 

Eric Sproul commented on TS-3486:
-

I realize now that the previous post was erroneous; I don't think that's the 
faulting thread.  I'm working on getting the right one.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593671#comment-14593671
 ] 

Eric Sproul commented on TS-3486:
-

[~shinrich] well this is odd, but possibly a C++ism...

My instruction pointer is 0x008009d7, but addr2line puts me in a 
header?!?

{noformat}
# gaddr2line -e /opt/circonus/bin/traffic_server 0x008009d7
/tmp/build_esproul/trafficserver-5.3.0/iocore/net/../../lib/ts/Ptr.h:300
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593687#comment-14593687
 ] 

Susan Hinrichs commented on TS-3486:


Could be due to some inlining.

Maybe just bt will get you line numbers down the stack?

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593784#comment-14593784
 ] 

Eric Sproul commented on TS-3486:
-

I guess I'm used to debuggers like mdb and dbx that put you in the faulted 
thread from the start...

From dbx I determined it was thread/LWP 26 that segfaulted, AND I grabbed the 
source while I was at it, so...
{noformat}
(gdb) thread 26
[Switching to thread 26 (LWP26)]
#0  0x008009d7 in operator IOBufferBlock* (this=0x16218ed0) at 
../../lib/ts/Ptr.h:300
300   operator T *() const { return (m_ptr); }
(gdb) bt
#0  0x008009d7 in operator IOBufferBlock* (this=0x16218ed0) at 
../../lib/ts/Ptr.h:300
#1  first_write_block (this=0x16218ec0) at 
../../iocore/eventsystem/I_IOBuffer.h:926
#2  read_from_net (nh=0x2921760, vc=0x19445740, thread=optimized out) at 
UnixNetVConnection.cc:275
#3  0x007f0d17 in NetHandler::mainNetEvent (this=0x2921760, 
event=optimized out, e=optimized out) at UnixNet.cc:546
#4  0x00821e40 in handleEvent (data=0x36a7cf0, event=5, this=optimized 
out) at I_Continuation.h:145
#5  process_event (e=0x36a7cf0, this=0x291e010, calling_code=optimized out) 
at UnixEThread.cc:128
#6  EThread::execute (this=0x291e010) at UnixEThread.cc:252
#7  0x008205fa in spawn_thread_internal (a=0x36a2a50) at Thread.cc:85
#8  0xdd7fff070dba in _thrp_setup () from /lib/64/libc.so.1
#9  0xdd7fff0710d0 in ?? () from /lib/64/libc.so.1
#10 0x in ?? ()
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-19 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593806#comment-14593806
 ] 

Eric Sproul commented on TS-3486:
-

Additionally, here's a `bt full` output (thanks [~psudaemon]!)
{noformat}
(gdb) bt full
#0  0x008009d7 in operator IOBufferBlock* (this=0x16218ed0) at 
../../lib/ts/Ptr.h:300
No locals.
#1  first_write_block (this=0x16218ec0) at 
../../iocore/eventsystem/I_IOBuffer.h:926
No locals.
#2  read_from_net (nh=0x2921760, vc=0x19445740, thread=optimized out) at 
UnixNetVConnection.cc:275
b = optimized out
buf = @0x19445880: {mbuf = 0x16218ec0, entry = 0x0}
toread = optimized out
total_read = optimized out
r = 0
lock = {m = {m_ptr = 0x13cbe790}, lock_acquired = true}
rattempted = optimized out
__FUNCTION__ = read_from_net
s = 0x19445858
mutex = 0xfc9150
ntodo = 9223372036854775807
niov = optimized out
tiovec = {{iov_base = 0x159bc0a7, iov_len = 3929}, {iov_base = 
0xbc7a000, iov_len = 32768}, {iov_base = 0xdd7ffd4a8e40, iov_len = 
8270580}, {iov_base = 0x32, iov_len = 428876640}, {
iov_base = 0xdd7ffd4a8e40, iov_len = 18446706140541555064}, 
{iov_base = 0x0, iov_len = 18883}, {iov_base = 0x1, iov_len = 2487}, {iov_base 
= 0x0, iov_len = 8324443}, {
iov_base = 0xdd7ffd4a8e40, iov_len = 8372923}, {iov_base = 0x0, 
iov_len = 386230828}, {iov_base = 0xdd7ffd4a8e00, iov_len = 
18446706140542042283}, {iov_base = 0x0, 
iov_len = 57310352}, {iov_base = 0x0, iov_len = 386230816}, 
{iov_base = 0x2921760, iov_len = 1434694902351034537}, {iov_base = 
0xdd7ffd4a8e40, iov_len = 18446706140541555235}, {
iov_base = 0xdd7ffd4a8e40, iov_len = 16594640}}
#3  0x007f0d17 in NetHandler::mainNetEvent (this=0x2921760, 
event=optimized out, e=optimized out) at UnixNet.cc:546
epd = optimized out
pd = 0x4bc1010
retval = optimized out
nget = 1
__FUNCTION__ = mainNetEvent
poll_timeout = 318363216
vc = optimized out
ptimeout = {tv_sec = 0, tv_nsec = 1000}
#4  0x00821e40 in handleEvent (data=0x36a7cf0, event=5, this=optimized 
out) at I_Continuation.h:145
No locals.
#5  process_event (e=0x36a7cf0, this=0x291e010, calling_code=optimized out) 
at UnixEThread.cc:128
c_temp = optimized out
lock = {m = {m_ptr = 0xfc8010}, lock_acquired = true}
calling_code = 5
#6  EThread::execute (this=0x291e010) at UnixEThread.cc:252
done_one = optimized out
e = optimized out
NegativeQueue = optimized out
next_time = 1434694895853026566
#7  0x008205fa in spawn_thread_internal (a=0x36a2a50) at Thread.cc:85
p = 0x36a2a50
#8  0xdd7fff070dba in _thrp_setup () from /lib/64/libc.so.1
No symbol table info available.
#9  0xdd7fff0710d0 in ?? () from /lib/64/libc.so.1
No symbol table info available.
#10 0x in ?? ()
No symbol table info available.
(gdb) 
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-18 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14591911#comment-14591911
 ] 

Eric Sproul commented on TS-3486:
-

This morning I've deployed a build that includes this patch.  Should know by 
COB if it's stable.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-18 Thread bettydramit (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14593041#comment-14593041
 ] 

bettydramit commented on TS-3486:
-

With this 
https://issues.apache.org/jira/secure/attachment/12740028/ts-3266.diff  patch 
for ats 5.2.0

It crashed about 16 hours.
{code}
 c++filt  a.txt 
traffic_server: Segmentation fault (Address not mapped to object 
[0x20])traffic_server - STACK TRACE: 
/usr/bin/traffic_server(crash_logger_invoke(int, siginfo*, 
void*)+0x99)[0x4aaac9]
/lib64/libpthread.so.0(+0xf710)[0x2b90561d8710]
/usr/bin/traffic_server(MIOBuffer::write_avail()+0x14)[0x68e704]
/usr/bin/traffic_server[0x733a99]
/usr/bin/traffic_server(NetHandler::mainNetEvent(int, Event*)+0x1f2)[0x7282e2]
/usr/bin/traffic_server(EThread::process_event(Event*, int)+0x125)[0x7540c5]
/usr/bin/traffic_server(EThread::execute()+0x43b)[0x75481b]
/usr/bin/traffic_server[0x75350a]
/lib64/libpthread.so.0(+0x79d1)[0x2b90561d09d1]
/lib64/libc.so.6(clone+0x6d)[0x2b90571c78fd]
{code}
Looks like https://issues.apache.org/jira/browse/TS-2681

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-18 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592598#comment-14592598
 ] 

Eric Sproul commented on TS-3486:
-

So far so good, it hasn't crashed since I deployed.  Since deploying 5.3.0 28 
days ago, we've averaged 11 crashes/day, or a crash about every 2 hours.  If we 
go  24 hours without a crash, I'll call this one fixed. :)

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-18 Thread Phil Sorber (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592632#comment-14592632
 ] 

Phil Sorber commented on TS-3486:
-

That's great news. We can mark this a dup of that and make sure that one is 
marked for backport. Then I can roll an rc for 5.3.1.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-18 Thread bettydramit (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14592774#comment-14592774
 ] 

bettydramit commented on TS-3486:
-

Good Jobs

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #29 0x005b980b in 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-17 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590453#comment-14590453
 ] 

Susan Hinrichs commented on TS-3486:


[~esproul] Thanks for the trace.  It confirms that the HttpServerSession was 
unmapped so the do_io_write method could not be invoked on it.

When you get a chance, could you try this diff?  I think it may eliminate a 
window were a session could be reactivated in one thread and freed in another 
thread.

https://issues.apache.org/jira/secure/attachment/12740028/ts-3266.diff

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime

 Attachments: ts3486-ptrace.txt.gz


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-17 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590312#comment-14590312
 ] 

Susan Hinrichs commented on TS-3486:


[~esproul] it would be very interesting to see if server_vc is an unallocated 
chunk (i.e. is it just that the vtable has been scrozzled due to being released 
back to the allocator).  Specifically for frame 0 in the stack,  does print 
*server_vc work?  Does print *((char *)server_vc) work?  Do either of them 
complain about in accessible memory?

I think it would be interesting to try the patch on ts-3266 in an environment 
where this happens with some frequency.  In our environment, we see the ts-3266 
crash more often.  Have only seen this crash once so far.  It could be that by 
fixing ts-3266 we remove the potential for a race condition that deletes the 
server side VC out from underneath us.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-17 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590070#comment-14590070
 ] 

Eric Sproul commented on TS-3486:
-

[~shinrich] we have some Backtrace.io data from crashes like this that we could 
share.  I can't give you direct access to our BT database, but if [~psudaemon] 
or [~zwoop] can guide me, I can pull whatever info you need.

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-06-17 Thread Susan Hinrichs (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14589988#comment-14589988
 ] 

Susan Hinrichs commented on TS-3486:


I think this might be related to TS-3266.  In both cases, the crashing stack is 
reactivating a session that had been in the session pool.

When server sessions are put in the pool (ServerSessionPool::releaseSession), a 
do_io_read is setup to capture any events from the server that might occur 
before the session is reactivated (e.g. sending an EOS).  This was causing the 
problem in TS-3266.  This do_io_read was not being cancelled soon enough so a 
read was being protected by the session pool lock while the reactivation logic 
was adjusting read.vio using the new HttpSM lock.

The release function also sets up a do_io_write for no bytes with the lock of 
the session pool.  Perhaps there is a similar race condition?

We saw this crash in production with no plugin on the stack at all.  
Unfortunately our core was partial, so I cannot explore the interesting data 
structures.


 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
Assignee: Phil Sorber
  Labels: crash
 Fix For: sometime


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-05-27 Thread Eric Sproul (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14560925#comment-14560925
 ] 

Eric Sproul commented on TS-3486:
-

I believe I am also seeing this with 5.3.0 and stats_over_http (using a custom 
path, if that matters.)  

This is from OmniOS r151006 (illumos).  I can make core files available upon 
request.

Many stacks look similar to this:

{noformat}
HttpServerSession::do_io_write(Continuation*, long, IOBufferReader*, bool)+0xb()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::do_http_server_open(bool)+0x268()
HttpSM::set_next_state()+0x510()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::set_next_state()+0x248()
HttpSM::do_hostdb_lookup()+0x272()
HttpSM::set_next_state()+0xd9f()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::state_cache_open_read(int, void*)+0x188()
HttpSM::main_handler(int, void*)+0xc9()
HttpCacheSM::state_cache_open_read(int, void*)+0x163()
_ZN5Cache9open_readEP12ContinuationPN3ats10CryptoHashEP7HTTPHdrP21CacheLookupHtt
pConfig13CacheFragTypePci+0x6e1()
_ZN14CacheProcessor9open_readEP12ContinuationP3URLbP7HTTPHdrP21CacheLookupHttpCo
nfigl13CacheFragType+0x8e()
HttpCacheSM::open_read(URL*, HTTPHdr*, CacheLookupHttpConfig*, long)+0x85()
HttpSM::do_cache_lookup_and_read()+0xfd()
HttpSM::set_next_state()+0x811()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::set_next_state()+0x248()
HttpSM::set_next_state()+0x862()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::set_next_state()+0x248()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::state_api_callback(int, void*)+0x8f()
TSHttpTxnReenable+0x1ed()
stats_over_http.so`stats_origin+0x86()
HttpSM::state_api_callout(int, void*)+0xde()
HttpSM::set_next_state()+0x248()
HttpSM::state_read_client_request_header(int, void*)+0x207()
HttpSM::main_handler(int, void*)+0xc9()
HttpSM::state_api_callout(int, void*)+0x2d0()
HttpSM::state_add_to_list(int, void*)+0x198()
HttpSM::attach_client_session(HttpClientSession*, IOBufferReader*)+0x3b5()
HttpClientSession::new_transaction()+0xc4()
ProxyClientSession::state_api_callout(int, void*)+0x13d()
_ZN17HttpClientSession14new_connectionEP14NetVConnectionP9MIOBufferP14IOBufferRe
aderb+0x224()
HttpSessionAccept::accept(NetVConnection*, MIOBuffer*, IOBufferReader*)+0x22
4()
ProtocolProbeTrampoline::ioCompletionEvent(int, void*)+0x3ca()
UnixNetVConnection::readSignalAndUpdate(int)+0x48()
SSLNetVConnection::net_read_io(NetHandler*, EThread*)+0xfad()
NetHandler::mainNetEvent(int, Event*)+0x1f7()
EThread::execute()+0x8d0()
spawn_thread_internal(void*)+0x4a()
libc.so.1`_thrp_setup+0x8a(dd7ffed71a80)
libc.so.1`_lwp_start()
{noformat}

Crash status and registers:

{noformat}
SIGSEGV: Segmentation Fault
%rax = 0x00838950   %r8  = 0x
%rbx = 0x08993340   %r9  = 0x0a0d
%rcx = 0x065cbcf8   %r10 = 0x0658
%rdx = 0x017b   %r11 = 0xdd7fff087348
%rsi = 0x08993340   %r12 = 0x065cbcf8
%rdi = 0x   %r13 = 0x017b
%r14 = 0x08994c68
%r15 = 0x08993a02

%cs = 0x0053%fs = 0x%gs = 0x
%ds = 0x004b%es = 0x004b%ss = 0x004b

%rip = 0x0067f66b 
_ZN17HttpServerSession11do_io_writeEP12ContinuationlP14IOBufferReaderb+0xb
%rbp = 0xdd7ffeb5ba40
%rsp = 0xdd7ffeb5a9e8

%rflags = 0x00010246
  id=0 vip=0 vif=0 ac=0 vm=0 rf=1 nt=0 iopl=0x0
  status=of,df,IF,tf,sf,ZF,af,PF,cf

%gsbase = 0x
%fsbase = 0xdd7ffed71a80
%trapno = 0xe
   %err = 0x4
{noformat}

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
  Labels: crash
 Fix For: sometime


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 

[jira] [Commented] (TS-3486) Segfault in do_io_write with plugin (??)

2015-04-03 Thread Leif Hedstrom (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-3486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14394486#comment-14394486
 ] 

Leif Hedstrom commented on TS-3486:
---

#6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876


What is cachefun? This is crashing due to something a plugin you have is doing 
it seems?

 Segfault in do_io_write with plugin (??)
 

 Key: TS-3486
 URL: https://issues.apache.org/jira/browse/TS-3486
 Project: Traffic Server
  Issue Type: Bug
Affects Versions: 5.2.0, 5.3.0
Reporter: Qiang Li
  Labels: crash
 Fix For: sometime


 {code}
 (gdb) bt
 #0  0x005bdb8b in HttpServerSession::do_io_write (this=value 
 optimized out, c=0x2aaadccc4bf0, nbytes=576, buf=0x2aaafc2ffee8, owner=false)
 at HttpServerSession.cc:104
 #1  0x005acc1d in HttpSM::setup_server_send_request 
 (this=0x2aaadccc4bf0) at HttpSM.cc:5686
 #2  0x005b3f85 in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1520
 #3  0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1455
 #4  0x005b980b in HttpSM::state_api_callback (this=0x2aaadccc4bf0, 
 event=6, data=0x0) at HttpSM.cc:1275
 #5  0x004d7a1b in TSHttpTxnReenable (txnp=0x2aaadccc4bf0, 
 event=TS_EVENT_HTTP_CONTINUE) at InkAPI.cc:5614
 #6  0x2ba118441c89 in cachefun (contp=value optimized out, event=value 
 optimized out, edata=0x2aaadccc4bf0) at main.cpp:1876
 #7  0x005b4466 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=value optimized out, data=value optimized out) at HttpSM.cc:1381
 #8  0x005b627d in HttpSM::do_http_server_open (this=0x2aaadccc4bf0, 
 raw=value optimized out) at HttpSM.cc:4639
 #9  0x005baa04 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:7021
 #10 0x005b25a3 in HttpSM::state_cache_open_write 
 (this=0x2aaadccc4bf0, event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2442
 #11 0x005b5b28 in HttpSM::main_handler (this=0x2aaadccc4bf0, 
 event=1108, data=0x2aab1c3b6800) at HttpSM.cc:2554
 #12 0x0059338a in handleEvent (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at 
 ../../iocore/eventsystem/I_Continuation.h:145
 #13 HttpCacheSM::state_cache_open_write (this=0x2aaadccc6618, event=value 
 optimized out, data=0x2aab1c3b6800) at HttpCacheSM.cc:167
 #14 0x00697223 in handleEvent (this=0x2aab1c3b6800, event=value 
 optimized out) at ../../iocore/eventsystem/I_Continuation.h:145
 #15 CacheVC::callcont (this=0x2aab1c3b6800, event=value optimized out) at 
 ../../iocore/cache/P_CacheInternal.h:662
 #16 0x00715940 in Cache::open_write (this=value optimized out, 
 cont=value optimized out, key=0x2ba0ff762d70, info=value optimized out, 
 apin_in_cache=46914401429576, type=CACHE_FRAG_TYPE_HTTP, 
 hostname=0x2aaadd281078 
 www.mifangba.comhttpapi.phpwww.mifangba.comhttp://www.mifangba.com/api.php?op=countid=4modelid=12;,
  host_len=16) at CacheWrite.cc:1788
 #17 0x006e5765 in open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at 
 P_CacheInternal.h:1093
 #18 CacheProcessor::open_write (this=value optimized out, 
 cont=0x2aaadccc6618, expected_size=value optimized out, url=0x2aaadccc5310, 
 cluster_cache_local=value optimized out, request=value optimized out, 
 old_info=0x0, pin_in_cache=0, type=CACHE_FRAG_TYPE_HTTP) at Cache.cc:3622
 #19 0x005936f0 in HttpCacheSM::open_write (this=0x2aaadccc6618, 
 url=value optimized out, request=value optimized out, old_info=value 
 optimized out, 
 pin_in_cache=value optimized out, retry=value optimized out, 
 allow_multiple=false) at HttpCacheSM.cc:298
 #20 0x005a022e in HttpSM::do_cache_prepare_action 
 (this=0x2aaadccc4bf0, c_sm=0x2aaadccc6618, object_read_info=0x0, retry=true, 
 allow_multiple=false) at HttpSM.cc:4511
 #21 0x005babd9 in do_cache_prepare_write (this=0x2aaadccc4bf0) at 
 HttpSM.cc:4436
 #22 HttpSM::set_next_state (this=0x2aaadccc4bf0) at HttpSM.cc:7098
 #23 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #24 0x005b45f8 in HttpSM::state_api_callout (this=0x2aaadccc4bf0, 
 event=0, data=0x0) at HttpSM.cc:1455
 #25 0x005ba712 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6876
 #26 0x005ba702 in HttpSM::set_next_state (this=0x2aaadccc4bf0) at 
 HttpSM.cc:6919
 #27 0x005b3f5f in HttpSM::handle_api_return (this=0x2aaadccc4bf0) at 
 HttpSM.cc:1517
 #28 0x005b45f8 in