[
https://issues.apache.org/jira/browse/TS-2776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14014904#comment-14014904
]
Sudheer Vinukonda commented on TS-2776:
---------------------------------------
The production host running master w/ TS-2211 (and TS-2815 as well, since, they
are likely related) has no core so far. Will need to let it run for 24 hours to
confirm, if it really solves the core though.
Note - Found another core on the production host running master w/ TS-2271
reverted.
Below is the gdb output
{code}
(gdb) print b
$1 = 0
(gdb) up
#3 SSLNetVConnection::load_buffer_and_write (this=0x2b4c202b0460,
towrite=52509, wattempted=@0x2b4ada2f5c28, total_wrote=@0x2b4ada2f5c30,
buf=<value optimized out>,
needs=@0x2b4ada2f5c38) at SSLNetVConnection.cc:399
399 in SSLNetVConnection.cc
(gdb) print b
$2 = (IOBufferBlock *) 0x2b4bd4f56200
(gdb) print *b
$3 = {<RefCountObj> = {<ForceVFPTToTop> = {_vptr.ForceVFPTToTop = 0x73cd10},
m_refcount = 1},
_start = 0x2b4dcc85d000
"or\",function(){B.error.report(W,\"apihook:\"+N,1,1,1);});}}}}return G;}return
H();};};},\"1.0.0\",{requires:[\"common-utils\",\"rocket-stats\"]});\n\nYUI.add(\"common-user-session\",function(E){var
C=E.common,B=C"..., _end = 0x2b4dcc85e000 "", _buf_end = 0x2b4dcc85e000 "",
_location = 0x744d88 "memory/IOBuffer/InkIOCoreAPI.cc:491", data = {m_ptr =
0x2b4be21ec8b0}, next = {m_ptr = 0x2b4bef66d0c0}}
(gdb) print ssl
$4 = (SSL *) 0x2b4bf964f940
(gdb) print *ssl
$5 = {version = 771, type = 8192, method = 0x3316464600, rbio = 0x2b4bf9730960,
wbio = 0x2b4bf9730960, bbio = 0x0, rwstate = 1, in_handshake = 0,
handshake_func = 0x33162217c0 <ssl3_accept>, server = 1, new_session = 0,
quiet_shutdown = 1, shutdown = 0, state = 3, rstate = 241, init_buf = 0x0,
init_msg = 0x2b4bfa940ea4, init_num = 0, init_off = 0,
packet = 0x2b4bff4c2ed3
"\335wsT\v\243\377\061\354|\260p\020\001%Km/\321Ě1Y6O\003\240\261`7W\nR|w\275\340\206\375\066IPo\b\203\230\247\fS\023x$$\327",
<incomplete sequence \322>, packet_length = 5, s2 = 0x0, s3 = 0x2b4bf95854d0,
d1 = 0x0, read_ahead = 0, msg_callback = 0, msg_callback_arg = 0x0, hit = 0,
param = 0x2b4bfb3770f0,
cipher_list = 0x0, cipher_list_by_id = 0x0, mac_flags = 0, enc_read_ctx =
0x2b4bf8807ef0, read_hash = 0x2b4bf8325040, expand = 0x0, enc_write_ctx =
0x2b4bf8535810,
write_hash = 0x2b4bfb6dfd00, compress = 0x0, cert = 0x2b4bfb3e08b0,
sid_ctx_length = 0, sid_ctx = '\000' <repeats 31 times>, session =
0x2b4bfa31c890,
generate_session_id = 0, verify_mode = 0, verify_callback = 0, info_callback
= 0, error = 0, error_code = 0, kssl_ctx = 0x2b4bfb6fe280, psk_client_callback
= 0,
psk_server_callback = 0, ctx = 0x2871cb0, debug = 0, verify_result = 0,
ex_data = {sk = 0x2b4bf9ffd010, dummy = 0}, client_CA = 0x0, references = 1,
options = 2170227703, mode = 16, max_cert_list = 102400, first_packet = 0,
client_version = 771, max_send_fragment = 16384, tlsext_debug_cb = 0,
tlsext_debug_arg = 0x0, tlsext_hostname = 0x0, servername_done = 1,
tlsext_status_type = -1, tlsext_status_expected = 0, tlsext_ocsp_ids = 0x0,
tlsext_ocsp_exts = 0x0, tlsext_ocsp_resp = 0x0, tlsext_ocsp_resplen = -1,
tlsext_ticket_expected = 1, tlsext_ecpointformatlist_length = 3,
tlsext_ecpointformatlist = 0x2b4bf9d36830 "", tlsext_ellipticcurvelist_length
= 0, tlsext_ellipticcurvelist = 0x0, tlsext_opaque_prf_input = 0x0,
tlsext_opaque_prf_input_len = 0, tlsext_session_ticket = 0x0,
tls_session_ticket_ext_cb = 0, tls_session_ticket_ext_cb_arg = 0x0,
tls_session_secret_cb = 0,
tls_session_secret_cb_arg = 0x0, initial_ctx = 0x2871cb0,
next_proto_negotiated = 0x2b4bf9d31c70 "spdy/3.1", next_proto_negotiated_len =
8 '\b', srtp_profiles = 0x0,
srtp_profile = 0x0, tlsext_heartbeat = 0, tlsext_hb_pending = 0,
tlsext_hb_seq = 0, renegotiate = 0}
{code}
> Core dump inside openssl library
> --------------------------------
>
> Key: TS-2776
> URL: https://issues.apache.org/jira/browse/TS-2776
> Project: Traffic Server
> Issue Type: Bug
> Components: SPDY, SSL
> Reporter: Sudheer Vinukonda
> Assignee: Bryan Call
> Priority: Blocker
> Labels: spdy, yahoo
> Fix For: 5.0.0
>
>
> During production testing of SPDY (w/ ATS compiled from master repo), noticed
> the below core from open ssl library. This core showed up after fixing a few
> other core dumps and memory leaks (refer TS-2742, TS-2743, TS-2750, TS-2765,
> TS-2767 etc) and happened once so far, after running stable for 30+ hours on
> a production host.
> {code}
> [example_prep.sh] Checking/Moving old cores...
> [TrafficServer] using root directory '/home/y'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [TrafficManager] ==> signal #15
> [E. Mgmt] log ==> [TrafficManager] using root directory '/home/y'
> [example_prep.sh] Checking/Moving old cores...
> [TrafficServer] using root directory '/home/y'
> NOTE: Traffic Server received Sig 11: Segmentation fault
> /home/y/bin/traffic_server - STACK TRACE:
> /lib64/libpthread.so.0(+0x329720f500)[0x2b7dff1f6500]
> /usr/lib64/libssl.so.10[0x331622b2e7]
> /usr/lib64/libssl.so.10(ssl3_write_bytes+0x75)[0x331622b905]
> /home/y/bin/traffic_server(_ZN17SSLNetVConnection21load_buffer_and_writeElRlS0_R17MIOBufferAccessorRi+0xdf)[0x6db57f]
> /home/y/bin/traffic_server(_Z15write_to_net_ioP10NetHandlerP18UnixNetVConnectionP7EThread+0x418)[0x6ef488]
> /home/y/bin/traffic_server(_ZN10NetHandler12mainNetEventEiP5Event+0x283)[0x6e3ee3]
> /home/y/bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0x8f)[0x7109ff]
> /home/y/bin/traffic_server(_ZN7EThread7executeEv+0x43b)[0x71122b]
> /home/y/bin/traffic_server[0x70fdaa]
> /lib64/libpthread.so.0(+0x3297207851)[0x2b7dff1ee851]
> /lib64/libc.so.6(clone+0x6d)[0x3296ee890d]
> [E. Mgmt] log ==> [TrafficManager] using root directory '/home/y'
> [example_prep.sh] Checking/Moving old cores...
> [TrafficServer] using root directory '/home/y'
> {code}
> gdb output below:
> {code}
> (gdb) bt
> #0 0x000000331622b2e7 in ?? () from /usr/lib64/libssl.so.10
> #1 0x000000331622b905 in ssl3_write_bytes () from /usr/lib64/libssl.so.10
> #2 0x00000000006db57f in do_SSL_write (this=0x2b7f42c7ca70, towrite=207693,
> wattempted=@0x2b7e111aec28, total_wrote=@0x2b7e111aec30, buf=<value optimized
> out>, needs=@0x2b7e111aec38)
> at SSLNetVConnection.cc:90
> #3 SSLNetVConnection::load_buffer_and_write (this=0x2b7f42c7ca70,
> towrite=207693, wattempted=@0x2b7e111aec28, total_wrote=@0x2b7e111aec30,
> buf=<value optimized out>, needs=@0x2b7e111aec38)
> at SSLNetVConnection.cc:399
> #4 0x00000000006ef488 in write_to_net_io (nh=0x2b7e0f89ac10,
> vc=0x2b7f42c7ca70, thread=0x2b7e0f897010) at UnixNetVConnection.cc:527
> #5 0x00000000006e3ee3 in NetHandler::mainNetEvent (this=0x2b7e0f89ac10,
> event=<value optimized out>, e=<value optimized out>) at UnixNet.cc:400
> #6 0x00000000007109ff in handleEvent (this=0x2b7e0f897010, e=0x31ae0d0,
> calling_code=5) at I_Continuation.h:146
> #7 EThread::process_event (this=0x2b7e0f897010, e=0x31ae0d0, calling_code=5)
> at UnixEThread.cc:145
> #8 0x000000000071122b in EThread::execute (this=0x2b7e0f897010) at
> UnixEThread.cc:269
> #9 0x000000000070fdaa in spawn_thread_internal (a=0x2f8fbe0) at Thread.cc:88
> #10 0x00002b7dff1ee851 in start_thread () from /lib64/libpthread.so.0
> #11 0x0000003296ee890d in clone () from /lib64/libc.so.6
> (gdb) up
> #1 0x000000331622b905 in ssl3_write_bytes () from /usr/lib64/libssl.so.10
> (gdb) up
> #2 0x00000000006db57f in do_SSL_write (this=0x2b7f42c7ca70, towrite=207693,
> wattempted=@0x2b7e111aec28, total_wrote=@0x2b7e111aec30, buf=<value optimized
> out>, needs=@0x2b7e111aec38)
> at SSLNetVConnection.cc:90
> 90 SSLNetVConnection.cc: No such file or directory.
> in SSLNetVConnection.cc
> (gdb)
> {code}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
