See <https://build.gluster.org/job/regression-test-burn-in/4661/display/redirect>
------------------------------------------ [...truncated 4.20 MB...] #4 0x0000000000000000 in ?? () No symbol table info available. Thread 4 (Thread 0x7f5025d13700 (LWP 1326)): #0 0x00007f502ed7bd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f502ff9eead in syncenv_task (proc=0x21aac80) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/syncop.c>:517 env = 0x21aac80 task = 0x0 sleep_till = {tv_sec = 1564003034, tv_nsec = 0} ret = 0 #2 0x00007f502ff9f0a2 in syncenv_processor (thdata=0x21aac80) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/syncop.c>:584 env = 0x21aac80 proc = 0x21aac80 task = 0x0 #3 0x00007f502ed77dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f502e63f02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (Thread 0x7f5026d15700 (LWP 1324)): #0 0x00007f502ed7f361 in sigwait () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000040b070 in ?? () No symbol table info available. #2 0x0000000000000000 in ?? () No symbol table info available. Thread 2 (Thread 0x7f5022242700 (LWP 1330)): #0 0x00007f502e63f603 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f502ffc88c2 in event_dispatch_epoll_worker (data=0x21f3a40) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/event-epoll.c>:745 event = {events = 1, data = {ptr = 0x100000005, fd = 5, u32 = 5, u64 = 4294967301}} ret = 0 ev_data = 0x21f3a40 event_pool = 0x21a1e40 myindex = 2 timetodie = 0 gen = 0 poller_death_notify = {next = 0x0, prev = 0x0} slot = 0x0 tmp = 0x0 __FUNCTION__ = "event_dispatch_epoll_worker" #2 0x00007f502ed77dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f502e63f02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7f5022a43700 (LWP 1329)): #0 0x00007f502ed79c30 in pthread_mutex_lock () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f502ff4a512 in gf_log_set_log_buf_size (buf_size=0) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/logging.c>:210 old = 0 ctx = 0x0 #2 0x00007f502ff4a9be in gf_log_disable_suppression_before_exit (ctx=0x216b010) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/logging.c>:371 No locals. #3 0x00007f502ff54925 in gf_print_trace (signum=11, ctx=0x216b010) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/common-utils.c>:918 msg = '\000' <repeats 1023 times> timestr = '\000' <repeats 63 times> stack = 0x0 #4 0x000000000040b10f in ?? () No symbol table info available. #5 0x0000000000000018 in ?? () No symbol table info available. #6 0x0000000b22a40620 in ?? () No symbol table info available. #7 0x00007f5022a411c0 in ?? () No symbol table info available. #8 <signal handler called> No symbol table info available. #9 0x0000000000000000 in ?? () No symbol table info available. #10 0x00007f502ff47c75 in xlator_notify (xl=0x7f501403e1d0, event=6, data=0x7f5014017b10) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/xlator.c>:699 old_THIS = 0x7f5014017b10 ret = 0 #11 0x00007f503002c66d in default_notify (this=0x7f5014017b10, event=6, data=0x7f50140155b0) at defaults.c:3388 parent = 0x7f501403f260 ret = 0 victim = 0x7f50140155b0 graph = 0x7f5014001aa0 __FUNCTION__ = "default_notify" #12 0x00007f50212da629 in notify (this=0x7f5014017b10, event=6, data=0x7f50140155b0) at <https://build.gluster.org/job/regression-test-burn-in/ws/xlators/debug/io-stats/src/io-stats.c>:4172 ret = 0 args = {type = IOS_DUMP_TYPE_NONE, u = {logfp = 0x0, dict = 0x0}} output = 0x7f50212d9db6 <notify> dict = 0x7f50140155b0 op = 0 list_cnt = 0 throughput = 0 time = 0 is_peek = false ap = {{gp_offset = 32, fp_offset = 48, overflow_arg_area = 0x7f5022a41480, reg_save_area = 0x7f5022a413c0}} up_data = 0x0 up_ci = 0x0 __FUNCTION__ = "notify" #13 0x00007f502ff47c75 in xlator_notify (xl=0x7f5014017b10, event=6, data=0x7f50140155b0) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/xlator.c>:699 old_THIS = 0x7f50140155b0 ret = 0 #14 0x00007f503002c66d in default_notify (this=0x7f50140155b0, event=6, data=0x7f501400d170) at defaults.c:3388 parent = 0x7f5014019910 ret = 0 victim = 0x7f501400d170 graph = 0x7f5014001aa0 __FUNCTION__ = "default_notify" #15 0x00007f502157b0ff in afr_notify (this=0x7f50140155b0, event=6, data=0x7f501400d170, data2=0x7f5021580c94 <notify>) at <https://build.gluster.org/job/regression-test-burn-in/ws/xlators/cluster/afr/src/afr-common.c>:5662 priv = 0x7f5014021fd0 child_xlator = 0x7f501400d170 i = 2 propagate = 1 had_heard_from_all = 0 have_heard_from_all = 1 idx = 0 ret = 0 call_psh = 0 up_child = -1 input = 0x0 output = 0x0 had_quorum = false has_quorum = false halo_max_latency_msec = 0 child_latency_msec = -1 __FUNCTION__ = "afr_notify" #16 0x00007f5021580d9e in notify (this=0x7f50140155b0, event=6, data=0x7f501400d170) at <https://build.gluster.org/job/regression-test-burn-in/ws/xlators/cluster/afr/src/afr.c>:42 ret = -1 ap = {{gp_offset = 32, fp_offset = 48, overflow_arg_area = 0x7f5022a41870, reg_save_area = 0x7f5022a417b0}} data2 = 0x7f5021580c94 <notify> #17 0x00007f502ff47c75 in xlator_notify (xl=0x7f50140155b0, event=6, data=0x7f501400d170) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/xlator.c>:699 old_THIS = 0x7f501400d170 ret = 0 #18 0x00007f503002c66d in default_notify (this=0x7f501400d170, event=6, data=0x0) at defaults.c:3388 parent = 0x7f5014017950 ret = 0 victim = 0x0 graph = 0x7f5014001aa0 __FUNCTION__ = "default_notify" #19 0x00007f50217b2342 in client_notify_dispatch (this=0x7f501400d170, event=6, data=0x0) at <https://build.gluster.org/job/regression-test-burn-in/ws/xlators/protocol/client/src/client.c>:97 ret = -1 ctx = 0x216b010 conf = 0x7f5014033c20 #20 0x00007f50217b221d in client_notify_dispatch_uniq (this=0x7f501400d170, event=6, data=0x0) at <https://build.gluster.org/job/regression-test-burn-in/ws/xlators/protocol/client/src/client.c>:71 conf = 0x7f5014033c20 #21 0x00007f50217c22d3 in client_rpc_notify (rpc=0x7f5014033db0, mydata=0x7f501400d170, event=RPC_CLNT_DISCONNECT, data=0x0) at <https://build.gluster.org/job/regression-test-burn-in/ws/xlators/protocol/client/src/client.c>:2378 this = 0x7f501400d170 conf = 0x7f5014033c20 is_parent_down = true ret = 0 __FUNCTION__ = "client_rpc_notify" #22 0x00007f502fceb67b in rpc_clnt_handle_disconnect (clnt=0x7f5014033db0, conn=0x7f5014033de0) at <https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-lib/src/rpc-clnt.c>:826 ts = {tv_sec = 0, tv_nsec = 0} unref_clnt = false pre_notify_gen = 0 post_notify_gen = 0 __FUNCTION__ = "rpc_clnt_handle_disconnect" #23 0x00007f502fceb93a in rpc_clnt_notify (trans=0x7f50140340c0, mydata=0x7f5014033de0, event=RPC_TRANSPORT_DISCONNECT, data=0x7f50140340c0) at <https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-lib/src/rpc-clnt.c>:887 conn = 0x7f5014033de0 clnt = 0x7f5014033db0 ret = -1 req_info = 0x0 pollin = 0x0 clnt_mydata = 0x0 old_THIS = 0x7f501400d170 __FUNCTION__ = "rpc_clnt_notify" #24 0x00007f502fce7a6e in rpc_transport_notify (this=0x7f50140340c0, event=RPC_TRANSPORT_DISCONNECT, data=0x7f50140340c0) at <https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-lib/src/rpc-transport.c>:545 ret = -1 __FUNCTION__ = "rpc_transport_notify" #25 0x00007f50242f3dc0 in socket_event_poll_err (this=0x7f50140340c0, gen=1, idx=5) at <https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-transport/socket/src/socket.c>:1378 priv = 0x7f5014034740 socket_closed = true __FUNCTION__ = "socket_event_poll_err" #26 0x00007f50242f9f49 in socket_event_handler (fd=14, idx=5, gen=1, data=0x7f50140340c0, poll_in=1, poll_out=0, poll_err=16, event_thread_died=0 '\000') at <https://build.gluster.org/job/regression-test-burn-in/ws/rpc/rpc-transport/socket/src/socket.c>:3018 sa = 0x7f5014034180 this = 0x7f50140340c0 priv = 0x7f5014034740 ret = -1 ctx = 0x216b010 socket_closed = false notify_handled = false __FUNCTION__ = "socket_event_handler" #27 0x00007f502ffc83de in event_dispatch_epoll_handler (event_pool=0x21a1e40, event=0x7f5022a42140) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/event-epoll.c>:642 ev_data = 0x7f5022a42144 slot = 0x21d5120 handler = 0x7f50242f993d <socket_event_handler> data = 0x7f50140340c0 idx = 5 gen = 1 ret = 0 fd = 14 handled_error_previously = false __FUNCTION__ = "event_dispatch_epoll_handler" #28 0x00007f502ffc88f7 in event_dispatch_epoll_worker (data=0x21f28f0) at <https://build.gluster.org/job/regression-test-burn-in/ws/libglusterfs/src/event-epoll.c>:755 event = {events = 17, data = {ptr = 0x100000005, fd = 5, u32 = 5, u64 = 4294967301}} ret = 1 ev_data = 0x21f28f0 event_pool = 0x21a1e40 myindex = 1 timetodie = 0 gen = 0 poller_death_notify = {next = 0x0, prev = 0x0} slot = 0x0 tmp = 0x0 __FUNCTION__ = "event_dispatch_epoll_worker" #29 0x00007f502ed77dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #30 0x00007f502e63f02d in clone () from /lib64/libc.so.6 No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterfs corefile : /glfs_epoll000-1322.core ========================================================= + rm -f /build/install/cores/gdbout.txt + sort /build/install/cores/liblist.txt + uniq + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-burn-in-4661.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-burn-in-4661.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-burn-in-4661.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + [[ builder203.int.aws.gluster.org == *\a\w\s* ]] + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i '' /archives/archived_builds/build-install-regression-test-burn-in-4661.tar.bz2 _logs-collec...@logs.aws.gluster.org:/var/www/glusterfs-logs/regression-test-burn-in-4661.bz2 Warning: Identity file not accessible: No such file or directory. Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts. Permission denied (publickey,gssapi-keyex,gssapi-with-mic). lost connection + true + echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-burn-in-4661.bz2' Cores and builds archived in https://logs.aws.gluster.org/regression-test-burn-in-4661.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-burn-in/4661/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20190602 /var/log/messages-20190609 /var/log/messages-20190616 /var/log/messages-20190708 tar: Removing leading `/' from member names + case $(uname -s) in ++ uname -s + /sbin/sysctl -w kernel.core_pattern=/%e-%p.core kernel.core_pattern = /%e-%p.core + exit 1 Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list maintainers@gluster.org https://lists.gluster.org/mailman/listinfo/maintainers