See <https://build.gluster.org/job/regression-test-with-multiplex/759/display/redirect?page=changes>
Changes: [Nithya Balachandran] cluster:dht: Corrected ret code check [Raghavendra G] protocol/client: Don't send fops till SETVOLUME is complete [Amar Tumballi] glusterd: address test failures with brick mux enabled ------------------------------------------ [...truncated 953.31 KB...] [New LWP 21273] [New LWP 21275] [New LWP 21274] Core was generated by `glusterd --xlator-option management.working-directory=/d/backends/2/glusterd --'. Program terminated with signal 11, Segmentation fault. #0 0x00007fd879c983e4 in ?? () exe = 'glusterd --xlator-option management.working-directory=/d/backends/2/glusterd --' ++ gdb -ex 'core-file /glusterd-21270.core' -ex 'set pagination off' -ex 'info proc exe' -ex q ++ tail -1 ++ cut -d ' ' -f1 ++ cut -d ''\''' -f2 + executable_name=glusterd ++ which glusterd + executable_path=/build/install/sbin/glusterd + set +x ========================================================= Start printing backtrace program name : /build/install/sbin/glusterd corefile : /glusterd-21270.core ========================================================= warning: core file may not match specified executable file. [New LWP 21270] [New LWP 21271] [New LWP 21301] [New LWP 21272] [New LWP 21273] [New LWP 21275] [New LWP 21274] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `glusterd --xlator-option management.working-directory=/d/backends/2/glusterd --'. Program terminated with signal 11, Segmentation fault. #0 0x00007fd879c983e4 in xlator_volume_option_get_list (vol_list=0xffffffffffffff00, key=0x25bda30 "run-directory") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/options.c>:921 921 if (!vol_list->given_opt) { Thread 7 (Thread 0x7fd86fa1a700 (LWP 21274)): #0 0x00007fd878c8751d in __lll_lock_wait () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd878c82e1b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007fd878c82ce8 in pthread_mutex_lock () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fd879c300fe in _gf_msg (domain=0x25b3510 "management", file=0x7fd86e7df9c0 "<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-proc-mgmt.c",> function=0x7fd86e7dfb00 <__FUNCTION__.13469> "glusterd_proc_stop", line=83, level=GF_LOG_INFO, errnum=0, trace=0, msgid=106131, fmt=0x7fd86e7dfa30 "%s already stopped") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:2085 ret = 0 msgstr = 0x0 ap = {{gp_offset = 0, fp_offset = 0, overflow_arg_area = 0x7fd8782c22f0 <__GI__IO_file_fopen+208>, reg_save_area = 0x7fd8782c2f30 <flush_cleanup>}} this = 0x25b24d0 ctx = 0x2569010 callstr = '\000' <repeats 4095 times> passcallstr = 0 log_inited = 0 __PRETTY_FUNCTION__ = "_gf_msg" #4 0x00007fd86e78a6ae in glusterd_proc_stop (proc=0x7fd879fd8498, sig=15, flags=4) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-proc-mgmt.c>:81 ret = 0 pid = -1 this = 0x25b24d0 __PRETTY_FUNCTION__ = "glusterd_proc_stop" __FUNCTION__ = "glusterd_proc_stop" #5 0x00007fd86e78b9df in glusterd_svc_stop (svc=0x7fd879fd6480, sig=15) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-svc-mgmt.c>:225 ret = -1 __FUNCTION__ = "glusterd_svc_stop" #6 0x00007fd86e7935f9 in glusterd_scrubsvc_stop (svc=0x7fd879fd6480, sig=15) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-scrub-svc.c>:136 No locals. #7 0x00007fd86e79345b in glusterd_scrubsvc_manager (svc=0x7fd879fd6480, data=0x0, flags=2) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-scrub-svc.c>:84 ret = 0 __FUNCTION__ = "glusterd_scrubsvc_manager" #8 0x00007fd86e78f45f in glusterd_svcs_manager (volinfo=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-svc-helper.c>:150 ret = 0 this = 0x25b24d0 conf = 0x7fd879fbc060 __PRETTY_FUNCTION__ = "glusterd_svcs_manager" #9 0x00007fd86e6a8785 in glusterd_restart_bricks (opaque=0x7fd879fe6820) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-utils.c>:6168 ret = 1 volinfo = 0x260a250 brickinfo = 0x0 snap = 0x0 start_svcs = true this = 0x25b24d0 conf = 0x7fd879fbc060 active_count = 1 quorum_count = 1 node_quorum = true __FUNCTION__ = "glusterd_restart_bricks" #10 0x00007fd86e69fe60 in glusterd_spawn_daemons (opaque=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-utils.c>:3542 conf = 0x7fd879fbc060 ret = -1 #11 0x00007fd879c7bb20 in synctask_wrap () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:375 task = 0x2602210 #12 0x00007fd87828f030 in ?? () from /lib64/libc.so.6 No symbol table info available. #13 0x0000000000000000 in ?? () No symbol table info available. Thread 6 (Thread 0x7fd86f219700 (LWP 21275)): #0 0x00007fd878c84d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd879c7c34d in syncenv_task (proc=0x25aa120) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:603 env = 0x25a9d60 task = 0x0 sleep_till = {tv_sec = 1527786328, tv_nsec = 0} ret = 0 #2 0x00007fd879c7c5e8 in syncenv_processor (thdata=0x25aa120) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:695 env = 0x25a9d60 proc = 0x25aa120 task = 0x0 #3 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007fd878345bad in clone () from /lib64/libc.so.6 No symbol table info available. Thread 5 (Thread 0x7fd87021b700 (LWP 21273)): #0 0x00007fd87830c56d in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd87830c404 in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x00007fd879c64bac in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:470 state = {death_row = {next = 0x0, prev = 0x0}, cold_lists = {0x0 <repeats 1024 times>}, n_cold_lists = 0} pool_list = 0x0 next_pl = 0x0 pt_pool = 0x0 i = 0 begin_time = {tv_sec = 0, tv_usec = 0} end_time = {tv_sec = 0, tv_usec = 0} elapsed = {tv_sec = 0, tv_usec = 0} #3 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007fd878345bad in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (Thread 0x7fd870a1c700 (LWP 21272)): #0 0x00007fd878c88461 in sigwait () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000040a78b in ?? () No symbol table info available. #2 0x0000000000000000 in ?? () No symbol table info available. Thread 3 (Thread 0x7fd86a100700 (LWP 21301)): #0 0x00007fd878c84995 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd86e74162e in hooks_worker (args=0x25b24d0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-hooks.c>:528 conf = 0x7fd879fbc060 hooks_priv = 0x265db50 stub = 0x0 #2 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fd878345bad in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7fd87121d700 (LWP 21271)): #0 0x00007fd878c87f3d in nanosleep () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd879c3d682 in gf_timer_proc (data=0x25a8b80) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:202 now = 8382938896104467 now_ts = {tv_sec = 8382938, tv_nsec = 896104467} reg = 0x25a8b80 sleepts = {tv_sec = 1, tv_nsec = 0} event = 0x25a8c30 tmp = 0x25a8b90 old_THIS = 0x0 #2 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fd878345bad in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7fd87a147780 (LWP 21270)): #0 0x00007fd879c983e4 in xlator_volume_option_get_list (vol_list=0xffffffffffffff00, key=0x25bda30 "run-directory") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/options.c>:921 opt = 0x0 opt_list = 0x0 found = 0x0 index = 0 i = 0 cmp_key = 0x0 #1 0x00007fd879c9851a in xlator_volume_option_get (xl=0x25b24d0, key=0x25bda30 "run-directory") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/options.c>:951 vol_list = 0xffffffffffffff00 found = 0x0 #2 0x00007fd879c781ac in _log_if_unknown_option (dict=0x25b3558, key=0x25bda30 "run-directory", value=0x25bebd8, data=0x25b24d0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:398 found = 0x0 xl = 0x25b24d0 __FUNCTION__ = "_log_if_unknown_option" #3 0x00007fd879c2101c in dict_foreach_match (dict=0x25b3558, match=0x7fd879c20eac <dict_match_everything>, match_data=0x0, action=0x7fd879c78169 <_log_if_unknown_option>, action_data=0x25b24d0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/dict.c>:1279 __FUNCTION__ = "dict_foreach_match" ret = 0 count = 6 pairs = 0x25bec68 next = 0x25beb48 #4 0x00007fd879c20f08 in dict_foreach (dict=0x25b3558, fn=0x7fd879c78169 <_log_if_unknown_option>, data=0x25b24d0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/dict.c>:1237 ret = 0 #5 0x00007fd879c78241 in _xlator_check_unknown_options (xl=0x25b24d0, data=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:413 No locals. #6 0x00007fd879c28e7c in xlator_foreach (this=0x25b24d0, fn=0x7fd879c78216 <_xlator_check_unknown_options>, data=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/xlator.c>:562 first = 0x25b24d0 old_THIS = 0x7fd879f362c0 <global_xlator> __FUNCTION__ = "xlator_foreach" #7 0x00007fd879c7826e in glusterfs_graph_unknown_options (graph=0x25ae150) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:420 No locals. #8 0x00007fd879c78d69 in glusterfs_graph_activate (graph=0x25ae150, ctx=0x2569010) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:742 ret = 0 root = 0x25b24d0 __FUNCTION__ = "glusterfs_graph_activate" #9 0x000000000040af69 in ?? () No symbol table info available. #10 0x00000000150bc384 in ?? () No symbol table info available. #11 0x0000000000000000 in ?? () No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterd corefile : /glusterd-21270.core ========================================================= + rm -f /build/install/cores/gdbout.txt + sort /build/install/cores/liblist.txt + uniq + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-759.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-759.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-759.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + echo 'Cores and build archived in http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-759.tar.bz2' Cores and build archived in http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-759.tar.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/759/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20180507 /var/log/messages-20180513 /var/log/messages-20180520 /var/log/messages-20180527 tar: Removing leading `/' from member names + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i <https://build.gluster.org/job/regression-test-with-multiplex/ws/> glusterfs-logs.tgz _logs_collec...@http.int.rht.gluster.org:/var/www/glusterfs-logs/regression-test-with-multiplex-759.tgz ssh: connect to host http.int.rht.gluster.org port 22: Connection timed out lost connection + true + case $(uname -s) in ++ uname -s + /sbin/sysctl -w 'kernel.core_pattern=|/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t %e %P %I %h' kernel.core_pattern = |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t %e %P %I %h + exit 1 Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list maintainers@gluster.org http://lists.gluster.org/mailman/listinfo/maintainers