See
<https://build.gluster.org/job/regression-test-with-multiplex/759/display/redirect?page=changes>
Changes:
[Nithya Balachandran] cluster:dht: Corrected ret code check
[Raghavendra G] protocol/client: Don't send fops till SETVOLUME is complete
[Amar Tumballi] glusterd: address test failures with brick mux enabled
------------------------------------------
[...truncated 953.31 KB...]
[New LWP 21273]
[New LWP 21275]
[New LWP 21274]
Core was generated by `glusterd --xlator-option
management.working-directory=/d/backends/2/glusterd --'.
Program terminated with signal 11, Segmentation fault.
#0 0x00007fd879c983e4 in ?? ()
exe = 'glusterd --xlator-option
management.working-directory=/d/backends/2/glusterd --'
++ gdb -ex 'core-file /glusterd-21270.core' -ex 'set pagination off' -ex 'info
proc exe' -ex q
++ tail -1
++ cut -d ' ' -f1
++ cut -d ''\''' -f2
+ executable_name=glusterd
++ which glusterd
+ executable_path=/build/install/sbin/glusterd
+ set +x
=========================================================
Start printing backtrace
program name : /build/install/sbin/glusterd
corefile : /glusterd-21270.core
=========================================================
warning: core file may not match specified executable file.
[New LWP 21270]
[New LWP 21271]
[New LWP 21301]
[New LWP 21272]
[New LWP 21273]
[New LWP 21275]
[New LWP 21274]
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib64/libthread_db.so.1".
Core was generated by `glusterd --xlator-option
management.working-directory=/d/backends/2/glusterd --'.
Program terminated with signal 11, Segmentation fault.
#0 0x00007fd879c983e4 in xlator_volume_option_get_list
(vol_list=0xffffffffffffff00, key=0x25bda30 "run-directory") at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/options.c>:921
921 if (!vol_list->given_opt) {
Thread 7 (Thread 0x7fd86fa1a700 (LWP 21274)):
#0 0x00007fd878c8751d in __lll_lock_wait () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fd878c82e1b in _L_lock_812 () from /lib64/libpthread.so.0
No symbol table info available.
#2 0x00007fd878c82ce8 in pthread_mutex_lock () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007fd879c300fe in _gf_msg (domain=0x25b3510 "management",
file=0x7fd86e7df9c0
"<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-proc-mgmt.c";,>
function=0x7fd86e7dfb00 <__FUNCTION__.13469> "glusterd_proc_stop", line=83,
level=GF_LOG_INFO, errnum=0, trace=0, msgid=106131, fmt=0x7fd86e7dfa30 "%s
already stopped") at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:2085
ret = 0
msgstr = 0x0
ap = {{gp_offset = 0, fp_offset = 0, overflow_arg_area = 0x7fd8782c22f0
<__GI__IO_file_fopen+208>, reg_save_area = 0x7fd8782c2f30 <flush_cleanup>}}
this = 0x25b24d0
ctx = 0x2569010
callstr = '\000' <repeats 4095 times>
passcallstr = 0
log_inited = 0
__PRETTY_FUNCTION__ = "_gf_msg"
#4 0x00007fd86e78a6ae in glusterd_proc_stop (proc=0x7fd879fd8498, sig=15,
flags=4) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-proc-mgmt.c>:81
ret = 0
pid = -1
this = 0x25b24d0
__PRETTY_FUNCTION__ = "glusterd_proc_stop"
__FUNCTION__ = "glusterd_proc_stop"
#5 0x00007fd86e78b9df in glusterd_svc_stop (svc=0x7fd879fd6480, sig=15) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-svc-mgmt.c>:225
ret = -1
__FUNCTION__ = "glusterd_svc_stop"
#6 0x00007fd86e7935f9 in glusterd_scrubsvc_stop (svc=0x7fd879fd6480, sig=15)
at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-scrub-svc.c>:136
No locals.
#7 0x00007fd86e79345b in glusterd_scrubsvc_manager (svc=0x7fd879fd6480,
data=0x0, flags=2) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-scrub-svc.c>:84
ret = 0
__FUNCTION__ = "glusterd_scrubsvc_manager"
#8 0x00007fd86e78f45f in glusterd_svcs_manager (volinfo=0x0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-svc-helper.c>:150
ret = 0
this = 0x25b24d0
conf = 0x7fd879fbc060
__PRETTY_FUNCTION__ = "glusterd_svcs_manager"
#9 0x00007fd86e6a8785 in glusterd_restart_bricks (opaque=0x7fd879fe6820) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-utils.c>:6168
ret = 1
volinfo = 0x260a250
brickinfo = 0x0
snap = 0x0
start_svcs = true
this = 0x25b24d0
conf = 0x7fd879fbc060
active_count = 1
quorum_count = 1
node_quorum = true
__FUNCTION__ = "glusterd_restart_bricks"
#10 0x00007fd86e69fe60 in glusterd_spawn_daemons (opaque=0x0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-utils.c>:3542
conf = 0x7fd879fbc060
ret = -1
#11 0x00007fd879c7bb20 in synctask_wrap () at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:375
task = 0x2602210
#12 0x00007fd87828f030 in ?? () from /lib64/libc.so.6
No symbol table info available.
#13 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 6 (Thread 0x7fd86f219700 (LWP 21275)):
#0 0x00007fd878c84d42 in pthread_cond_timedwait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fd879c7c34d in syncenv_task (proc=0x25aa120) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:603
env = 0x25a9d60
task = 0x0
sleep_till = {tv_sec = 1527786328, tv_nsec = 0}
ret = 0
#2 0x00007fd879c7c5e8 in syncenv_processor (thdata=0x25aa120) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:695
env = 0x25a9d60
proc = 0x25aa120
task = 0x0
#3 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007fd878345bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 5 (Thread 0x7fd87021b700 (LWP 21273)):
#0 0x00007fd87830c56d in nanosleep () from /lib64/libc.so.6
No symbol table info available.
#1 0x00007fd87830c404 in sleep () from /lib64/libc.so.6
No symbol table info available.
#2 0x00007fd879c64bac in pool_sweeper (arg=0x0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:470
state = {death_row = {next = 0x0, prev = 0x0}, cold_lists = {0x0
<repeats 1024 times>}, n_cold_lists = 0}
pool_list = 0x0
next_pl = 0x0
pt_pool = 0x0
i = 0
begin_time = {tv_sec = 0, tv_usec = 0}
end_time = {tv_sec = 0, tv_usec = 0}
elapsed = {tv_sec = 0, tv_usec = 0}
#3 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#4 0x00007fd878345bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 4 (Thread 0x7fd870a1c700 (LWP 21272)):
#0 0x00007fd878c88461 in sigwait () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x000000000040a78b in ?? ()
No symbol table info available.
#2 0x0000000000000000 in ?? ()
No symbol table info available.
Thread 3 (Thread 0x7fd86a100700 (LWP 21301)):
#0 0x00007fd878c84995 in pthread_cond_wait@@GLIBC_2.3.2 () from
/lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fd86e74162e in hooks_worker (args=0x25b24d0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-hooks.c>:528
conf = 0x7fd879fbc060
hooks_priv = 0x265db50
stub = 0x0
#2 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007fd878345bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 2 (Thread 0x7fd87121d700 (LWP 21271)):
#0 0x00007fd878c87f3d in nanosleep () from /lib64/libpthread.so.0
No symbol table info available.
#1 0x00007fd879c3d682 in gf_timer_proc (data=0x25a8b80) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:202
now = 8382938896104467
now_ts = {tv_sec = 8382938, tv_nsec = 896104467}
reg = 0x25a8b80
sleepts = {tv_sec = 1, tv_nsec = 0}
event = 0x25a8c30
tmp = 0x25a8b90
old_THIS = 0x0
#2 0x00007fd878c80e25 in start_thread () from /lib64/libpthread.so.0
No symbol table info available.
#3 0x00007fd878345bad in clone () from /lib64/libc.so.6
No symbol table info available.
Thread 1 (Thread 0x7fd87a147780 (LWP 21270)):
#0 0x00007fd879c983e4 in xlator_volume_option_get_list
(vol_list=0xffffffffffffff00, key=0x25bda30 "run-directory") at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/options.c>:921
opt = 0x0
opt_list = 0x0
found = 0x0
index = 0
i = 0
cmp_key = 0x0
#1 0x00007fd879c9851a in xlator_volume_option_get (xl=0x25b24d0, key=0x25bda30
"run-directory") at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/options.c>:951
vol_list = 0xffffffffffffff00
found = 0x0
#2 0x00007fd879c781ac in _log_if_unknown_option (dict=0x25b3558, key=0x25bda30
"run-directory", value=0x25bebd8, data=0x25b24d0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:398
found = 0x0
xl = 0x25b24d0
__FUNCTION__ = "_log_if_unknown_option"
#3 0x00007fd879c2101c in dict_foreach_match (dict=0x25b3558,
match=0x7fd879c20eac <dict_match_everything>, match_data=0x0,
action=0x7fd879c78169 <_log_if_unknown_option>, action_data=0x25b24d0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/dict.c>:1279
__FUNCTION__ = "dict_foreach_match"
ret = 0
count = 6
pairs = 0x25bec68
next = 0x25beb48
#4 0x00007fd879c20f08 in dict_foreach (dict=0x25b3558, fn=0x7fd879c78169
<_log_if_unknown_option>, data=0x25b24d0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/dict.c>:1237
ret = 0
#5 0x00007fd879c78241 in _xlator_check_unknown_options (xl=0x25b24d0,
data=0x0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:413
No locals.
#6 0x00007fd879c28e7c in xlator_foreach (this=0x25b24d0, fn=0x7fd879c78216
<_xlator_check_unknown_options>, data=0x0) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/xlator.c>:562
first = 0x25b24d0
old_THIS = 0x7fd879f362c0 <global_xlator>
__FUNCTION__ = "xlator_foreach"
#7 0x00007fd879c7826e in glusterfs_graph_unknown_options (graph=0x25ae150) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:420
No locals.
#8 0x00007fd879c78d69 in glusterfs_graph_activate (graph=0x25ae150,
ctx=0x2569010) at
<https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:742
ret = 0
root = 0x25b24d0
__FUNCTION__ = "glusterfs_graph_activate"
#9 0x000000000040af69 in ?? ()
No symbol table info available.
#10 0x00000000150bc384 in ?? ()
No symbol table info available.
#11 0x0000000000000000 in ?? ()
No symbol table info available.
=========================================================
Finish backtrace
program name : /build/install/sbin/glusterd
corefile : /glusterd-21270.core
=========================================================
+ rm -f /build/install/cores/gdbout.txt
+ sort /build/install/cores/liblist.txt
+ uniq
+ cat /build/install/cores/liblist.txt.tmp
+ grep -v /build/install
+ tar -cf
/archives/archived_builds/build-install-regression-test-with-multiplex-759.tar
/build/install/sbin /build/install/bin /build/install/lib
/build/install/libexec /build/install/cores
tar: Removing leading `/' from member names
+ tar -rhf
/archives/archived_builds/build-install-regression-test-with-multiplex-759.tar
-T /build/install/cores/liblist.txt
tar: Removing leading `/' from member names
+ bzip2
/archives/archived_builds/build-install-regression-test-with-multiplex-759.tar
+ rm -f /build/install/cores/liblist.txt
+ rm -f /build/install/cores/liblist.txt.tmp
+ find /archives -size +1G -delete -type f
+ echo 'Cores and build archived in
http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-759.tar.bz2'
Cores and build archived in
http://builder104.cloud.gluster.org/archived_builds/build-install-regression-test-with-multiplex-759.tar.bz2
+ echo 'Open core using the following command to get a proper stack'
Open core using the following command to get a proper stack
+ echo 'Example: From root of extracted tarball'
Example: From root of extracted tarball
+ echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file
./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>'
\t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core'
<target, say ./build/install/sbin/glusterd>
+ RET=1
+ '[' 1 -ne 0 ']'
+ tar -czf
<https://build.gluster.org/job/regression-test-with-multiplex/759/artifact/glusterfs-logs.tgz>
/var/log/glusterfs /var/log/messages /var/log/messages-20180507
/var/log/messages-20180513 /var/log/messages-20180520 /var/log/messages-20180527
tar: Removing leading `/' from member names
+ scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i
<https://build.gluster.org/job/regression-test-with-multiplex/ws/>
glusterfs-logs.tgz
_logs_collec...@http.int.rht.gluster.org:/var/www/glusterfs-logs/regression-test-with-multiplex-759.tgz
ssh: connect to host http.int.rht.gluster.org port 22: Connection timed out
lost connection
+ true
+ case $(uname -s) in
++ uname -s
+ /sbin/sysctl -w 'kernel.core_pattern=|/usr/libexec/abrt-hook-ccpp %s %c %p %u
%g %t %e %P %I %h'
kernel.core_pattern = |/usr/libexec/abrt-hook-ccpp %s %c %p %u %g %t %e %P %I %h
+ exit 1
Build step 'Execute shell' marked build as failure
_______________________________________________
maintainers mailing list
maintainers@gluster.org
http://lists.gluster.org/mailman/listinfo/maintainers
