See <https://build.gluster.org/job/regression-test-with-multiplex/1391/display/redirect?page=changes>
Changes: [Pranith Kumar K] graph/shd: Use glusterfs_graph_deactivate to free the xl rec [Kotresh H R] posix : add posix_set_ctime() in posix_ftruncate() [Raghavendra G] protocol/client: propagte GF_EVENT_CHILD_PING only for connections to ------------------------------------------ [...truncated 4.25 MB...] No symbol table info available. #5 0x00007fb1640ecd2c in ?? () from /lib64/libgcc_s.so.1 No symbol table info available. #6 0x00007fb1640ed6ed in ?? () from /lib64/libgcc_s.so.1 No symbol table info available. #7 0x00007fb1640edcd6 in _Unwind_ForcedUnwind () from /lib64/libgcc_s.so.1 No symbol table info available. #8 0x00007fb1742ff302 in __pthread_unwind () from /lib64/libpthread.so.0 No symbol table info available. #9 0x00007fb1742f7815 in sigcancel_handler () from /lib64/libpthread.so.0 No symbol table info available. #10 <signal handler called> No symbol table info available. #11 0x00007fb1742fcd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #12 0x00007fb166ad882a in __afr_shd_healer_wait (healer=0x7fb148a9b188) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heald.c>:100 priv = 0x7fb148963330 wait_till = {tv_sec = 1561656345, tv_nsec = 0} ret = 0 #13 0x00007fb166ad88a5 in afr_shd_healer_wait (healer=0x7fb148a9b188) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heald.c>:121 ret = 0 #14 0x00007fb166ada2fe in afr_shd_index_healer (data=0x7fb148a9b188) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heald.c>:821 healer = 0x7fb148a9b188 this = 0x7fb148057190 ret = 0 priv = 0x7fb148963330 pre_crawl_xdata = 0x0 loc = {path = 0x0, name = 0x0, inode = 0x0, parent = 0x0, gfid = '\000' <repeats 15 times>, pargfid = '\000' <repeats 15 times>} __FUNCTION__ = "afr_shd_index_healer" #15 0x00007fb1742f8dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #16 0x00007fb173bbfead in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (Thread 0x7fb14effd700 (LWP 5771)): #0 0x00007fb1742f9f47 in pthread_join () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fb1754dbb55 in gf_thread_cleanup_xint (thread=140399895312128) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/common-utils.c>:3941 ret = 0 res = 0x0 #2 0x00007fb166b04132 in afr_destroy_healer_object (this=0x7fb148057190, healer=0x7fb148a9b188) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr.c>:627 ret = -1 __FUNCTION__ = "afr_destroy_healer_object" #3 0x00007fb166b0426b in afr_selfheal_daemon_fini (this=0x7fb148057190) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr.c>:655 healer = 0x7fb148a9b188 shd = 0x7fb1489634c8 priv = 0x7fb148963330 i = 1 #4 0x00007fb166b04379 in fini (this=0x7fb148057190) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr.c>:676 priv = 0x7fb148963330 #5 0x00007fb1754c8658 in xlator_fini_rec (xl=0x7fb148057190) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/xlator.c>:668 trav = 0x0 old_THIS = 0x7fb1757e1a20 <global_xlator> __FUNCTION__ = "xlator_fini_rec" #6 0x00007fb1754c8594 in xlator_fini_rec (xl=0x7fb148059870) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/xlator.c>:657 trav = 0x7fb14805a970 old_THIS = 0x0 __FUNCTION__ = "xlator_fini_rec" #7 0x00007fb1754c8bb2 in xlator_tree_fini (xl=0x7fb148059870) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/xlator.c>:766 top = 0x7fb148059870 __FUNCTION__ = "xlator_tree_fini" #8 0x00007fb17551a07e in glusterfs_graph_deactivate (graph=0x7fb14803e0a0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:443 top = 0x7fb148059870 #9 0x00007fb17551c37e in glusterfs_graph_cleanup (arg=0x7fb14803e0a0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/graph.c>:1404 graph = 0x7fb14803e0a0 ctx = 0x1238010 ret = 0 __FUNCTION__ = "glusterfs_graph_cleanup" #10 0x00007fb1742f8dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #11 0x00007fb173bbfead in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (Thread 0x7fb14f7fe700 (LWP 5735)): #0 0x00007fb1742fcd12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fb17551f272 in syncenv_task (proc=0x12783e0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:517 env = 0x1277c60 task = 0x0 sleep_till = {tv_sec = 1561656345, tv_nsec = 0} ret = 0 #2 0x00007fb17551f467 in syncenv_processor (thdata=0x12783e0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:584 env = 0x1277c60 proc = 0x12783e0 task = 0x7fb15c0176a0 #3 0x00007fb1742f8dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007fb173bbfead in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7fb167fc4700 (LWP 5511)): #0 0x00007fb173bc0483 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fb175548c87 in event_dispatch_epoll_worker (data=0x12beea0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:745 event = {events = 4, data = {ptr = 0x10000000d, fd = 13, u32 = 13, u64 = 4294967309}} ret = 0 ev_data = 0x12beea0 event_pool = 0x126ee40 myindex = 1 timetodie = 0 gen = 0 poller_death_notify = {next = 0x0, prev = 0x0} slot = 0x0 tmp = 0x0 __FUNCTION__ = "event_dispatch_epoll_worker" #2 0x00007fb1742f8dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fb173bbfead in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7fb16b294700 (LWP 5508)): #0 0x00007fb166d3bf66 in client_xattrop (frame=0x7fb13c012a58, this=0x7fb14804c510, loc=0x7fb15c40eae0, flags=GF_XATTROP_ADD_ARRAY, dict=0x7fb13c01b268, xdata=0x7fb13c00c228) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/protocol/client/src/client.c>:1466 ret = -1 conf = 0x7fb148aae440 proc = 0x0 args = {loc = 0x7fb15c40eae0, fd = 0x0, fd_out = 0x0, linkname = 0x0, iobref = 0x0, vector = 0x0, xattr = 0x7fb13c01b268, stbuf = 0x0, oldloc = 0x0, newloc = 0x0, name = 0x0, flock = 0x0, volume = 0x0, basename = 0x0, offset = 0, off_in = 0, off_out = 0, mask = 0, cmd = 0, size = 0, mode = 0, rdev = 0, flags = 0, count = 0, datasync = 0, cmd_entrylk = ENTRYLK_LOCK, type = ENTRYLK_RDLCK, optype = GF_XATTROP_ADD_ARRAY, valid = 0, len = 0, what = GF_SEEK_DATA, lease = 0x0, umask = 0, xdata = 0x7fb13c00c228, locklist = 0x0} __FUNCTION__ = "client_xattrop" #1 0x00007fb166ac050b in afr_selfheal_post_op (frame=0x7fb134021018, this=0x7fb148057190, inode=0x7fb134018fe8, subvol=1, xattr=0x7fb13c01b268, xdata=0x7fb13c00c228) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heal-common.c>:434 _new = 0x7fb13c012a58 old_THIS = 0x7fb148057190 next_xl_fn = 0x7fb166d3be9b <client_xattrop> tmp_cbk = 0x7fb166abff39 <afr_selfheal_post_op_cbk> priv = 0x7fb148963330 local = 0x7fb1340013e8 loc = {path = 0x0, name = 0x0, inode = 0x7fb134018fe8, parent = 0x0, gfid = "Ru*\264\aaL\031\201\361\257\234g\254\307M", pargfid = '\000' <repeats 15 times>} ret = 0 __FUNCTION__ = "afr_selfheal_post_op" #2 0x00007fb166ac1b35 in afr_selfheal_undo_pending (frame=0x7fb134021018, this=0x7fb148057190, inode=0x7fb134018fe8, sources=0x7fb15c410610 "\001\001\001", sinks=0x7fb15c4105f0 "", healed_sinks=0x7fb15c4105d0 "", undid_pending=0x7fb15c410590 "", type=AFR_DATA_TRANSACTION, replies=0x7fb15c40f240, locked_on=0x7fb15c4105b0 "\001\001\001\001\001") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heal-common.c>:668 priv = 0x7fb148963330 local = 0x7fb1340013e8 i = 1 j = 5 pending = 0x7fb15c40f0b0 "" input_dirty = 0x7fb15c40f080 input_matrix = 0x7fb15c40f040 full_heal_mtx_in = 0x7fb15c40ef10 full_heal_mtx_out = 0x7fb15c40ede0 output_dirty = 0x7fb15c40ecc0 output_matrix = 0x7fb15c40ec80 xattr = 0x7fb13c01b268 xdata = 0x7fb13c00c228 __FUNCTION__ = "afr_selfheal_undo_pending" #3 0x00007fb166ad0a73 in __afr_selfheal_data (frame=0x7fb134021018, this=0x7fb148057190, fd=0x7fb1480016b8, locked_on=0x7fb15c410730 "\001\001\001\001\001\177") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heal-data.c>:739 priv = 0x7fb148963330 ret = 5 sources = 0x7fb15c410610 "\001\001\001" sinks = 0x7fb15c4105f0 "" data_lock = 0x7fb15c4105b0 "\001\001\001\001\001" healed_sinks = 0x7fb15c4105d0 "" undid_pending = 0x7fb15c410590 "" locked_replies = 0x7fb15c40f240 source = 0 did_sh = true is_arbiter_the_only_sink = false empty_file = false __FUNCTION__ = "__afr_selfheal_data" #4 0x00007fb166ad150e in afr_selfheal_data (frame=0x7fb134021018, this=0x7fb148057190, fd=0x7fb1480016b8) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heal-data.c>:868 priv = 0x7fb148963330 locked_on = 0x7fb15c410730 "\001\001\001\001\001\177" ret = 5 inode = 0x7fb134018fe8 __FUNCTION__ = "afr_selfheal_data" #5 0x00007fb166acc506 in afr_selfheal_do (frame=0x7fb134021018, this=0x7fb148057190, gfid=0x7fb15c410950 "Ru*\264\aaL\031\201\361\257\234g\254\307M") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heal-common.c>:2514 ret = 0 entry_ret = 1 metadata_ret = 1 data_ret = 1 or_ret = 0 inode = 0x7fb134018fe8 fd = 0x7fb1480016b8 data_selfheal = true metadata_selfheal = true entry_selfheal = false priv = 0x7fb148963330 #6 0x00007fb166acc671 in afr_selfheal (this=0x7fb148057190, gfid=0x7fb15c410950 "Ru*\264\aaL\031\201\361\257\234g\254\307M") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heal-common.c>:2563 ret = -1 frame = 0x7fb134021018 local = 0x7fb1340013e8 #7 0x00007fb166ad8fe7 in afr_shd_selfheal (healer=0x7fb148a9b2d8, child=3, gfid=0x7fb15c410950 "Ru*\264\aaL\031\201\361\257\234g\254\307M") at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heald.c>:328 ret = 0 eh = 0x0 priv = 0x7fb148963330 shd = 0x7fb1489634c8 shd_event = 0x0 path = 0x7fb134012200 "/Link" subvol = 0x7fb148051b40 this = 0x7fb148057190 crawl_event = 0x7fb148a9b2e8 #8 0x00007fb166ad93ad in afr_shd_index_heal (subvol=0x7fb148051b40, entry=0x7fb15800f7f0, parent=0x7fb164e2c040, data=0x7fb148a9b2d8) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/cluster/afr/src/afr-self-heald.c>:424 healer = 0x7fb148a9b2d8 priv = 0x7fb148963330 gfid = "Ru*\264\aaL\031\201\361\257\234g\254\307M" ret = 0 val = 1 __FUNCTION__ = "afr_shd_index_heal" #9 0x00007fb175549f54 in _dir_scan_job_fn (data=0x7fb15c017410) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop-utils.c>:264 scan_data = 0x7fb15c017410 entry = 0x7fb15800f7f0 ret = 0 #10 0x00007fb17551e9a5 in synctask_wrap () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:272 task = 0x7fb15c0176a0 #11 0x00007fb173b0a010 in ?? () from /lib64/libc.so.6 No symbol table info available. #12 0x0000000000000000 in ?? () No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterfs corefile : /glfs_sproc0-5504.core ========================================================= + rm -f /build/install/cores/gdbout.txt + sort /build/install/cores/liblist.txt + uniq + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1391.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1391.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1391.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + [[ builder202.int.aws.gluster.org == *\a\w\s* ]] + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i '' /archives/archived_builds/build-install-regression-test-with-multiplex-1391.tar.bz2 [email protected]:/var/www/glusterfs-logs/regression-test-with-multiplex-1391.bz2 Warning: Identity file not accessible: No such file or directory. Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts. Permission denied (publickey,gssapi-keyex,gssapi-with-mic). lost connection + true + echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1391.bz2' Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1391.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1391/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20190602 /var/log/messages-20190609 /var/log/messages-20190616 /var/log/messages-20190623 tar: Removing leading `/' from member names + case $(uname -s) in ++ uname -s + /sbin/sysctl -w kernel.core_pattern=/%e-%p.core kernel.core_pattern = /%e-%p.core + exit 1 Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list [email protected] https://lists.gluster.org/mailman/listinfo/maintainers
