See <https://build.gluster.org/job/regression-test-with-multiplex/1804/display/redirect>
Changes: ------------------------------------------ [...truncated 3.80 MB...] 6 test(s) needed retry ./tests/basic/distribute/rebal-all-nodes-migrate.t ./tests/bugs/bug-1064147.t ./tests/bugs/bug-1702299.t ./tests/bugs/replicate/bug-1037501.t ./tests/features/ssl-authz.t ./tests/glusterfind/glusterfind-basic.t Result is 1 + gdb -ex 'core-file /glfs_sigwait-2892.core' -ex 'set pagination off' -ex 'info proc exe' -ex q GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-115.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. [New LWP 2894] [New LWP 2895] [New LWP 2896] [New LWP 2925] [New LWP 2893] [New LWP 2892] [New LWP 2926] [New LWP 2898] [New LWP 2897] Core was generated by `glusterd'. Program terminated with signal 11, Segmentation fault. #0 0x00007f92bd2a9c9f in ?? () exe = 'glusterd' ++ gdb -ex 'core-file /glfs_sigwait-2892.core' -ex 'set pagination off' -ex 'info proc exe' -ex q ++ cut -d ''\''' -f2 ++ cut -d ' ' -f1 ++ tail -1 + executable_name=glusterd ++ which glusterd + executable_path=/build/install/sbin/glusterd + set +x ========================================================= Start printing backtrace program name : /build/install/sbin/glusterd corefile : /glfs_sigwait-2892.core ========================================================= warning: core file may not match specified executable file. [New LWP 2894] [New LWP 2895] [New LWP 2896] [New LWP 2925] [New LWP 2893] [New LWP 2892] [New LWP 2926] [New LWP 2898] [New LWP 2897] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `glusterd'. Program terminated with signal 11, Segmentation fault. #0 0x00007f92bd2a9c9f in _IO_cleanup () from /lib64/libc.so.6 Thread 9 (Thread 0x7f92b41fd700 (LWP 2897)): #0 0x00007f92bda68da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f92bec87b16 in syncenv_task (proc=0x16046b0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524 env = 0x16042f0 task = 0x0 sleep_till = {tv_sec = 1587679431, tv_nsec = 0} ret = 0 #2 0x00007f92bec87d0b in syncenv_processor (thdata=0x16046b0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591 env = 0x16042f0 proc = 0x16046b0 task = 0x7f92a0003c90 #3 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 8 (Thread 0x7f92b39fc700 (LWP 2898)): #0 0x00007f92bd321953 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f92becd03e8 in runner (arg=0x1608470) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/contrib/timer-wheel/timer-wheel.c>:186 tv = {tv_sec = 0, tv_usec = 177533} base = 0x1608470 #2 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 7 (Thread 0x7f92afa03700 (LWP 2926)): #0 0x00007f92bd32ae63 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f92becb19f6 in event_dispatch_epoll_worker (data=0x16d9c90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:741 event = {events = 17, data = {ptr = 0x100000004, fd = 4, u32 = 4, u64 = 4294967300}} ret = 0 ev_data = 0x16d9c90 event_pool = 0x15fbce0 myindex = 1 timetodie = 0 gen = 0 poller_death_notify = {next = 0x0, prev = 0x0} slot = 0x0 tmp = 0x0 __FUNCTION__ = "event_dispatch_epoll_worker" #2 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 6 (Thread 0x7f92bf15c4c0 (LWP 2892)): #0 0x00007f92bda65fd7 in pthread_join () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f92becb1cde in event_dispatch_epoll (event_pool=0x15fbce0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:835 i = 1 t_id = 140267988465408 pollercount = 1 ret = 0 ev_data = 0x16d9c90 __FUNCTION__ = "event_dispatch_epoll" #2 0x00007f92bec6da2b in gf_event_dispatch (event_pool=0x15fbce0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event.c>:115 ret = -1 __FUNCTION__ = "gf_event_dispatch" #3 0x000000000040c426 in ?? () No symbol table info available. #4 0x0000000000000000 in ?? () No symbol table info available. Thread 5 (Thread 0x7f92b6201700 (LWP 2893)): #0 0x00007f92bda68da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f92bec49b71 in gf_timer_proc (data=0x1603980) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:141 now = {tv_sec = 2131514, tv_nsec = 836751570} reg = 0x1603980 event = 0x7f92a401c9d0 tmp = 0x0 old_THIS = 0x7f92bef4a8e0 <global_xlator> #2 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (Thread 0x7f92b0204700 (LWP 2925)): #0 0x00007f92bda689f5 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f92b2dfd111 in hooks_worker (args=0x160ed90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-hooks.c>:527 conf = 0x16bab10 hooks_priv = 0x16d6ce0 stub = 0x7f92a401c940 #2 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (Thread 0x7f92b49fe700 (LWP 2896)): #0 0x00007f92bda68da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f92bec87b16 in syncenv_task (proc=0x16042f0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524 env = 0x16042f0 task = 0x0 sleep_till = {tv_sec = 1587679431, tv_nsec = 0} ret = 0 #2 0x00007f92bec87d0b in syncenv_processor (thdata=0x16042f0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591 env = 0x16042f0 proc = 0x16042f0 task = 0x7f92a0003c90 #3 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7f92b51ff700 (LWP 2895)): #0 0x00007f92bd2f180d in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f92bd2f16a4 in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f92bec6f03b in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:453 state = {cold_lists = {0x0 <repeats 1024 times>}, n_cold_lists = 0} pool_list = 0x7f92bef48570 <pool_threads> i = 0 pending = false #3 0x00007f92bda64e65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f92bd32a88d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7f92b5a00700 (LWP 2894)): #0 0x00007f92bd2a9c9f in _IO_cleanup () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f92bd265c4b in __run_exit_handlers () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f92bd265ce7 in exit () from /lib64/libc.so.6 No symbol table info available. #3 0x0000000000409704 in ?? () No symbol table info available. #4 0x0000000000000001 in ?? () No symbol table info available. #5 0x00000000000186c0 in ?? () No symbol table info available. #6 0x00000000004161a0 in ?? () No symbol table info available. #7 0x000000000000000f in ?? () No symbol table info available. #8 0x0000000000000000 in ?? () No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterd corefile : /glfs_sigwait-2892.core ========================================================= + rm -f /build/install/cores/gdbout.txt + sort /build/install/cores/liblist.txt + uniq + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1804.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1804.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1804.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + [[ builder210.int.aws.gluster.org == *\a\w\s* ]] + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i **** /archives/archived_builds/build-install-regression-test-with-multiplex-1804.tar.bz2 [email protected]:/var/www/glusterfs-logs/regression-test-with-multiplex-1804.bz2 Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts. + echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1804.bz2' Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1804.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1804/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20200329 /var/log/messages-20200405 /var/log/messages-20200412 /var/log/messages-20200419 tar: Removing leading `/' from member names + case $(uname -s) in ++ uname -s + /sbin/sysctl -w kernel.core_pattern=/%e-%p.core kernel.core_pattern = /%e-%p.core + exit 1 Logs are archived at Build artifacts: https://build.gluster.org/job/regression-test-with-multiplex/ Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list [email protected] https://lists.gluster.org/mailman/listinfo/maintainers
