See <https://build.gluster.org/job/regression-test-with-multiplex/1836/display/redirect>
Changes: ------------------------------------------ [...truncated 3.91 MB...] 6 test(s) needed retry ./tests/00-geo-rep/georep-basic-dr-rsync-arbiter.t ./tests/basic/distribute/file-rename.t ./tests/basic/distribute/rebal-all-nodes-migrate.t ./tests/basic/nl-cache.t ./tests/bugs/bug-1371806_2.t ./tests/bugs/posix/bug-1113960.t Result is 1 + gdb -ex 'core-file /glfs_sigwait-24439.core' -ex 'set pagination off' -ex 'info proc exe' -ex q GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-119.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. [New LWP 24441] [New LWP 24444] [New LWP 24440] [New LWP 24478] [New LWP 24439] [New LWP 24479] [New LWP 24442] [New LWP 24443] [New LWP 24445] Core was generated by `glusterd'. Program terminated with signal 11, Segmentation fault. #0 0x00007f8020f22cef in ?? () exe = 'glusterd' ++ gdb -ex 'core-file /glfs_sigwait-24439.core' -ex 'set pagination off' -ex 'info proc exe' -ex q ++ cut -d ''\''' -f2 ++ cut -d ' ' -f1 ++ tail -1 + executable_name=glusterd ++ which glusterd + executable_path=/build/install/sbin/glusterd + set +x ========================================================= Start printing backtrace program name : /build/install/sbin/glusterd corefile : /glfs_sigwait-24439.core ========================================================= warning: core file may not match specified executable file. [New LWP 24441] [New LWP 24444] [New LWP 24440] [New LWP 24478] [New LWP 24439] [New LWP 24479] [New LWP 24442] [New LWP 24443] [New LWP 24445] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `glusterd'. Program terminated with signal 11, Segmentation fault. #0 0x00007f8020f22cef in _IO_cleanup () from /lib64/libc.so.6 Thread 9 (Thread 0x7f801765c700 (LWP 24445)): #0 0x00007f8020f9a9a3 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f80229493e2 in runner (arg=0x1b69470) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/contrib/timer-wheel/timer-wheel.c>:186 tv = {tv_sec = 0, tv_usec = 159514} base = 0x1b69470 #2 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 8 (Thread 0x7f801865e700 (LWP 24443)): #0 0x00007f80216e1de2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f8022900b16 in syncenv_task (proc=0x1b652f0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524 env = 0x1b652f0 task = 0x0 sleep_till = {tv_sec = 1589130767, tv_nsec = 0} ret = 0 #2 0x00007f8022900d0b in syncenv_processor (thdata=0x1b652f0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591 env = 0x1b652f0 proc = 0x1b652f0 task = 0x7f8004004510 #3 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 7 (Thread 0x7f8018e5f700 (LWP 24442)): #0 0x00007f8020f6a85d in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8020f6a6f4 in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f80228e803b in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:453 state = {cold_lists = {0x0 <repeats 1024 times>}, n_cold_lists = 0} pool_list = 0x7f8022bc1570 <pool_threads> i = 0 pending = false #3 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 6 (Thread 0x7f8013662700 (LWP 24479)): #0 0x00007f8020fa3eb3 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f802292a9f0 in event_dispatch_epoll_worker (data=0x1c3ac90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:741 event = {events = 17, data = {ptr = 0x100000004, fd = 4, u32 = 4, u64 = 4294967300}} ret = 0 ev_data = 0x1c3ac90 event_pool = 0x1b5cce0 myindex = 1 timetodie = 0 gen = 0 poller_death_notify = {next = 0x0, prev = 0x0} slot = 0x0 tmp = 0x0 __FUNCTION__ = "event_dispatch_epoll_worker" #2 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 5 (Thread 0x7f8022dd54c0 (LWP 24439)): #0 0x00007f80216df017 in pthread_join () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f802292acd8 in event_dispatch_epoll (event_pool=0x1b5cce0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:835 i = 1 t_id = 140188058003200 pollercount = 1 ret = 0 ev_data = 0x1c3ac90 __FUNCTION__ = "event_dispatch_epoll" #2 0x00007f80228e6a2b in gf_event_dispatch (event_pool=0x1b5cce0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event.c>:115 ret = -1 __FUNCTION__ = "gf_event_dispatch" #3 0x000000000040c426 in ?? () No symbol table info available. #4 0x0000000000000000 in ?? () No symbol table info available. Thread 4 (Thread 0x7f8013e63700 (LWP 24478)): #0 0x00007f80216e1a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f8016a5d111 in hooks_worker (args=0x1b6fd90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/mgmt/glusterd/src/glusterd-hooks.c>:527 conf = 0x1c1bb10 hooks_priv = 0x1c37ce0 stub = 0x7f7ffc193a00 #2 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (Thread 0x7f8019e61700 (LWP 24440)): #0 0x00007f80216e1de2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f80228c2b71 in gf_timer_proc (data=0x1b64980) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:141 now = {tv_sec = 248226, tv_nsec = 860141155} reg = 0x1b64980 event = 0x7f7ffc005a30 tmp = 0x0 old_THIS = 0x7f8022bc38e0 <global_xlator> #2 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7f8017e5d700 (LWP 24444)): #0 0x00007f80216e1de2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f8022900b16 in syncenv_task (proc=0x1b656b0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524 env = 0x1b652f0 task = 0x0 sleep_till = {tv_sec = 1589130769, tv_nsec = 0} ret = 0 #2 0x00007f8022900d0b in syncenv_processor (thdata=0x1b656b0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591 env = 0x1b652f0 proc = 0x1b656b0 task = 0x7f8004004030 #3 0x00007f80216ddea5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f8020fa38dd in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7f8019660700 (LWP 24441)): #0 0x00007f8020f22cef in _IO_cleanup () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f8020edec9b in __run_exit_handlers () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f8020eded37 in exit () from /lib64/libc.so.6 No symbol table info available. #3 0x0000000000409704 in ?? () No symbol table info available. #4 0x0000000000000001 in ?? () No symbol table info available. #5 0x00000000000186c0 in ?? () No symbol table info available. #6 0x00000000004161a0 in ?? () No symbol table info available. #7 0x000000000000000f in ?? () No symbol table info available. #8 0x0000000000000000 in ?? () No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterd corefile : /glfs_sigwait-24439.core ========================================================= + rm -f /build/install/cores/gdbout.txt + sort /build/install/cores/liblist.txt + uniq + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1836.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1836.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1836.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + [[ builder210.int.aws.gluster.org == *\a\w\s* ]] + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i **** /archives/archived_builds/build-install-regression-test-with-multiplex-1836.tar.bz2 [email protected]:/var/www/glusterfs-logs/regression-test-with-multiplex-1836.bz2 Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts. + echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1836.bz2' Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1836.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1836/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20200419 /var/log/messages-20200426 /var/log/messages-20200503 /var/log/messages-20200510 tar: Removing leading `/' from member names + case $(uname -s) in ++ uname -s + /sbin/sysctl -w kernel.core_pattern=/%e-%p.core kernel.core_pattern = /%e-%p.core + exit 1 Logs are archived at Build artifacts: https://build.gluster.org/job/regression-test-with-multiplex/ Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list [email protected] https://lists.gluster.org/mailman/listinfo/maintainers
