See <https://build.gluster.org/job/regression-test-with-multiplex/1693/display/redirect?page=changes>
Changes: [Amar Tumballi] protocol/server: structure logging [Amar Tumballi] protocol/server-rpc-fops_v2: structure logging [Amar Tumballi] protocol/server-helpers: structure logging [Amar Tumballi] protocol/client: structure logging [Amar Tumballi] xlator/dht-helper: structure logging ------------------------------------------ [...truncated 3.73 MB...] ./tests/basic/fencing/afr-lock-heal-advanced.t ./tests/basic/fencing/afr-lock-heal-basic.t ./tests/bugs/glusterd/bug-857330/normal.t ./tests/bugs/glusterd/bug-857330/xml.t ./tests/bugs/glusterfs-server/bug-877992.t ./tests/bugs/replicate/bug-1480525.t Result is 1 + gdb -ex 'core-file /glfs_epoll000-14350.core' -ex 'set pagination off' -ex 'info proc exe' -ex q GNU gdb (GDB) Red Hat Enterprise Linux 7.6.1-115.el7 Copyright (C) 2013 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html> This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. [New LWP 14357] [New LWP 14358] [New LWP 14356] [New LWP 14350] [New LWP 14351] [New LWP 14352] [New LWP 14353] [New LWP 14354] [New LWP 14355] [New LWP 14359] Core was generated by `/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'. Program terminated with signal 11, Segmentation fault. #0 0x00007fd2e9e3f5bb in ?? () exe = '/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen' ++ cut -d ' ' -f1 ++ tail -1 ++ cut -d ''\''' -f2 ++ gdb -ex 'core-file /glfs_epoll000-14350.core' -ex 'set pagination off' -ex 'info proc exe' -ex q + executable_name=/build/install/sbin/glusterfs ++ which /build/install/sbin/glusterfs + executable_path=/build/install/sbin/glusterfs + set +x ========================================================= Start printing backtrace program name : /build/install/sbin/glusterfs corefile : /glfs_epoll000-14350.core ========================================================= warning: core file may not match specified executable file. [New LWP 14357] [New LWP 14358] [New LWP 14356] [New LWP 14350] [New LWP 14351] [New LWP 14352] [New LWP 14353] [New LWP 14354] [New LWP 14355] [New LWP 14359] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib64/libthread_db.so.1". Core was generated by `/build/install/sbin/glusterfs -s 127.1.1.3 --volfile-id shd/patchy -p /d/backen'. Program terminated with signal 11, Segmentation fault. #0 0x00007fd2e9e3f5bb in gf_log_flush () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:143 143 if (ctx && ctx->log.logger == gf_logger_glusterlog) { Thread 10 (Thread 0x7fd2da65e700 (LWP 14359)): #0 0x00007fd2e8534851 in clone () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd2e8c6eda0 in ?? () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007fd2da65e700 in ?? () No symbol table info available. #3 0x0000000000000000 in ?? () No symbol table info available. Thread 9 (Thread 0x7fd2df407700 (LWP 14355)): #0 0x00007fd2e8c72da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd2e9e9189c in syncenv_task (proc=0x1df3f60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524 env = 0x1df3ba0 task = 0x0 sleep_till = {tv_sec = 1583257383, tv_nsec = 0} ret = 0 #2 0x00007fd2e9e91a91 in syncenv_processor (thdata=0x1df3f60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591 env = 0x1df3ba0 proc = 0x1df3f60 task = 0x0 #3 0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007fd2e853488d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 8 (Thread 0x7fd2dfc08700 (LWP 14354)): #0 0x00007fd2e8c72da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd2e9e9189c in syncenv_task (proc=0x1df3ba0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:524 env = 0x1df3ba0 task = 0x0 sleep_till = {tv_sec = 1583257383, tv_nsec = 0} ret = 0 #2 0x00007fd2e9e91a91 in syncenv_processor (thdata=0x1df3ba0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:591 env = 0x1df3ba0 proc = 0x1df3ba0 task = 0x0 #3 0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007fd2e853488d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 7 (Thread 0x7fd2e0409700 (LWP 14353)): #0 0x00007fd2e84fb80d in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd2e84fb6a4 in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x00007fd2e9e78e51 in pool_sweeper (arg=0x0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:453 state = {cold_lists = {0x0 <repeats 1024 times>}, n_cold_lists = 0} pool_list = 0x0 i = 0 pending = true #3 0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007fd2e853488d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 6 (Thread 0x7fd2e0c0a700 (LWP 14352)): #0 0x00007fd2e8c76381 in sigwait () from /lib64/libpthread.so.0 No symbol table info available. #1 0x000000000040b3e6 in ?? () No symbol table info available. #2 0x0000000000000000 in ?? () No symbol table info available. Thread 5 (Thread 0x7fd2e140b700 (LWP 14351)): #0 0x00007fd2e8c72da2 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd2e9e53987 in gf_timer_proc (data=0x1df2e40) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/timer.c>:141 now = {tv_sec = 2373372, tv_nsec = 376776019} reg = 0x1df2e40 event = 0x1e3c5e0 tmp = 0x0 old_THIS = 0x0 #2 0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fd2e853488d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (Thread 0x7fd2ea3664c0 (LWP 14350)): #0 0x00007fd2e8c6ffd7 in pthread_join () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007fd2e9ebbd84 in event_dispatch_epoll (event_pool=0x1dead50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:835 i = 2 t_id = 140543612126976 pollercount = 2 ret = 0 ev_data = 0x1e3c900 __FUNCTION__ = "event_dispatch_epoll" #2 0x00007fd2e9e77841 in gf_event_dispatch (event_pool=0x1dead50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event.c>:115 ret = -1 __FUNCTION__ = "gf_event_dispatch" #3 0x000000000040c426 in ?? () No symbol table info available. #4 0x0000000000000000 in ?? () No symbol table info available. Thread 3 (Thread 0x7fd2dec06700 (LWP 14356)): #0 0x00007fd2e852b953 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd2e9eda48e in runner (arg=0x1df7d20) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/contrib/timer-wheel/timer-wheel.c>:186 tv = {tv_sec = 0, tv_usec = 936494} base = 0x1df7d20 #2 0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fd2e853488d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7fd2dc138700 (LWP 14358)): #0 0x00007fd2e8534e63 in epoll_wait () from /lib64/libc.so.6 No symbol table info available. #1 0x00007fd2e9ebba9c in event_dispatch_epoll_worker (data=0x1e3c900) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/event-epoll.c>:741 event = {events = 4, data = {ptr = 0x100000003, fd = 3, u32 = 3, u64 = 4294967299}} ret = 0 ev_data = 0x1e3c900 event_pool = 0x1dead50 myindex = 2 timetodie = 0 gen = 0 poller_death_notify = {next = 0x0, prev = 0x0} slot = 0x0 tmp = 0x0 __FUNCTION__ = "event_dispatch_epoll_worker" #2 0x00007fd2e8c6ee65 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007fd2e853488d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7fd2dc939700 (LWP 14357)): #0 0x00007fd2e9e3f5bb in gf_log_flush () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/logging.c>:143 this = 0x7fd2cc03e080 ctx = 0x1db559000 #1 0x00007fd2e9e49ba1 in gf_print_trace (signum=11, ctx=0x1db4010) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/common-utils.c>:904 msg = '\000' <repeats 1023 times> timestr = '\000' <repeats 63 times> stack = 0x0 #2 0x000000000040b485 in ?? () No symbol table info available. #3 0x0000000000000000 in ?? () No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterfs corefile : /glfs_epoll000-14350.core ========================================================= + rm -f /build/install/cores/gdbout.txt + uniq + sort /build/install/cores/liblist.txt + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + [[ builder200.int.aws.gluster.org == *\a\w\s* ]] + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i **** /archives/archived_builds/build-install-regression-test-with-multiplex-1693.tar.bz2 [email protected]:/var/www/glusterfs-logs/regression-test-with-multiplex-1693.bz2 Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts. + echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1693.bz2' Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1693.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1693/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20200209 /var/log/messages-20200216 /var/log/messages-20200223 /var/log/messages-20200301 tar: Removing leading `/' from member names + case $(uname -s) in ++ uname -s + /sbin/sysctl -w kernel.core_pattern=/%e-%p.core kernel.core_pattern = /%e-%p.core + exit 1 Logs are archived at Build artifacts: https://build.gluster.org/job/regression-test-with-multiplex/ Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list [email protected] https://lists.gluster.org/mailman/listinfo/maintainers
