See <https://build.gluster.org/job/regression-test-with-multiplex/1402/display/redirect?page=changes>
Changes: [atin] glusterd.h: align structs [Jiffin Thottan] gnfs: use strcpy to prevent memory overflow [Raghavendra G] quick-read: rename cache-invalidation key to avoid redundant keys ------------------------------------------ [...truncated 4.14 MB...] No symbol table info available. Thread 13 (Thread 0x7f93603a1700 (LWP 22394)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f95159b758e in index_worker (data=0x7f94ae942b90) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:216 priv = 0x7f94ae9563e0 this = 0x7f94ae942b90 stub = 0x0 bye = false #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 12 (Thread 0x7f9356df7700 (LWP 22386)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f95173350ca in changelog_ev_connector (data=0x7f93702df868) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/changelog/src/changelog-ev-handle.c>:221 this = 0x7f9370291710 c_clnt = 0x7f93702df868 crpc = 0x0 __FUNCTION__ = "changelog_ev_connector" #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 11 (Thread 0x7f93604e3700 (LWP 22384)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f95159b758e in index_worker (data=0x7f93702a3680) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:216 priv = 0x7f93702b6ed0 this = 0x7f93702a3680 stub = 0x0 bye = false #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 10 (Thread 0x7f93586f9700 (LWP 22382)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f9517da6ec1 in posix_fsyncer_pick (this=0x7f93d60440f0, head=0x7f93586f8150) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2384 priv = 0x7f93d6619ef0 count = 0 #2 0x00007f9517da71dd in posix_fsyncer (d=0x7f93d60440f0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2474 this = 0x7f93d60440f0 priv = 0x7f93d6619ef0 stub = 0x0 tmp = 0x0 list = {next = 0x7f93586f8150, prev = 0x7f93586f8150} count = 0 do_fsync = true __FUNCTION__ = "posix_fsyncer" #3 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 9 (Thread 0x7f93596fb700 (LWP 22380)): #0 0x00007f9528c54fad in nanosleep () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f9528c54e44 in sleep () from /lib64/libc.so.6 No symbol table info available. #2 0x00007f9517da6bf8 in posix_disk_space_check_thread_proc (data=0x7f93d60440f0) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:2317 this = 0x7f93d60440f0 priv = 0x7f93d6619ef0 interval = 5 ret = 0 __FUNCTION__ = "posix_disk_space_check_thread_proc" #3 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 8 (Thread 0x7f935a6fd700 (LWP 22378)): #0 0x00007f9528c850f3 in select () from /lib64/libc.so.6 No symbol table info available. #1 0x00007f95173356dc in changelog_ev_dispatch (data=0x7f93d6094b18) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/changelog/src/changelog-ev-handle.c>:366 ret = 3 opaque = 0x0 this = 0x7f93d60469a0 c_clnt = 0x7f93d6094b18 tv = {tv_sec = 0, tv_usec = 207179} __FUNCTION__ = "changelog_ev_dispatch" #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 7 (Thread 0x7f935b6ff700 (LWP 22376)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f95173350ca in changelog_ev_connector (data=0x7f93d6094b18) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/changelog/src/changelog-ev-handle.c>:221 this = 0x7f93d60469a0 c_clnt = 0x7f93d6094b18 crpc = 0x0 __FUNCTION__ = "changelog_ev_connector" #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 6 (Thread 0x7f937414c700 (LWP 22374)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f95159b758e in index_worker (data=0x7f93d6058910) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:216 priv = 0x7f93d606c180 this = 0x7f93d6058910 stub = 0x0 bye = false #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 5 (Thread 0x7f937428e700 (LWP 22363)): #0 0x00007f95293ca965 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f95159b758e in index_worker (data=0x7f94cbadbb30) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/features/index/src/index.c>:216 priv = 0x7f94cbaef370 this = 0x7f94cbadbb30 stub = 0x0 bye = false #2 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #3 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 4 (Thread 0x7f940ddae700 (LWP 22012)): #0 0x00007f95293cad12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f952a5ed2e1 in syncenv_task (proc=0x192d070) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:517 env = 0x192c170 task = 0x0 sleep_till = {tv_sec = 1562603110, tv_nsec = 0} ret = 0 #2 0x00007f952a5ed4d6 in syncenv_processor (thdata=0x192d070) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:584 env = 0x192c170 proc = 0x192d070 task = 0x7f94e43c7040 #3 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 3 (Thread 0x7f94e1efc700 (LWP 22684)): #0 0x00007f95293cad12 in pthread_cond_timedwait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0 No symbol table info available. #1 0x00007f952a5ed2e1 in syncenv_task (proc=0x192df70) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:517 env = 0x192c170 task = 0x0 sleep_till = {tv_sec = 1562603110, tv_nsec = 0} ret = 0 #2 0x00007f952a5ed4d6 in syncenv_processor (thdata=0x192df70) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:584 env = 0x192c170 proc = 0x192df70 task = 0x7f94e43bff20 #3 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #4 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 2 (Thread 0x7f9317fff700 (LWP 22579)): #0 0x00007f952a5d469e in __gf_mem_invalidate (ptr=0x7f95106b88e9) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:272 header = 0x7f9510607b10 end = 0x7f9510807b68 inval = {magic = 3735929054, mem_acct = 0x18ed560, type = 101, size = 2097152, baseaddr = 0x7f9510607b60} #1 0x00007f952a5d49f1 in __gf_free (free_ptr=0x7f9510607b60) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/mem-pool.c>:350 ptr = 0x7f9510607b10 mem_acct = 0x18ed560 header = 0x7f9510607b10 last_ref = false __PRETTY_FUNCTION__ = "__gf_free" #2 0x00007f952a5eca89 in synctask_destroy (task=0x7f9510606d50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:287 No locals. #3 0x00007f952a5ecb0d in synctask_done (task=0x7f9510606d50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:304 No locals. #4 0x00007f952a5ed437 in synctask_switchto (task=0x7f9510606d50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:557 env = 0x192c170 __FUNCTION__ = "synctask_switchto" #5 0x00007f952a5ed4ef in syncenv_processor (thdata=0x192d430) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:588 env = 0x192c170 proc = 0x192d430 task = 0x7f9510606d50 #6 0x00007f95293c6dd5 in start_thread () from /lib64/libpthread.so.0 No symbol table info available. #7 0x00007f9528c8e02d in clone () from /lib64/libc.so.6 No symbol table info available. Thread 1 (Thread 0x7f94493de700 (LWP 21891)): #0 0x00007f9517da47ee in __posix_janitor_timer_start (this=0x7f937028ed50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:1505 priv = 0x7f9370864c40 timer = 0x0 #1 0x00007f9517da451f in posix_janitor_task_done (ret=0, frame=0x0, data=0x7f937028ed50) at <https://build.gluster.org/job/regression-test-with-multiplex/ws/xlators/storage/posix/src/posix-helpers.c>:1432 this = 0x7f937028ed50 priv = 0x7f9370864c40 #2 0x00007f952a5eca4b in synctask_wrap () at <https://build.gluster.org/job/regression-test-with-multiplex/ws/libglusterfs/src/syncop.c>:274 task = 0x7f95101f8b50 #3 0x00007f9528bd80d0 in ?? () from /lib64/libc.so.6 No symbol table info available. #4 0x0000000000000000 in ?? () No symbol table info available. ========================================================= Finish backtrace program name : /build/install/sbin/glusterfsd corefile : /glfs_sproc003-21581.core ========================================================= + rm -f /build/install/cores/gdbout.txt + sort /build/install/cores/liblist.txt + uniq + cat /build/install/cores/liblist.txt.tmp + grep -v /build/install + tar -cf /archives/archived_builds/build-install-regression-test-with-multiplex-1402.tar /build/install/sbin /build/install/bin /build/install/lib /build/install/libexec /build/install/cores tar: Removing leading `/' from member names + tar -rhf /archives/archived_builds/build-install-regression-test-with-multiplex-1402.tar -T /build/install/cores/liblist.txt tar: Removing leading `/' from member names + bzip2 /archives/archived_builds/build-install-regression-test-with-multiplex-1402.tar + rm -f /build/install/cores/liblist.txt + rm -f /build/install/cores/liblist.txt.tmp + find /archives -size +1G -delete -type f + [[ builder207.int.aws.gluster.org == *\a\w\s* ]] + scp -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -i '' /archives/archived_builds/build-install-regression-test-with-multiplex-1402.tar.bz2 [email protected]:/var/www/glusterfs-logs/regression-test-with-multiplex-1402.bz2 Warning: Identity file not accessible: No such file or directory. Warning: Permanently added 'logs.aws.gluster.org,18.219.45.211' (ECDSA) to the list of known hosts. Permission denied (publickey,gssapi-keyex,gssapi-with-mic). lost connection + true + echo 'Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1402.bz2' Cores and builds archived in https://logs.aws.gluster.org/regression-test-with-multiplex-1402.bz2 + echo 'Open core using the following command to get a proper stack' Open core using the following command to get a proper stack + echo 'Example: From root of extracted tarball' Example: From root of extracted tarball + echo '\t\tgdb -ex '\''set sysroot ./'\'' -ex '\''core-file ./build/install/cores/xxx.core'\'' <target, say ./build/install/sbin/glusterd>' \t\tgdb -ex 'set sysroot ./' -ex 'core-file ./build/install/cores/xxx.core' <target, say ./build/install/sbin/glusterd> + RET=1 + '[' 1 -ne 0 ']' + tar -czf <https://build.gluster.org/job/regression-test-with-multiplex/1402/artifact/glusterfs-logs.tgz> /var/log/glusterfs /var/log/messages /var/log/messages-20190616 /var/log/messages-20190623 /var/log/messages-20190630 /var/log/messages-20190707 tar: Removing leading `/' from member names + case $(uname -s) in ++ uname -s + /sbin/sysctl -w kernel.core_pattern=/%e-%p.core kernel.core_pattern = /%e-%p.core + exit 1 Build step 'Execute shell' marked build as failure _______________________________________________ maintainers mailing list [email protected] https://lists.gluster.org/mailman/listinfo/maintainers
