On Jan 18, 2007, at 4:33 PM, Murali Vilayannur wrote:
Hi Scott,
Just a shot into the wild...
Can you do
% mv /lib/tls /lib/tls.old
and then rerun the server with valgrind..
It still aborts:
% valgrind --leak-check=full ./sbin/pvfs2-server -d ./etc/fs.conf ./
etc/server.conf-fog33
==15140== Memcheck, a memory error detector for x86-linux.
==15140== Copyright (C) 2002-2005, and GNU GPL'd, by Julian Seward et
al.
==15140== Using valgrind-2.4.0, a program supervision framework for
x86-linux.
==15140== Copyright (C) 2000-2005, and GNU GPL'd, by Julian Seward et
al.
==15140== For more details, rerun with: -v
==15140==
[D 08:17:28.562590] PVFS2 Server version 2.6.1pre1-2007-01-17-144247
starting.
[D 01/19 08:17] bmi_mx: entering BMI_mx_method_addr_lookup.
==15140== Invalid write of size 1
==15140== at 0x1B90583B: strcpy (mac_replace_strmem.c:199)
==15140== by 0x80AC20F: bmx_parse_peername (mx.c:532)
==15140== by 0x80B193E: BMI_mx_method_addr_lookup (mx.c:2546)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x1BBB60E5 is 0 bytes after a block of size 5 alloc'd
==15140== at 0x1B904F75: calloc (vg_replace_malloc.c:175)
==15140== by 0x80AC18D: bmx_parse_peername (mx.c:526)
==15140== by 0x80B193E: BMI_mx_method_addr_lookup (mx.c:2546)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140==
==15140== Invalid read of size 1
==15140== at 0x1B905801: strlen (mac_replace_strmem.c:189)
==15140== by 0x80ABEAC: bmx_verify_hostname (mx.c:414)
==15140== by 0x80AC262: bmx_parse_peername (mx.c:541)
==15140== by 0x80B193E: BMI_mx_method_addr_lookup (mx.c:2546)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x1BBB60E5 is 0 bytes after a block of size 5 alloc'd
==15140== at 0x1B904F75: calloc (vg_replace_malloc.c:175)
==15140== by 0x80AC18D: bmx_parse_peername (mx.c:526)
==15140== by 0x80B193E: BMI_mx_method_addr_lookup (mx.c:2546)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140==
==15140== Invalid read of size 1
==15140== at 0x1BAF24DA: strspn (in /lib/libc-2.3.2.so)
==15140== by 0x80AC262: bmx_parse_peername (mx.c:541)
==15140== by 0x80B193E: BMI_mx_method_addr_lookup (mx.c:2546)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x1BBB60E5 is 0 bytes after a block of size 5 alloc'd
==15140== at 0x1B904F75: calloc (vg_replace_malloc.c:175)
==15140== by 0x80AC18D: bmx_parse_peername (mx.c:526)
==15140== by 0x80B193E: BMI_mx_method_addr_lookup (mx.c:2546)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
[D 01/19 08:17] bmi_mx: leaving BMI_mx_method_addr_lookup.
==15140== Warning: noted but unhandled ioctl 0x4D4F (type=0x4D,
nr=0x4F, size=0) with no size/direction hints.
==15140== ioctl was on file "/dev/mx0"
==15140== This could cause spurious value errors to appear.
==15140== See README_MISSING_SYSCALL_OR_IOCTL for guidance on
writing a proper wrapper.
==15140== Warning: noted but unhandled ioctl 0x4D06 (type=0x4D,
nr=0x6, size=0) with no size/direction hints.
==15140== ioctl was on file "/dev/mx0"
==15140== This could cause spurious value errors to appear.
==15140== See README_MISSING_SYSCALL_OR_IOCTL for guidance on
writing a proper wrapper.
==15140== Warning: noted but unhandled ioctl 0x4D13 (type=0x4D,
nr=0x13, size=0) with no size/direction hints.
==15140== ioctl was on file "/dev/mx0"
==15140== This could cause spurious value errors to appear.
==15140== See README_MISSING_SYSCALL_OR_IOCTL for guidance on
writing a proper wrapper.
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x1B9F0C6A: pthread_create@@GLIBC_2.1 (in /lib/
libpthread-0.10.so)
==15140== by 0x1BA577B5: mx_open_endpoint (mx_open_endpoint.c:453)
==15140== by 0x80ACD0E: bmx_open_endpoint (mx.c:788)
==15140== by 0x80ACF86: BMI_mx_initialize (mx.c:895)
==15140== by 0x805A2C6: activate_method (bmi.c:1914)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x52BFE580 is on thread 1's stack
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x1BA577B5: mx_open_endpoint (mx_open_endpoint.c:453)
==15140== by 0x80ACD0E: bmx_open_endpoint (mx.c:788)
==15140== by 0x80ACF86: BMI_mx_initialize (mx.c:895)
==15140== by 0x805A2C6: activate_method (bmi.c:1914)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x52BFE67C is on thread 1's stack
[D 01/19 08:17] bmi_mx: memory used at end of initialization 17200540.
[D 01/19 08:17] bmi_mx: entering BMI_mx_set_info.
[D 01/19 08:17] bmi_mx: leaving BMI_mx_set_info.
[D 01/19 08:17] bmi_mx: entering BMI_mx_set_info.
[D 01/19 08:17] bmi_mx: leaving BMI_mx_set_info.
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x80C1CDD: dbpf_thread_initialize (dbpf-thread.c:44)
==15140== by 0x80C3589: dbpf_initialize (dbpf-mgmt.c:537)
==15140== by 0x80712E8: trove_initialize (trove-mgmt.c:108)
==15140== by 0x8054C37: server_initialize_subsystems (pvfs2-
server.c:1011)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x52BFE8AC is on thread 1's stack
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x8068F81: PINT_thread_mgr_bmi_start (thread-mgr.c:463)
==15140== by 0x806C37C: fp_multiqueue_initialize (flowproto-
multiqueue.c:312)
==15140== by 0x806A196: PINT_flow_initialize (flow.c:193)
==15140== by 0x8054CDE: server_initialize_subsystems (pvfs2-
server.c:1043)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x52BFE89C is on thread 1's stack
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x8068E93: PINT_thread_mgr_trove_start (thread-mgr.c:
412)
==15140== by 0x806C39E: fp_multiqueue_initialize (flowproto-
multiqueue.c:318)
==15140== by 0x806A196: PINT_flow_initialize (flow.c:193)
==15140== by 0x8054CDE: server_initialize_subsystems (pvfs2-
server.c:1043)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140== Address 0x52BFE89C is on thread 1's stack
[E 01/19 08:17] TROVE:DBPF:Berkeley DB: read: 0x1da457f0, 4096: Bad
address
[E 01/19 08:17] TROVE:DBPF:Berkeley DB: //scratch/atchley/4e901077/
collection_attributes.db: Bad address
[E 01/19 08:17] src/server/pvfs2-server.c line 1077: Error
initializing filesystem pvfs2-fs
[E 01/19 08:17] [bt] ./sbin/pvfs2-server [0x8054de6]
[E 01/19 08:17] [bt] ./sbin/pvfs2-server [0x8054691]
[E 01/19 08:17] [bt] ./sbin/pvfs2-server(main+0x4b0) [0x8054078]
[E 01/19 08:17] [bt] /lib/libc.so.6(__libc_start_main+0xc6)
[0x1ba91e36]
[E 01/19 08:17] [bt] ./sbin/pvfs2-server(aio_cancel64+0x61)
[0x80539a1]
[E 01/19 08:17] Error: Could not initialize server interfaces; aborting.
[E 01/19 08:17] Error: Could not initialize server; aborting.
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x80692E6: PINT_thread_mgr_bmi_stop (thread-mgr.c:618)
==15140== by 0x806C3D7: fp_multiqueue_finalize (flowproto-
multiqueue.c:338)
==15140== by 0x806A300: PINT_flow_finalize (flow.c:251)
==15140== by 0x8055E02: server_shutdown (pvfs2-server.c:1503)
==15140== by 0x8054370: main (pvfs2-server.c:704)
==15140== Address 0x52BFE974 is on thread 1's stack
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x8069242: PINT_thread_mgr_trove_stop (thread-mgr.c:586)
==15140== by 0x806C3F1: fp_multiqueue_finalize (flowproto-
multiqueue.c:344)
==15140== by 0x806A300: PINT_flow_finalize (flow.c:251)
==15140== by 0x8055E02: server_shutdown (pvfs2-server.c:1503)
==15140== by 0x8054370: main (pvfs2-server.c:704)
==15140== Address 0x52BFE974 is on thread 1's stack
[D 01/19 08:17] bmi_mx: entering BMI_mx_finalize.
Dumping MX statistics for endpoint 3 on board 0:
isend tiny ( 0- 32): 0
isend small ( 33- 128): 0
isend medium ( 129- 32768): 0
isend large ( > 32768): 0
isend total : 0
issend total : 0
irecv : 0
expected : 0
unexpected : 0 (including 0 claimed by the handler)
early fragments : 0
overlap: 181976 test before completion out of 181976
overlap: 0 non-blocking wait out of 0
overlap: 0 completion overlapped out of 0
resent_slow/resent: 0/0
delayed_acks/total_acks: 0/0
rcache: hits 0 (0 kbytes) miss 0 (0 kbytes)
mcp handles: got 0 missed 0
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x1BA54BBA: mx_close_endpoint (mx_close_endpoint.c:87)
==15140== by 0x80AD2A8: BMI_mx_finalize (mx.c:945)
==15140== by 0x80575BB: BMI_finalize (bmi.c:403)
==15140== by 0x8055EAF: server_shutdown (pvfs2-server.c:1512)
==15140== by 0x8054370: main (pvfs2-server.c:704)
==15140== Address 0x52BFE954 is on thread 1's stack
[D 01/19 08:17] bmi_mx: 0 misses.
[D 01/19 08:17] bmi_mx: memory leaked at shutdown 0.
[D 01/19 08:17] bmi_mx: leaving BMI_mx_finalize.
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x80C1DC9: dbpf_thread_finalize (dbpf-thread.c:66)
==15140== by 0x80C35A3: dbpf_finalize (dbpf-mgmt.c:544)
==15140== by 0x8071368: trove_finalize (trove-mgmt.c:134)
==15140== by 0x8055F64: server_shutdown (pvfs2-server.c:1521)
==15140== by 0x8054370: main (pvfs2-server.c:704)
==15140== Address 0x52BFE974 is on thread 1's stack
==15140==
==15140== Syscall param write(buf) points to uninitialised byte(s)
==15140== at 0x1B9F4A3B: write (in /lib/libpthread-0.10.so)
==15140== by 0x1BAA7AE1: exit (in /lib/libc-2.3.2.so)
==15140== by 0x80561D2: server_shutdown (pvfs2-server.c:1565)
==15140== by 0x8054370: main (pvfs2-server.c:704)
==15140== Address 0x52BFE9AC is on thread 1's stack
==15140==
==15140== ERROR SUMMARY: 13 errors from 13 contexts (suppressed: 21
from 1)
==15140== malloc/free: in use at exit: 8982 bytes in 26 blocks.
==15140== malloc/free: 795 allocs, 769 frees, 84372826 bytes allocated.
==15140== For counts of detected errors, rerun with: -v
==15140== searching for pointers to 26 not-freed blocks.
==15140== checked 484084 bytes.
==15140==
==15140==
==15140== 56 (36 direct, 20 indirect) bytes in 1 blocks are
definitely lost in loss record 13 of 18
==15140== at 0x1B90459D: malloc (vg_replace_malloc.c:130)
==15140== by 0x80B20AD: alloc_method_addr (bmi-method-support.c:99)
==15140== by 0x80AFD95: bmx_alloc_method_addr (mx.c:1916)
==15140== by 0x80B1AC1: BMI_mx_method_addr_lookup (mx.c:2570)
==15140== by 0x805A267: activate_method (bmi.c:1903)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140==
==15140==
==15140== 8160 bytes in 1 blocks are definitely lost in loss record
18 of 18
==15140== at 0x1B90459D: malloc (vg_replace_malloc.c:130)
==15140== by 0x1B9F092E: __pthread_initialize_manager (in /lib/
libpthread-0.10.so)
==15140== by 0x1B9F0C6A: pthread_create@@GLIBC_2.1 (in /lib/
libpthread-0.10.so)
==15140== by 0x1BA577B5: mx_open_endpoint (mx_open_endpoint.c:453)
==15140== by 0x80ACD0E: bmx_open_endpoint (mx.c:788)
==15140== by 0x80ACF86: BMI_mx_initialize (mx.c:895)
==15140== by 0x805A2C6: activate_method (bmi.c:1914)
==15140== by 0x80573F9: BMI_initialize (bmi.c:173)
==15140== by 0x8054A66: server_initialize_subsystems (pvfs2-
server.c:961)
==15140== by 0x8054690: server_initialize (pvfs2-server.c:801)
==15140== by 0x8054077: main (pvfs2-server.c:551)
==15140==
==15140== LEAK SUMMARY:
==15140== definitely lost: 8196 bytes in 2 blocks.
==15140== indirectly lost: 20 bytes in 2 blocks.
==15140== possibly lost: 0 bytes in 0 blocks.
==15140== still reachable: 766 bytes in 22 blocks.
==15140== suppressed: 0 bytes in 0 blocks.
==15140== Reachable blocks (those to which a pointer was found) are
not shown.
==15140== To see them, rerun with: --show-reachable=yes
_______________________________________________
Pvfs2-developers mailing list
[email protected]
http://www.beowulf-underground.org/mailman/listinfo/pvfs2-developers
