Vlad, 2.8.4 has a couple of problems with newer kernels, we are just about to release 2.8.5 (running through final tests), it fixes many (hopefully all, for now - as kernels go). We were wanting to have this out in December, but the migration from CVS to SVN delayed us a bit (and working through jenkins updates, etc..)
If you go to SVN to grab it, make sure you look for the 2.8.5 tag, trunk has the 2.9.0 line in it (capability based security and distributed metadata for directory entries) and it needs a little more baking. you can also just grab the pre release of 2.8.5 from here: http://www.orangefs.org/download/orangefs-2.8.5-pre.tar.gz there will be a couple newer changes in the actual release when it surfaces (there is one other kernel module issue that is addressed).. hope that helps, -b On Sun, Jan 22, 2012 at 6:26 PM, Vlad Popa <[email protected]> wrote: > Hi! > > I was just evaluating orangefs on a Puias/Centos 6.1 Linux 64 bit with > Mellanox IB Cards installed and OFED stack 1.5.3.2. I was following the > steps written in the quick-howto and everything went well up to this point: > > [vlad@gpu01 bin]$ ./pvfs2-ls /mnt/pvfs2/ > [E 23:50:30.043098] Warning: openib_mem_register: ibv_register_mr. > [E 23:50:30.043200] PVFS_isys_fs_add call: Cannot allocate memory > *** glibc detected *** ./pvfs2-ls: double free or corruption (out): > 0x0000000001624150 *** > ======= Backtrace: ========= > /lib64/libc.so.6[0x32aec75156] > ./pvfs2-ls(PINT_smcb_free+**0xcd)[0x4607fd] > ./pvfs2-ls(PVFS_sys_fs_add+**0x3f)[0x42e1af] > ./pvfs2-ls(main+0x3fc)[**0x40e46c] > /lib64/libc.so.6(__libc_start_**main+0xfd)[0x32aec1ec9d] > ./pvfs2-ls[0x40c779] > ======= Memory map: ======== > 00400000-00492000 r-xp 00000000 08:01 7616507 > /usr/local/bin/pvfs2-ls > 00691000-00699000 rw-p 00091000 08:01 7616507 > /usr/local/bin/pvfs2-ls > 00699000-0069b000 rw-p 00000000 00:00 0 > 015de000-01723000 rw-p 00000000 00:00 0 > [heap] > 32ae400000-32ae420000 r-xp 00000000 08:01 8654247 > /lib64/ld-2.12.so > 32ae61f000-32ae620000 r--p 0001f000 08:01 8654247 > /lib64/ld-2.12.so > 32ae620000-32ae621000 rw-p 00020000 08:01 8654247 > /lib64/ld-2.12.so > 32ae621000-32ae622000 rw-p 00000000 00:00 0 > 32aec00000-32aed86000 r-xp 00000000 08:01 8654248 > /lib64/libc-2.12.so > 32aed86000-32aef85000 ---p 00186000 08:01 8654248 > /lib64/libc-2.12.so > 32aef85000-32aef89000 r--p 00185000 08:01 8654248 > /lib64/libc-2.12.so > 32aef89000-32aef8a000 rw-p 00189000 08:01 8654248 > /lib64/libc-2.12.so > 32aef8a000-32aef8f000 rw-p 00000000 00:00 0 > 32af000000-32af002000 r-xp 00000000 08:01 8654250 > /lib64/libdl-2.12.so > 32af002000-32af202000 ---p 00002000 08:01 8654250 > /lib64/libdl-2.12.so > 32af202000-32af203000 r--p 00002000 08:01 8654250 > /lib64/libdl-2.12.so > 32af203000-32af204000 rw-p 00003000 08:01 8654250 > /lib64/libdl-2.12.so > 32af400000-32af417000 r-xp 00000000 08:01 8654254 > /lib64/libpthread-2.12.so > 32af417000-32af616000 ---p 00017000 08:01 8654254 > /lib64/libpthread-2.12.so > 32af616000-32af617000 r--p 00016000 08:01 8654254 > /lib64/libpthread-2.12.so > 32af617000-32af618000 rw-p 00017000 08:01 8654254 > /lib64/libpthread-2.12.so > 32af618000-32af61c000 rw-p 00000000 00:00 0 > 32b0800000-32b0816000 r-xp 00000000 08:01 8654275 > /lib64/libgcc_s-4.4.5-**20110214.so.1 > 32b0816000-32b0a15000 ---p 00016000 08:01 8654275 > /lib64/libgcc_s-4.4.5-**20110214.so.1 > 32b0a15000-32b0a16000 rw-p 00015000 08:01 8654275 > /lib64/libgcc_s-4.4.5-**20110214.so.1 > 3fb0a00000-3fb0a0d000 r-xp 00000000 08:01 7615310 > /usr/lib64/libibverbs.so.1.0.0 > 3fb0a0d000-3fb0c0c000 ---p 0000d000 08:01 7615310 > /usr/lib64/libibverbs.so.1.0.0 > 3fb0c0c000-3fb0c0d000 rw-p 0000c000 08:01 7615310 > /usr/lib64/libibverbs.so.1.0.0 > 7eff4defa000-7eff4df01000 r-xp 00000000 08:01 7608219 > /usr/lib64/libmlx4-rdmav2.so > 7eff4df01000-7eff4e100000 ---p 00007000 08:01 7608219 > /usr/lib64/libmlx4-rdmav2.so > 7eff4e100000-7eff4e101000 rw-p 00006000 08:01 7608219 > /usr/lib64/libmlx4-rdmav2.so > 7eff4e101000-7eff4e106000 r-xp 00000000 08:01 7608741 > /usr/lib64/libnes-rdmav2.so > 7eff4e106000-7eff4e306000 ---p 00005000 08:01 7608741 > /usr/lib64/libnes-rdmav2.so > 7eff4e306000-7eff4e307000 rw-p 00005000 08:01 7608741 > /usr/lib64/libnes-rdmav2.so > 7eff4e307000-7eff4e30a000 r-xp 00000000 08:01 7612278 > /usr/lib64/libipathverbs-**rdmav2.so > 7eff4e30a000-7eff4e50a000 ---p 00003000 08:01 7612278 > /usr/lib64/libipathverbs-**rdmav2.so > 7eff4e50a000-7eff4e50b000 rw-p 00003000 08:01 7612278 > /usr/lib64/libipathverbs-**rdmav2.so > 7eff4e50b000-7eff4e512000 r-xp 00000000 08:01 7606791 > /usr/lib64/libmthca-rdmav2.so > 7eff4e512000-7eff4e712000 ---p 00007000 08:01 7606791 > /usr/lib64/libmthca-rdmav2.so > 7eff4e712000-7eff4e713000 rw-p 00007000 08:01 7606791 > /usr/lib64/libmthca-rdmav2.so > 7eff4e713000-7eff4e717000 rw-p 00000000 00:00 0 > 7eff4e726000-7eff4e727000 -w-s d0006000 00:05 10551 > /dev/infiniband/uverbs0 > 7eff4e727000-7eff4e728000 rw-p 00000000 00:00 0 > 7fff33ff1000-7fff34006000 rw-p 00000000 00:00 0 > [stack] > 7fff34041000-7fff34042000 r-xp 00000000 00:00 0 > [vdso] > ffffffffff600000-**ffffffffff601000 r-xp 00000000 00:00 0 > [vsyscall] > Aborted (core dumped) > > I was evaluating orangefs version 2.8.4, kernel is > 2.6.32-131.6.1.el6.x86_64 on a rhel/centos 6.1 based installation. > > Any clues how to get out of this ? Can I be sure, that the cvs version is > free of this ? > > > Greetings from Europe/Austria > > Vlad Popa > ______________________________**_________________ > Pvfs2-users mailing list > Pvfs2-users@beowulf-**underground.org<[email protected]> > http://www.beowulf-**underground.org/mailman/**listinfo/pvfs2-users<http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users> >
_______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
