Hello, Finally I got OrangeFS working with OpenMPI 1.6 with Romio. The problem was on the ROMIO side of compilation. Only what I need, it was compile OrangeFS with --enable-shared flag, without any CFLAGS.
Then there were two "patchs" in ROMIO code in OpenMPI, first was in file openmpi-1.6.5/ompi/mca/io/romio/romio/adio/ad_pvfs2/ad_pvfs2_io_dtype.c where I rewrote "swtich" to more "if" (it was already discussed in openmpi mailing list) and second in file: openmpi-1.6.5/ompi/mca/io/romio/romio/adio/ad_pvfs2/ad_pvfs2.c where i rewrote ADIOI_PVFS2_IReadContig and ADIOI_PVFS2_IWriteContig to NULL. This patch I have found here: http://www.orangefs.org/trac/orangefs/browser/branches/OFSTest-dev/OFSTest/OFSTestNode.py?rev=10645#L1328 Then the basic OpenMPI ROMIO program was working, but I didnt done any other more sophisticated tests. Thanks for replay, I didnt try to compile RPM. Hanousek Vít The opemmpi mailing list thread, where it was discused: http://www.open-mpi.org/community/lists/users/2014/02/23638.php Compilation comads that I used: OrangeFS: ./configure --prefix=/usr/local/orangefs --with-kernel=/usr/src/kernels/2.6.32-431.5.1.el6.x86_64\ --with-openib=/usr --without-bmi-tcp --enable-shared make -j32 make install make kmod make kmod_install depmod Patched OpenMPI 1.6.5: ./configure --prefix=/usr/local/openmpi_1.6.5_romio\ --with-io-romio-flags='--with-file-system=pvfs2+ufs+nfs --with-pvfs2=/usr/local/orangefs'\ --with-sge --with-psm make -j 32 make install ---------- Původní zpráva ---------- Od: Dave Love Komu: [email protected] Datum: 24. 3. 2014 23:39:09 Předmět: [Pvfs2-users] Re: OrangeFS kernel module CFLAGS "-fPIC" [Rather delayed as I forgot to retry the bounce I got to start with.] vithanousek writes: > Hello, > > At first excuse my poor level of english. > > I got in problems when I comiled OrangeFS 2.8.7 (current stable), with > CFLAGS="-fPIC". I was navigated by OpenMPI with ROMIO, to recompile OrangeFS > with this flag, without this flag compilation works without problems, but I > need OrangeFS at first for ROMIO. Did you manage to get ROMIO working correctly with it? I was waiting for the reported problem with OMPI 1.6 to be fixed. > I compiled OrangeFS by this way: > export CFLAGS="-fPIC" > ./configure --prefix=/usr/local/orangefs --with-kernel=/usr/src/kernels/2.6. > 32-431.5.1.el6.x86_64 --with-openib=/usr --without-bmi-tcp For what it's worth, I built RH6 RPMS with (which doesn't add -fPIC specifically) and the patch in the parallel SOURCES directory. The problem I found is that the autoconf test uses -Werror, the compiler gives an unused variable warning for the current_fsuid test, and it fails with the normal RPM-defined CFLAGS. I couldn't make building the module under dkms work in the normal way, and I fiddled it in the dkms.conf for the package. I'd be interested if anyone has a better solution. _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users _______________________________________________ Pvfs2-users mailing list [email protected] http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users
