On Sun, 5 Jul 2009, Yixun Liu wrote: > I run it on my computer. > > md[/home/scratch/yixun/petsc-3.0.0-p3/src/ksp/ksp/examples/tutorials>make > ex2 > > mpicc -o ex2.o -c -Wall -Wwrite-strings -Wno-strict-aliasing -g3 > -I/home/scratch/yixun/petsc-3.0.0-p3/src/dm/mesh/sieve > -I/home/scratch/yixun/petsc-3.0.0-p3/linux-gnu-c-debug/include > -I/home/scratch/yixun/petsc-3.0.0-p3/include > -I/usr/lib64/mpi/gcc/openmpi/include -I/usr/lib64/mpi/gcc/openmpi/lib64 > -D__SDIR__="src/ksp/ksp/examples/tutorials/" ex2.c > mpicc -Wall -Wwrite-strings -Wno-strict-aliasing -g3 -o ex2 ex2.o > -Wl,-rpath,/home/scratch/yixun/petsc-3.0.0-p3/linux-gnu-c-debug/lib > -L/home/scratch/yixun/petsc-3.0.0-p3/linux-gnu-c-debug/lib -lpetscksp > -lpetscdm -lpetscmat -lpetscvec -lpetsc -lX11 -llapack -lblas > -L/usr/lib64/mpi/gcc/openmpi/lib64 > -L/usr/lib64/gcc/x86_64-suse-linux/4.3 -L/usr/lib64 -L/lib64 > -L/usr/x86_64-suse-linux/lib -ldl -lmpi -lopen-rte -lopen-pal -lnsl > -lutil -lgcc_s -lpthread -lmpi_f90 -lmpi_f77 -lgfortranbegin -lgfortran > -lm -lm -L/usr/lib64/gcc/x86_64-suse-linux -L/usr/x86_64-suse-linux/bin > -L/lib -lm -lm -ldl -lmpi -lopen-rte -lopen-pal -lnsl -lutil -lgcc_s > -lpthread -ldl > /bin/rm -f ex2.o
Did you install this OpenMPI - or did someone-else/sysadmin install it for you? > > md[/home/scratch/yixun/petsc-3.0.0-p3/src/ksp/ksp/examples/tutorials>mpiexec > -n 2 ./ex2 > > DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol: > dat_registry_add_provider > DAT: library load failure: /usr/lib64/libdaplcma.so.1: undefined symbol: > dat_registry_add_provider > -------------------------------------------------------------------------- > > WARNING: Failed to open "OpenIB-cma" > [DAT_PROVIDER_NOT_FOUND:DAT_NAME_NOT_REGISTERED]. > This may be a real error or it may be an invalid entry in the uDAPL > Registry which is contained in the dat.conf file. Contact your local > System Administrator to confirm the availability of the interfaces in > the dat.conf file. Your mpiexec is trying to run on infiniban and failing? > -------------------------------------------------------------------------- > [0,1,1]: uDAPL on host md was unable to find any NICs. > Another transport will be used instead, although this may result in > lower performance. > -------------------------------------------------------------------------- > Norm of error 0.000411674 iterations 7 And then it attempts 'sockets' - and then successfully runs the PETSc example.. So something is wrong with your mpi usage. I guess - you'll have to check with your sysadmin - how to correctly use infiniband.. Satish
