Anton, On the node that you saw the failure (u02n065) can you verify what the max locked memory limit is set to? In a bash shell you can do this with ulimit -l. It should be set to at least 128K. Also please verify that the available memory on the node (/proc/meminfo shows this) is sufficient as it may be possible that some zombie processes on that node are consuming memory.
Avneesh -----Original Message----- From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On Behalf Of Anton Shterenlikht Sent: Thursday, July 08, 2010 9:07 AM To: us...@open-mpi.org Subject: [OMPI users] ipath_userinit: userinit command failed: Cannot allocate memory I'm trying to use MPI with fortran on Linux 2.6.18-164.6.1.el5 x86_64 I compiled this trivial code with mpif90: program simple include 'mpif.h' integer numtasks, rank, ierr, rc rc=1 call MPI_INIT(ierr) if (ierr .ne. 0) then print *,'Error starting MPI program. Terminating.' call MPI_ABORT(MPI_COMM_WORLD, rc, ierr) end if call MPI_COMM_RANK(MPI_COMM_WORLD, rank, ierr) call MPI_COMM_SIZE(MPI_COMM_WORLD, numtasks, ierr) print *, 'Number of tasks=',numtasks,' My rank=',rank ! ****** do some work ****** call MPI_FINALIZE(ierr) end I run it with mpirun. When I use 2 cpus or less, all is fine. When I try to specify more than 2 cpus I get this error: u02n065:0.ipath_userinit: userinit command failed: Cannot allocate memory u02n065:0.Driver initialization failure on /dev/ipath where u02n065 is the node name. Please advise many thanks anton -- Anton Shterenlikht Room 2.6, Queen's Building Mech Eng Dept Bristol University University Walk, Bristol BS8 1TR, UK Tel: +44 (0)117 331 5944 Fax: +44 (0)117 929 4423 _______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users
