I don't think the LD_LIBRARY_PATH belongs on our command line -
shouldn't you do that before calling mpiexec? Ralph Aniruddha Shet wrote: #PBS -l walltime=0:01:00 #PBS -l nodes=4:ppn=2 #PBS -N aniruddha_job #PBS -S /bin/bashcd $HOME/NPB/NPB3.2/NPB3.2-MPI/bin/OMPI/EP/A/4_NO /home/osu4005/openmpi/openmpi_NO/bin/mpiexec --bynode --prefix /home/osu4005/openmpi/openmpi_NO --mca btl mvapi -n 4 LD_LIBRARY_PATH=/usr/local/intel-8.0-20040716/lib:$LD_LIBRARY_PATH ./ep.A.4 > results.ep.A.4 ----- Original Message ----- From: "Jeff Squyres (jsquyres)" <jsquy...@cisco.com> To: "Open MPI Users" <us...@open-mpi.org> Sent: Thursday, April 13, 2006 7:42 AM Subject: Re: [OMPI users] Error while loading shared librariesIf you are using PBS, the environment of where you ran "qsub" is automatically copied out to the first node in your job where your script is run. Can you send your torque job script?-----Original Message----- From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On Behalf Of Aniruddha Shet Sent: Thursday, April 13, 2006 12:13 AM To: Open MPI Users Subject: Re: [OMPI users] Error while loading shared libraries The error message is coming from all nodes. I explicitly add the path of Intel shared library to LD_LIBRARY_PATH on my mpiexec command, in addition to it being added in my shell startup file. I make a batch request to PBS. The Intel shared library is on a common file system across compute nodes. ----- Original Message ----- From: "Jeff Squyres (jsquyres)" <jsquy...@cisco.com> To: "Open MPI Users" <us...@open-mpi.org> Sent: Wednesday, April 12, 2006 11:03 PM Subject: Re: [OMPI users] Error while loading shared librariesMy mistake -- I missed the "orted" part of the error message. "orted" is a helper application that is intentally launchedby Open MPIduring mpirun. What is happening is that it is not able to find the Intel libraries, and is therefore failing to launch. So why is it not finding the Intel shared library? - is this error message coming from a remote node? - is your LD_LIBRARY_PATH set for all your remote nodes?For example,if you're using rsh or ssh to start processes (vs. aresource managersuch as SLURM or Torque), you will need to ensure that your shell startup files on all the nodes sets LD_LIBRARY_PATHproperly (i.e., it'snot enough to "setenv LD_LIBRARY_PATH ...; mpirun ..." because the LD_LIBRARY_PATH value won't be set on all the nodes) - Is the Intel shared library available on all your nodes?(you didn'tspecify if the applications that you are able to run wereon all yourcompute nodes or just on the node where you compiled them)-----Original Message----- From: Aniruddha Shet [mailto:s...@cse.ohio-state.edu] Sent: Wednesday, April 12, 2006 12:17 PM To: Open MPI Users Cc: Jeff Squyres (jsquyres) Subject: Re: [OMPI users] Error while loading shared libraries Hi, I am able to run non-OpenMPI MPI jobs where the MPI library is built on top of Intel compilers. Plus, non-MPI jobs built with Intel compilers run just fine. So, I am not sure how to go about fixing this. Thanks, Aniruddha ----- Original Message ----- From: "Jeff Squyres (jsquyres)" <jsquy...@cisco.com> To: "Open MPI Users" <us...@open-mpi.org> Sent: Wednesday, April 12, 2006 8:30 AM Subject: Re: [OMPI users] Error while loading shared librariesGreetings. Your logs look normal. The problem appears to be how you compiled / linked your final executable. You said that you used -static -- I don't knowoffhand ifthat is a supported flag for the intel compiler or not.Did you *link*with -static, or just *compile* with it? Try running "ldd" on your executable -- it will show which shared libraries your executable links against. I *think* that libcprts.so is a library internal to theInter compiler-- so even if icc supports "-static", this library may beexempted...?(that's a total guess -- I'm not familiar with theinternals of theIntel compilers) If this is the case, you might tryinstalling theIntel compiler run-time libraries on all your nodes (this seems unattractive, though). Regardless, I don't think that this is an MPI problem --you might wantto try playing around with compiling some simple [non-MPI]"hello world"applications with your Intel compiler to figure out howto compilethings statically.-----Original Message----- From: users-boun...@open-mpi.org [mailto:users-boun...@open-mpi.org] On Behalf Of Aniruddha Shet Sent: Monday, April 10, 2006 10:06 PM To: us...@open-mpi.org Subject: [OMPI users] Error while loading shared libraries Hi, I have built OpenMPI using ifort and icc Intel compilers with --enable-static --disable-shared options. I compilemy job usingOpenMPI wrapper compilers, additionally with -static option. When I run the job, I get the error 'orted:error while loading sharedlibraries:libcprts.so.5: cannot open shared object file: No such file or directory'. I also have the path of Intel compiler libraries in LD_LIBRARY_PATH. Please find attached a tar file having config.log andompi_info output.Thanks, Aniruddha -------------------------------------------------------------- -------------------- Aniruddha Shet | Project webpage: http://forge-fre.ornl.gov/molar/index.html Graduate Research Associate | Project webpage:www.cs.unm.edu/~fastosDept. of Comp. Sci. & Engg | Personal webpage: www.cse.ohio-state.edu/~shet The Ohio State University | Office: DL 474 2015 Neil Avenue | Phone: +1 (614) 292 7036 Columbus OH 43210-1277 | Cell: +1 (614) 446 1630 -------------------------------------------------------------- --------------------_______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users_______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users_______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users_______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users_______________________________________________ users mailing list us...@open-mpi.org http://www.open-mpi.org/mailman/listinfo.cgi/users |
- [OMPI users] Error while loading shared libraries Aniruddha Shet
- Re: [OMPI users] Error while loading shared l... Jeff Squyres (jsquyres)
- Re: [OMPI users] Error while loading shar... Aniruddha Shet
- Re: [OMPI users] Error while loading shared l... Jeff Squyres (jsquyres)
- Re: [OMPI users] Error while loading shar... Aniruddha Shet
- Re: [OMPI users] Error while loading shared l... Jeff Squyres (jsquyres)
- Re: [OMPI users] Error while loading shar... Aniruddha Shet
- Re: [OMPI users] Error while loading ... Ralph Castain
- [OMPI users] Error while loading shared libra... Rohan Deshpande
- Re: [OMPI users] Error while loading shar... Rayson Ho
- Re: [OMPI users] Error while loading ... Rohan Deshpande
- Re: [OMPI users] Error while load... Reuti
- Re: [OMPI users] Error while... Rohan Deshpande