Re: [O-MPI users] mpirun --prefix
On Jan 4, 2006, at 7:24 PM, Anthony Chan wrote:
How about this -- an ISV asked me for a similar feature a little
while ago: if mpirun is invoked with an absolute pathname, then use
that base directory (minus the difference from $bindir) as an option
to an implicit --prefix.
(your suggestion may actually be parsed as exactly that, but I wasn't
entirely sure)
Yes, that is what I meant. The change should make things easier for
typical MPI users.
Ok, I've added it to the to-do list for the v1.1 series (we're really
only doing bug fixes to the v1.0 series).
--
{+} Jeff Squyres
{+} The Open MPI Project
{+} http://www.open-mpi.org/
Re: [O-MPI users] mpirun --prefix
Hi Jeff,
On Wed, 4 Jan 2006, Jeff Squyres wrote:
> Anthony --
>
> I'm really sorry; we just noticed this message today -- it got lost
> in the post-SC recovery/holiday craziness. :-(
I understand. :)
>
> Your request is fairly reasonable, but I wouldn't want to make it the
> default behavior. Specifically, I can envision some scenarios where
> it might be problematic (e.g., heterogeneous situations -- which we
> don't yet support, but definitely will someday).
>
> How about this -- an ISV asked me for a similar feature a little
> while ago: if mpirun is invoked with an absolute pathname, then use
> that base directory (minus the difference from $bindir) as an option
> to an implicit --prefix.
>
> (your suggestion may actually be parsed as exactly that, but I wasn't
> entirely sure)
Yes, that is what I meant. The change should make things easier for
typical MPI users.
Thanks,
A.Chan
>
>
> On Nov 22, 2005, at 12:20 PM, Anthony Chan wrote:
>
> >
> > This is not a bug just wonder if this can be improved. I have been
> > running openmpi linked program with command
> >
> > /bin/mpirun --prefix \
> > --host A -np N a.out
> >
> > My understanding is that --prefix allows extra search path in
> > addition to
> > PATH and LD_LIBRARY_PATH, correct me if I am wrong. Assuming that
> > openmpi's install directory structure is fixed, would it possible for
> > mpirun to search automatically for libmpi.so &
> > friends so to avoid the redundant --prefix to
> > mpirun ?
> >
> > Thanks,
> > A.Chan
> >
> > ___
> > users mailing list
> > us...@open-mpi.org
> > http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
> --
> {+} Jeff Squyres
> {+} The Open MPI Project
> {+} http://www.open-mpi.org/
>
>
> ___
> users mailing list
> us...@open-mpi.org
> http://www.open-mpi.org/mailman/listinfo.cgi/users
>
>
Re: [O-MPI users] mpirun --prefix
Anthony --
I'm really sorry; we just noticed this message today -- it got lost
in the post-SC recovery/holiday craziness. :-(
Your request is fairly reasonable, but I wouldn't want to make it the
default behavior. Specifically, I can envision some scenarios where
it might be problematic (e.g., heterogeneous situations -- which we
don't yet support, but definitely will someday).
How about this -- an ISV asked me for a similar feature a little
while ago: if mpirun is invoked with an absolute pathname, then use
that base directory (minus the difference from $bindir) as an option
to an implicit --prefix.
(your suggestion may actually be parsed as exactly that, but I wasn't
entirely sure)
On Nov 22, 2005, at 12:20 PM, Anthony Chan wrote:
This is not a bug just wonder if this can be improved. I have been
running openmpi linked program with command
/bin/mpirun --prefix \
--host A -np N a.out
My understanding is that --prefix allows extra search path in
addition to
PATH and LD_LIBRARY_PATH, correct me if I am wrong. Assuming that
openmpi's install directory structure is fixed, would it possible for
mpirun to search automatically for libmpi.so &
friends so to avoid the redundant --prefix to
mpirun ?
Thanks,
A.Chan
___
users mailing list
us...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/users
--
{+} Jeff Squyres
{+} The Open MPI Project
{+} http://www.open-mpi.org/
Re: [O-MPI users] mpirun --prefix
Hello Anthony, On Tuesday 22 November 2005 18:20, Anthony Chan wrote: > This is not a bug just wonder if this can be improved. I have been > running openmpi linked program with command > > /bin/mpirun --prefix \ > --host A -np N a.out > > My understanding is that --prefix allows extra search path in addition to > PATH and LD_LIBRARY_PATH, correct me if I am wrong. Assuming that > openmpi's install directory structure is fixed, would it possible for > mpirun to search automatically for libmpi.so & > friends so to avoid the redundant --prefix to > mpirun ? The problem is, that You need the LD_LIBRARY_PATH set to the ompi/orte-libraries installed on Your system However, with rsh-based startup-method, those paths may not be set on the actual node. Therefore, one solution is to copy those flags responsible with -x PATH and -x LD_LIBRARY_PATH, or shorter to use --prefix so that the rsh-code sets these env.-flags itself. However, You may need to play with the --mca rsh_assume_same_shell 0 flag to the mpirun startup to figure out the way these flags should be set (bash/sh, tcsh/csh-way)... Otherwise, it assumes the same shell as on the machine You run the mpirun/mpiexec. With best regards, Rainer -- - Dipl.-Inf. Rainer Keller email: kel...@hlrs.de High Performance Computing Tel: ++49 (0)711-685 5858 Center Stuttgart (HLRS)Fax: ++49 (0)711-678 7626 POSTAL:Nobelstrasse 19 http://www.hlrs.de/people/keller ACTUAL:Allmandring 30, R. O.030 70550 Stuttgart
Re: [O-MPI users] mpirun --prefix
On Nov 22, 2005, at 12:20 PM, Anthony Chan wrote:
This is not a bug just wonder if this can be improved. I have been
running openmpi linked program with command
/bin/mpirun --prefix \
--host A -np N a.out
My understanding is that --prefix allows extra search path in addition
to
PATH and LD_LIBRARY_PATH, correct me if I am wrong.
Sort of. It actually uses an absolute pathname to launch various
executables (as opposed to launching executables with relative
filenames and letting the $PATH figure it out).
Assuming that openmpi's install directory structure is fixed, would it
possible for
mpirun to search automatically for libmpi.so &
friends so to avoid the redundant --prefix to
mpirun ?
Yes and no.
For the launched processes, yes, we set PATH and LD_LIBRARY_PATH so
that you don't have to in your shell startup files.
But for mpirun itself, no we cannot, because of unix linker/shell
semantics. When you type "mpirun", mpirun itself won't launch until
liborte.so can be found (one of our support libraries). So if the unix
linker can't find liborte.so when you try to launch mpirun, there's
nothing we can do about it -- mpirun isn't even launched, so there's no
code that we can have to set LD_LIBRARY_PATH. That being said, the
rpath in mpirun should be set such that liborte.so should be found
automatically (i.e., without you having to set LD_LIBRARY_PATH).
Hence, the unix linker should be able to find liborte.so regardless of
what you have in LD_LIBRARY_PATH.
The --prefix option is to set LD_LIBRARY_PATH for the started
executables because, at least at the moment, we are not setting the
rpath in user-compiled MPI executables via the wrapper compilers. This
is on the to-do list, but it didn't happen for 1.0.
--
{+} Jeff Squyres
{+} The Open MPI Project
{+} http://www.open-mpi.org/
