I was able to get mpiexec to work with shared memory on my cluster.
Here are the steps I took
I had to rebuild mpich and mpiexec with shared memory

First I downloaded the OSCAR version of mpich-1.2.5.10  ( I picked this
one so it would not overwrite anything I had before)

I then installed the srpm
I then copied the tarball to a temp directory visible to the whole
cluster
I untared it
I then typed
./configure -cc=icc -fc=ifc -c++=icc --with-device=ch_p4
--with-comm=shared -rsh=ssh

Next I typed
make

Then I typed
make install --prefix=/opt/mpich-1.2.5.10

Then cexec make install --prefix=/opt/mpich-1.2.5.10


Then for mpiexec
I downloaded mpiexec-0.75 and untared it
I then typed 
 ./configure --with-pbs=/opt/pbs --with-default-comm=mpich-p4
--disable-mpich-gm --disable-emp --with-comm=shared 
make
make install

This installed in the /usr/local/bin directory which is mounted across
my system

Now I'm not sure how to interface OSCARS switcher utility to add this
new mpich so I just modify my path.  This is a sample script to run my
code

To compile the code I used
PATH=/opt/mpich-1.2.5.10/bin:$PATH
export PATH
mpiCC ....

Then to run it under pbs


 #PBS -N s3948pd1.5
 #PBS -l nodes=2:ppn=2
 #PBS -o output
 #PBS -e errors
 #PBS -S /bin/bash
 #PBS -V
 #
 echo "I Ran on:"
 cat $PBS_NODEFILE
 #
 P4_GLOBMEMSIZE=100000000
 export P4_GLOBMEMSIZE
 cd $PBS_O_WORKDIR

 PATH=/opt/mpich-1.2.5.10/bin:$PATH
 export PATH
 /usr/local/bin/mpiexec -v -comm mpich-p4 ~/workspace/mpi/test sim.cfg
shapes.cfg



I hope this helps

****************************************************
Christopher D. Oubre                               *
email: [EMAIL PROTECTED]                     *
research: http://cmt.rice.edu/~coubre              *
Web: http://www.angelfire.com/la2/oubre            *
Hangout: http://pub44.ezboard.com/bsouthterrebonne *
Phone:(713)348-3541  Fax:   (713)348-4150          *
Rice University                                    *
Department of Physics, M.S. 61                     *
6100 Main St.                       ^-^            *
Houston, Tx  77251-1892, USA       (O O)           *
-= Phlax=-                         ( v )           *
************************************m*m*************


-------------------------------------------------------
This sf.net email is sponsored by:ThinkGeek
Welcome to geek heaven.
http://thinkgeek.com/sf
_______________________________________________
Oscar-users mailing list
[EMAIL PROTECTED]
https://lists.sourceforge.net/lists/listinfo/oscar-users

Reply via email to