Re: [OMPI devel] Notes on building and running Open MPI on Red Storm

2007-07-12 Thread Joshua Hursey
Thanks for the heads up. I've noticed this warning on the Cray  
systems here at ORNL, and haven't had a chance to put the fix in yet.


This function is exposed in non-CR builds as a user interface item.  
If the user requests a checkpoint of an MPI job that was not compiled  
with C/R (or doesn't have it enabled if FT was compiled in) then it  
will respond with a nice error message instead of not responding at  
all. I go back and forth on cutting this out completely as the tools  
to checkpoint shouldn't be built if a user doesn't compile in FT  
support.


I'll work on a fix for it in the next couple of days.

Cheers,
Josh

On Jul 12, 2007, at 10:40 AM, Brian Barrett wrote:


On Jul 11, 2007, at 4:47 PM, Glendenning, Lisa wrote:


  * When linking with libopen-pal, the following warning is normal:
'In
function `checkpoint_response': warning: mkfifo is not implemented  
and

will always fail'


Josh -

I thought the checkpoint code wasn't built unless requested.  Anyway,
if you AC_CHECK_FUNCS for mkfifo, it'll fail on the Cray.  Can you
update opal/runtime/opal_cr.c to not have code that calls mkfifo()
compiled on platforms that don't have mkfifo?


Thanks,

Brian
___
devel mailing list
de...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/devel



Josh Hursey
jjhur...@open-mpi.org
http://www.open-mpi.org/





Re: [OMPI devel] Notes on building and running Open MPI on Red Storm

2007-07-12 Thread Brian Barrett
Do you have a Subversion account?  If so, feel free to update the  
wiki ;).  If not, we should probably get you an account.  Then feel  
free to update the wiki ;).  But thanks for the notes!


Brian

On Jul 11, 2007, at 4:47 PM, Glendenning, Lisa wrote:


Some supplementary information to the wiki at
https://svn.open-mpi.org/trac/ompi/wiki/CrayXT3.


I. Accessing the Open MPI source:

  * Subversion is installed on redstorm in /projects/unsupported/bin

  * Reddish has subversion in the default path (you don't have to  
load a

module)

  * The proxy information in the wiki is accurate, and works on both
redstorm and reddish


II. Building Open MPI on reddish:

  * 'module load PrgEnv-pgi-xc' to cross compile for redstorm

  * Reddish and redstorm do not have recent enough version of  
autotools,

so you must build your own (currently available in
/project/openmpi/rbbrigh/tools)

  * Suggested configuration: 'configure CC=qk-gcc CXX=qk-pgCC
F77=qk-pgf77 FC=qk-pgf90 --disable-mpi-profile --with- 
platform=redstorm

--host=x86_64-cray-linux-gnu --build=x86_64-unknown-linux-gnu
--disable-mpi-f90 --disable-mem-debug --disable-mem-profile
--disable-debug build_alias=x86_64-unknown-linux-gnu
host_alias=x86_64-cray-linux-gnu'


III. Building with Open MPI:

  * No executables will be installed in $PREFIX/bin, so must compile
without mpicc, e.g. 'qk-gcc -I$PREFIX/include *.c -L$PREFIX/lib -lmpi
-lopen-rte -lopen-pal'

  * When linking with libopen-pal, the following warning is normal:  
'In

function `checkpoint_response': warning: mkfifo is not implemented and
will always fail'


IV. Running on Redstorm:

  * scp your executable from reddish to redstorm

  * Use 'qsub' to submit job and 'yod' to launch job (if you do an
interactive session, you can bypass PBS)

  * qsub expects project/task information - you can either provide  
this

with -A option or set it in $XT_ACCOUNT environmental variable

  * Sample job script for qsub with 8 nodes/processes and 10 minute
runtime:

#!/bin/sh
#PBS -lsize=8
#PBS -lwalltime=10:00
cd $PBS_O_WORKDIR
yod a.out

  * Use 'xtshowmesh' and 'qstat' to query job status and cluster
configuration

___
devel mailing list
de...@open-mpi.org
http://www.open-mpi.org/mailman/listinfo.cgi/devel