All I had to do was: 1) export GASNET_SPAWNFN=C 2) export GASNET_CSPAWN_CMD='srun -N%N %C' 3) ./hello6-taskpar-dist -nl 2
Rafael : I will try doing your way too. Once again thank you all for the response. On Thu, Mar 27, 2014 at 5:39 PM, Rafael Larrosa Jiménez <[email protected]>wrote: > Hi Bibek, > > > Hi there, > > Since a simple hello world application works. I tried running > > chapel program for multiple node. The computer I am running has slurm as > > job scheduler. But I am running into some problem. I even tried running > > chapel binary directly into the slurm but it does not work that way. > > It is even easier, if correctly configured you should only write: > > ./hello6-taskpar-dist -nl 2 > > And that should execute that program inside the queue system, but as if it > were executed locally. > > I prefer to define : > export CHPL_LAUNCHER_USE_SBATCH=1 > > So it is sent to que queue system, so the prompt returns inmediatly and > you can see it when doing squeue and the results are returned as usual, > inside a file. > > > > > *$ srun -p marvin -N 2 -n 4 -c 8 ./hello6-taskpar-dist* > > > > > > Then I read README.multilocale and README.launcher there I found couple > of > > things on how to launch chapel using slurm. So I tried exporting ... > > > > export CHPL_COMM=gasnet > > export CHPL_COMM_SUBSTRATE=ibv > > export CHPL_LAUNCHER_WALLTIME=00:15:00 > > export GASNET_SPAWNFN=S > > export GASNET_SSH_SERVERS="reno lyra01" > > export SSH_CMD=ssh > > export SSH_OPTIONS=-x > > export GASNET_CSPAWN_CMD="srun -N%N %C" > > > > and yes I did recompiled after doing all this. > > when I do > > > > ./hello6-taskpar-dist -nl 2 > > > > Access denied: user bghimire (uid=3030) has no active jobs. > > > > Connection closed by 12.23.1.1 > > > > connection to reno failed. > > > > Terminated > > > > > > I was curious why the slurm was not working in this case. Its just going > > through the ssh but not doing any slurm thing > > > > Another question is what does -N%N %C really mean in export > > GASNET_CSPAWN_CMD="srun -N%N %C" and how can I force it to submit job > via > > slurm to specific node and cores. > > I would try to use the mpi spawner in gasnet, using: > > export CHPL_COMM=gasnet > export CHPL_COMM_SUBSTRATE=ibv > export CHPL_GASNET_SEGMENT=large > export CHPL_HOME=correct chapel home > export CHPL_LAUNCHER=slurm-gasnetrun_ibv > export CHPL_LAUNCHER_USE_SBATCH=1 > export CHPL_LAUNCHER_WALLTIME="00:15:00" > > And for gasnet: > export GASNET_IBV_SPAWNER=mpi > > About how to specify some specific kind of nodes, you can use: > > export CHPL_LAUNCHER_CONSTRAINT=kind_of_node_as_specified_in_slurm > > That will put a constraint line in the batch file. > > Hope it works, > > Rafael > -- > Rafael Larrosa Jiménez > Centro de Supercomputación y Bioinformática - http://www.scbi.uma.es > Universidad de Málaga > > EMAIL: [email protected] Edificio de Bioinnovación > TELEF: + 34951952788 C/ Severo Ochoa 34 > FAX : +34951952792 Parque Tecnológico de > Andalucía > 29590 Málaga (SPAIN) > >
------------------------------------------------------------------------------
_______________________________________________ Chapel-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/chapel-users
