Hi Bibek, > Hi there, > Since a simple hello world application works. I tried running > chapel program for multiple node. The computer I am running has slurm as > job scheduler. But I am running into some problem. I even tried running > chapel binary directly into the slurm but it does not work that way.
It is even easier, if correctly configured you should only write: ./hello6-taskpar-dist -nl 2 And that should execute that program inside the queue system, but as if it were executed locally. I prefer to define : export CHPL_LAUNCHER_USE_SBATCH=1 So it is sent to que queue system, so the prompt returns inmediatly and you can see it when doing squeue and the results are returned as usual, inside a file. > *$ srun -p marvin -N 2 -n 4 -c 8 ./hello6-taskpar-dist* > > > Then I read README.multilocale and README.launcher there I found couple of > things on how to launch chapel using slurm. So I tried exporting ... > > export CHPL_COMM=gasnet > export CHPL_COMM_SUBSTRATE=ibv > export CHPL_LAUNCHER_WALLTIME=00:15:00 > export GASNET_SPAWNFN=S > export GASNET_SSH_SERVERS="reno lyra01" > export SSH_CMD=ssh > export SSH_OPTIONS=-x > export GASNET_CSPAWN_CMD="srun -N%N %C" > > and yes I did recompiled after doing all this. > when I do > > ./hello6-taskpar-dist -nl 2 > > Access denied: user bghimire (uid=3030) has no active jobs. > > Connection closed by 12.23.1.1 > > connection to reno failed. > > Terminated > > > I was curious why the slurm was not working in this case. Its just going > through the ssh but not doing any slurm thing > > Another question is what does -N%N %C really mean in export > GASNET_CSPAWN_CMD="srun -N%N %C" and how can I force it to submit job via > slurm to specific node and cores. I would try to use the mpi spawner in gasnet, using: export CHPL_COMM=gasnet export CHPL_COMM_SUBSTRATE=ibv export CHPL_GASNET_SEGMENT=large export CHPL_HOME=correct chapel home export CHPL_LAUNCHER=slurm-gasnetrun_ibv export CHPL_LAUNCHER_USE_SBATCH=1 export CHPL_LAUNCHER_WALLTIME="00:15:00" And for gasnet: export GASNET_IBV_SPAWNER=mpi About how to specify some specific kind of nodes, you can use: export CHPL_LAUNCHER_CONSTRAINT=kind_of_node_as_specified_in_slurm That will put a constraint line in the batch file. Hope it works, Rafael -- Rafael Larrosa Jiménez Centro de Supercomputación y Bioinformática - http://www.scbi.uma.es Universidad de Málaga EMAIL: [email protected] Edificio de Bioinnovación TELEF: + 34951952788 C/ Severo Ochoa 34 FAX : +34951952792 Parque Tecnológico de Andalucía 29590 Málaga (SPAIN) ------------------------------------------------------------------------------ _______________________________________________ Chapel-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/chapel-users
