On 2012-11-20 01:22, Danny Auble wrote: > > In reference to file staging Slurm has sbcast > (http://www.schedmd.com/slurmdocs/sbcast.html) that can be used to > broadcast your files out to your home directories on your compute nodes.
But not in the simple way as Torque's -W stagein/stageout option. It is usable mostly for distributing files from a computing node to others in the same parallel job. If I want to distribute files from submission node to computing nodes it requires usage of salloc or shared file system as staging area. The same is also for sbatch output, which stays on computing node, where the job was executed or should be redirected to shared area. Regards, Rolandas Naujikas > Danny > > On 11/19/2012 10:24 AM, Mario Kadastik wrote: >> Hi, >> >> we're setting up a test instance of slurm. So far I've gotten as far as >> slurm control node and one worker node configured. I'm able to use the >> slurm-torque interface commands to send a job that actually does things on >> the workernode, but the output is kept at the workernode as we do not use >> shared home directories. For some reason I cannot run srun directly: >> >> [mario@slurm-1 ~]$ srun /bin/hostname >> srun: error: Couldn't find the specified plugin name for launch/slurm >> looking at all files >> srun: error: cannot find launch plugin for launch/slurm >> srun: error: cannot create launch context for launch/slurm >> Segmentation fault >> [mario@slurm-1 ~]$ >> >> the slurm I built is built from slurm-2.5.0-0.rc1.tar.bz2 using rpmbuild -ta >> slurm-2.5.0-0.rc1.tar.bz2. So far on the headnode I installed: >> [root@slurm-1 ~]# rpm -qa|grep slurm >> slurm-plugins-2.5.0-0.rc1.el6.x86_64 >> slurm-torque-2.5.0-0.rc1.el6.x86_64 >> slurm-sjstat-2.5.0-0.rc1.el6.x86_64 >> slurm-2.5.0-0.rc1.el6.x86_64 >> slurm-sjobexit-2.5.0-0.rc1.el6.x86_64 >> slurm-munge-2.5.0-0.rc1.el6.x86_64 >> slurm-perlapi-2.5.0-0.rc1.el6.x86_64 >> >> haven't set up accounting yet so those packages weren't installed. >> >> The srun peculiarity somewhat disturbs me, but as qrun worked i'm not 100% >> sure what's going on. However I was curious if slurm supports input / output >> stageing using scp or similar? Our current cluster is based on torque, which >> uses scp to stage in input files and stage out output files. Most of the >> tools used for submission by users as well as through grid assume the PBS >> staging code so my interest is wether this is possible to be set up as well? >> Should this be done through prologue/epilogue scripts or is there some >> native way to do it? >> >> Thanks, >> >> Mario Kadastik, PhD >> Researcher >> >> --- >> "Physics is like sex, sure it may have practical reasons, but that's not >> why we do it" >> -- Richard P. Feynman
