The Prolog does not run on the compute hosts until something from the
job actually does something on the compute host. You could add the
configuration parameter "PrologFlags=Alloc" to run the Prolog at job
allocation time, but that will introduce an extra RPC for every job
and make job launch slightly slower.
SPANK is not integrated with sbcast. That could be done, but it is not
currently supported.
I hope that helps.
Quoting Magnus Jonsson <[email protected]>:
Hi everybody.
As some of you may now from my presentation in Lugano we are using a
SPANK-plugin to give private /tmp directories to our users.
One of our users was using the sbcast command to send files to nodes
in the allocation.
This works badly as the SPANK-plugin is not used at all for sbcast.
I'm unsure exactly which part of Slurm that receives the data and
how this is implemented at all and if SPANK should be involved at
all but the files do not show up where the user expects them to be.
Is this solvable in any way with sbcast. For now we just recommended
the user to use "srun cp ${PATH_TO_FILES}/* $TMPDIR/"
Also this has the side effect that the prolog on the node is not run
until you actually send a job to the node.
I.e. you can send data to a node with sbcast before the prolog this
might not be an expected/wanted behaviour.
Best,
Magnus
--
Magnus Jonsson, Developer, HPC2N, Umeå Universitet
--
Morris "Moe" Jette
CTO, SchedMD LLC
Commercial Slurm Development and Support
