Hello,
sorry for answering late…
Thank you to everybody!
I will try to increase NFS performance.
Best regards,
Brigitte Selch
Von: John Hearns [mailto:hear...@googlemail.com]
Gesendet: Donnerstag, 28. September 2017 16:45
An: slurm-dev
Betreff: [slurm-dev] Re: MPI-Jobs on cluster - how
Brigitte, are you able to tell us more about this scratch filesystem?
You could arrange that the compute nodes mount it directly, so you get the
performance you need.
Thsi can be achieved by putting a routing node onto the cluster network.
Or you could route throug the cluster head node.
Also you
Hello,
but then I'm not able to minimize the amount of core used on the headnode .
The first running job uses all cores of my headnode, no next job could start
...
I have experimented with OverSubscribe=FORCE, but this can only be defined for
a whole partition not for one node only.
I'm just a
Brigitte, thankyou. That makes sense. I guess that there is an NFS
re-export of the scratch filesystem.
I know this is not an answer to the problem at the moment, maybe you shoud
look at Bee On Demand for the future.
https://www.beegfs.io/wiki/BeeOND
With the disclaimer that I have not implemente
Hi Brigitte,
On Thu, Sep 28, 2017 at 02:51:53AM -0600, Selch, Brigitte (FIDF) wrote:
> We have a cluster with one headnodes and x computenodes.
> Scratch Filesystems are locally attached to the headnode, so the MPI task
> which makes I/O should run on headnode.
> But how can I determine, which n
-files and
result-files, it would be good, to have this job on the headnode.
Thank you!
Von: John Hearns [mailto:hear...@googlemail.com]
Gesendet: Donnerstag, 28. September 2017 11:04
An: slurm-dev
Betreff: [slurm-dev] Re: MPI-Jobs on cluster - how to set batchhost
Brigitte, I understand
Brigitte, I understand what you are trying to achieve.
But may I ask - is there local storage n your compute nodes?
You coudl run a job where the results are written to local storage, then
transferred to your scratch filesystem at the end of the job.
It is normal on HPC cluster to have the scrat
