Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Simone Riggi
Hi again, I think I managed to make it working with: $ slurmrestd -f /etc/slurm/slurmrestd.conf -a rest_auth/jwt -s openapi/v0.0.36 -vvv 0.0.0.0:6820 Sample request: $ curl -H "X-SLURM-USER-NAME:riggi" -H "X-SLURM-USER-TOKEN:${SLURM_JWT}" http://localhost:6820/slurm/v0.0.36/ping { "meta": {

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Simone Riggi
Ok, I think I have found the plugins in: /root/rpmbuild/BUILD/slurm-20.11.5/src/slurmrestd/plugins/openapi/ I did: make make install and now I have: $ slurmrestd -s list slurmrestd: Possible OpenAPI plugins: slurmrestd: openapi/v0.0.35 slurmrestd: openapi/v0.0.36 slurmrestd: openapi/dbv0.0.36

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Simone Riggi
Thanks very much. I found both files under: /root/rpmbuild/BUILD/slurm-20.11.5/src/slurmrestd/plugins/auth/jwt/.libs/rest_auth_jwt.so /root/rpmbuild/BUILD/slurm-20.11.5/src/slurmrestd/plugins/auth/local/.libs/rest_auth_local.so It seems they weren't installed (any hints why?). By the way I tried

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Ward Poelmans
Hi Simone, On 8/04/2021 15:53, Simone Riggi wrote: > - I see effectively that --with jwt is not listed. I wonder how to build > (using rpmbuild) slurm auth plugins?  >   In general I didn't understand from the doc what plugins slurmrestd > expects by default and where it searches it. From -a

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Simone Riggi
Thanks very much for your reply. - I added this line to the slurm.conf file: AuthAltParameters=jwt_key=/var/spool/slurmctld/jwt_hs256.key I restarted the daemons but this does not change slurmrestd error. I guess this is needed anyway after plugins are found, so thanks for pointing that out. -

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Ward Poelmans
Hi Ole, On 8/04/2021 10:09, Ole Holm Nielsen wrote: > On 4/8/21 9:50 AM, Simone Riggi wrote: >> >> rpmbuild -ta slurm-20.11.5.tar.bz2 --with mysql --with slurmrestd >> --with jwt > > I don't see this "--with jwt" in the slurm.spec file: It's not yet there:

Re: [slurm-users] [EXT] slurmctld error

2021-04-08 Thread Sean Crosby
The memory you tell Slurm (using the RealMemory value) is the memory the jobs can use. So if your nodes have a minimum free RAM of 3353, I think set RealMemory for your nodes to 3300MB. You always have to leave some RAM for OS/caching etc. The way we calculate Slurm RAM is (physical RAM - GPFS

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Ole Holm Nielsen
On 4/8/21 9:50 AM, Simone Riggi wrote: I write you about how to properly setup slurmrestd. ... 2) Installed slurm with: rpmbuild -ta slurm-20.11.5.tar.bz2 --with mysql --with slurmrestd --with jwt I don't see this "--with jwt" in the slurm.spec file: [slurm-20.11.5]# grep "# --with"

Re: [slurm-users] slurmrestd configuration

2021-04-08 Thread Ward Poelmans
Hi Simone, On 8/04/2021 09:50, Simone Riggi wrote: > where /etc/slurm/slurmrestd.conf > > include /etc/slurm/slurm.conf > AuthType=auth/jwt Did you add a key? AuthAltParameters=jwt_key=/etc/slurm/jwt.key It needs to be present on the slurmdbd and slurmctld nodes. Ward

[slurm-users] slurmrestd configuration

2021-04-08 Thread Simone Riggi
Dear all, I write you about how to properly setup slurmrestd. I followed a recent post ( https://groups.google.com/g/slurm-users/c/VDeFmSDao1U/m/Yu0j-VNcBgAJ) but slurmrestd fails with: *slurmrestd: fatal: No authentication plugins to load* Indeed when I run slurmrestd -a list, no plugin is

Re: [slurm-users] [EXT] slurmctld error

2021-04-08 Thread Sean Crosby
The reason why your nodes are drained is "Low RealMemory" This reason is because you have told Slurm about the RAM on the node, but it is less than the RAM on the node. You have told Slurm that the amount of RAM on wn001 is 3934MB What does free -m show on wn001? The DBD looks good now! Can

Re: [slurm-users] [EXT] slurmctld error

2021-04-08 Thread Ioannis Botsis
sacctmgr list cluster Cluster ControlHost ControlPort RPC Share GrpJobs GrpTRES GrpSubmit MaxJobs MaxTRES MaxSubmit MaxWall QOS Def QOS -- --- - - --- - - ---

Re: [slurm-users] [EXT] slurmctld error

2021-04-08 Thread Ioannis Botsis
Hi Sean I made all the changes you recommended but the problem remains. Attached you will find dbd & ctld log files an slurmd log file from one node wn001. Also slum configuration. scontrol show node wn001 NodeName=wn001 Arch=x86_64 CoresPerSocket=2 CPUAlloc=0 CPUTot=2