Re: [slurm-users] MariaDB lock problems for sacctmgr delete query
Hi Ole, On 16/02/18 22:23, Ole Holm Nielsen wrote: Question: Is it safer to wait for 17.11.4 where the issue will presumably be solved? I don't think the commit has been backported to 17.11.x to date. It's in master (for 18.08) here: commit 4a16541bf0e005e1984afd4201b97df482e269ee Author: Tim Wickberg Date: Tue Feb 13 21:34:33 2018 -0700 Remove AUTO_INCREMENT resets when removing an association from the database. These calls are apparently quite expensive on larger databases, and nothing requires that the association id number not have any skipped values. So stop doing this. Performance problems first reported by Jessica Nettelblad. Bug 4785. All the best, Chris
Re: [slurm-users] MariaDB lock problems for sacctmgr delete query
We're planning to upgrade Slurm 17.02 to 17.11 soon, so it's important for us to test the slurmdbd and database upgrade before doing the actual upgrade. I've made a *successful* upgrade of the database migration from 17.02 to 17.11, making a dry run on an offlined compute node running CentOS 7.4. The dry run procedure has been documented in my Slurm Wiki page: https://wiki.fysik.dtu.dk/niflheim/Slurm_installation#make-a-dry-run-database-upgrade I tried Jessica's problem command, and it didn't cause any errors in my case: # sacctmgr -i delete account where account=XXX cluster=niflheim At least it appears that we don't get hurt by Slurm Bug 4785 referred to in the page mentioned below. Question: Is it safer to wait for 17.11.4 where the issue will presumably be solved? On 02/14/2018 09:32 PM, Jessica Nettelblad wrote: FYI - SchedMD has now solved the issue in the master branch. https://github.com/SchedMD/slurm/commit/4a16541bf0e005e1984afd4201b97df482e269ee#diff-7649dde209b4e528e3ba8bb090b19f63 Best regards, Jessica Nettelblad, UPPMAX On Wed, Feb 14, 2018 at 3:31 PM, Bjørn-Helge Mevik mailto:b.h.me...@usit.uio.no>> wrote: Thanks for the heads-up! We're currently runnint 17.02.7 with MariaDB, and haven't seen this problem, but we are going to upgrade to 17.11 in the not-to-far-future. /Ole
Re: [slurm-users] MariaDB lock problems for sacctmgr delete query
FYI - SchedMD has now solved the issue in the master branch. https://github.com/SchedMD/slurm/commit/4a16541bf0e005e1984afd4201b97df482e269ee#diff-7649dde209b4e528e3ba8bb090b19f63 Best regards, Jessica Nettelblad, UPPMAX On Wed, Feb 14, 2018 at 3:31 PM, Bjørn-Helge Mevik wrote: > Thanks for the heads-up! We're currently runnint 17.02.7 with MariaDB, > and haven't seen this problem, but we are going to upgrade to 17.11 in > the not-to-far-future. > > -- > Cheers, > Bjørn-Helge Mevik, dr. scient, > Department for Research Computing, University of Oslo >
Re: [slurm-users] MariaDB lock problems for sacctmgr delete query
Thanks for the heads-up! We're currently runnint 17.02.7 with MariaDB, and haven't seen this problem, but we are going to upgrade to 17.11 in the not-to-far-future. -- Cheers, Bjørn-Helge Mevik, dr. scient, Department for Research Computing, University of Oslo signature.asc Description: PGP signature
