Re: [slurm-users] [EXT] Re: Missing data in sreport for a time period in slurm

2021-10-18 Thread Sean Crosby
Did you change those values to a timestamp before May 2020 like I suggested? If you do that, then Slurm will regenerate the data needed for sreport to work properly. Sean From: mshubham Sent: Tuesday, 19 October 2021 16:20 To: slurm-users@lists.schedmd.com ;

Re: [slurm-users] [EXT] Re: Missing data in sreport for a time period in slurm

2021-10-18 Thread mshubham
Dear All, By checking the value of last ran table, hourly rollup shows today's date. +---+--++- | hourly_rollup | daily_rollup | monthly_rollup| +---+--++- |1634617800 | 1634581800

Re: [slurm-users] [EXT] Re: Missing data in sreport for a time period in slurm

2021-10-18 Thread Sean Crosby
sreport keeps a track of when it has done the last rollup calculations in the database. Open MySQL for your Slurm accounting database, do select * from slurm_acct_db.clustername_last_ran_table; where slurm_acct_db is your accounting database name (slurm_acct_db is default), and clustername is

Re: [slurm-users] Missing data in sreport for a time period in slurm

2021-10-18 Thread mshubham
Dear all, As i recall, there were some runaway jobs one month ago, and i used this command to fix it, and from that date only(from 15 Sept) , previous data from 26 May 2020 to Sept 14 2021 has been gone in sreport. I hope there is no co-relation between using this command and data missing in

Re: [slurm-users] slurm.conf syntax checker?

2021-10-18 Thread Diego Zuccato
Il 15/10/2021 06:02, Marcus Wagner ha scritto: mostly, our problem was, that we forgot to add/remove a node to/from the partitions/topology file, which caused slurmctld to deny startup. So I wrote a simple checker for that. Here is the output of a sample run: Even "just" catching syntax errors

Re: [slurm-users] Missing data in sreport for a time period in slurm

2021-10-18 Thread mshubham
Dear all, "sacctmgr show runawayjobs" doesnot show any problematic jobs. On 10/18/21 12:41 PM, mshubham wrote: > Dear all, > I am facing a issue in slurm(v19.05.1) in which data from 26 May 2020 to > Sept 14 2021 is missing in sreport but the same data is present through > sacct command, It

Re: [slurm-users] Missing data in sreport for a time period in slurm

2021-10-18 Thread Ole Holm Nielsen
On 10/18/21 12:41 PM, mshubham wrote: Dear all, I am facing a issue in slurm(v19.05.1) in which data from 26 May 2020 to Sept 14 2021 is missing in sreport but the same data is present through sacct command, It which was working fine few days ago. Right now, we have to get data utilization

[slurm-users] Missing data in sreport for a time period in slurm

2021-10-18 Thread mshubham
Dear all, I am facing a issue in slurm(v19.05.1) in which data from 26 May 2020 to Sept 14 2021 is missing in sreport but the same data is present through sacct command, It which was working fine few days ago. Right now, we have to get data utilization from sacct command for each user. It would be

Re: [slurm-users] Custom GRES not working in 21.08.2

2021-10-18 Thread Bas van der Vlies
Hi Quirin maybe you have this gres issue https://bugs.schedmd.com/show_bug.cgi?id=12642#c27 -- Bas van der Vlies > On 17 Oct 2021, at 16:32, Quirin Lohr wrote: > > Hi, > > I just upgraded from 20.11 to 21.08.2. > > Now it seems the slurmd cannot handle my custom GRES. > I have set VRAM of