You may also find the "sdiag" command helpful.
Quoting Andy Riebs <[email protected]>:
Hi Scott,
The quick & dirty way would be to take your current command,
sort on the submit date, then remove the items that you don't want.
For example,
$ sacct -X -S ... | sort -k3 >sorted_by_submit.log
$ # now edit the log file
A better long term/reusable solution would be to use a proper
database query, assuming that you are storing the job stats in a
database. I don't really know what the schema looks like any more,
but grepping for "SELECT" in the src/sacct directory would probably
get you pretty close to where you want to go.
Cheers
Andy
On 03/17/2015 04:23 PM, Scott Yockel
wrote:
Slurm Dev,
I’m trying to do some stats on submission times by
users so that I can identify when users are submitting at high
rates, like hundreds of jobs per minute. This way we can work
with them towards using job arrays and lessen the load on
scheduler. I’ve tried using sacct and “-S” but his gives me a
range of submission times since it looks at, I’m guessing, state
changes. Example:
[syockel]$ sacct -X -S 2015-03-16 -u syockel -o
jobid,user,submit,state
JobID User Submit
State
------------ --------- -------------------
----------
35138363 syockel 2015-03-12T16:18:02
PENDING
35511366 syockel 2015-03-17T10:56:57
CANCELLED+
35511426 syockel 2015-03-17T10:59:10
COMPLETED
35512007 syockel 2015-03-17T11:24:18
CANCELLED+
35512164 syockel 2015-03-17T11:27:11
CANCELLED+
35512351 syockel 2015-03-17T11:29:38
RUNNING
As you can see the first job was submitted on
2015-03-12, but I really on want ones from yesterday until now.
I’ve tried adding various “—state=“ combinations but still
cannot get a list that corresponds to a submit time I desire.
Does anyone have a way to do this? Perhaps a strait DB query,
but some help would be nice.
Slurm: 14.11.4
Kernel: 2.6.32-358.14.1.el6.centos.plus.x86_64
Thanks,
~Scott
==================================
Dr. Scott Yockel | Senior Team Lead of HPC
FAS Research Computing | Harvard University
38 Oxford Street Cambridge, MA
Office: 211A | Phone: 617-496-7468
==================================
--
Morris "Moe" Jette
CTO, SchedMD LLC
Commercial Slurm Development and Support
