Hi, Have you tried the ElasticSearch job completion plugin? With Kibana you can have nice charts for reporting and easily query the database to retrieve the information required. It does not support importing old jobs, but as soon as you set it up, you can start getting nice dashboards with kibana. You can get more info in this presentation http://www.hpckp.org/images/training/slurm15/10-new_jobcomp_plugin_for_elasticsearch.pdf or in the github repo of the plugin (already integrated in the slurm 15.x version) https://github.com/asanchez1987/jobcomp-elasticsearch
Cheers, Carlos On Thu, Dec 31, 2015 at 2:22 AM, Chris Samuel <[email protected]> wrote: > > On Wed, 30 Dec 2015 04:59:05 PM Simpson Lachlan wrote: > > > Ohhh, thankyou. This is the first I've heard of this being necessary.( I > saw > > it in the docs, but brushed over it) > > I think it's only really necessary for XDMoD which we've only just started > playing with (it looks really nice), but I've put default and maximum > walltimes on systems I manage for around a decade now. Originally we did > it > to enable planning outages as in my previous job there were some > mathematicians who would run codes for arbitrarily long times (well over 3 > months). > > > Do you have a recommended default time? Your 10 minute limit seems rather > > short? > > That's deliberate, it's meant to force users to think about what they need > rather than just taking the default and making it harder for backfill to > work > efficiently. > > > And Max limit...iirc V3 had a max limit of 96 days or something - I feel > > like a week should be enough, but my colleague tells me that some whole > of > > genome sequencing can take at least that long... > > Our defaults are: > > PartitionName=DEFAULT MaxTime=30-0 DefaultTime=0:10:0 > > So that's 30 days maximum. We have people run jobs for a couple of weeks > easily. > > All the best, > Chris > -- > Christopher Samuel Senior Systems Administrator > VLSCI - Victorian Life Sciences Computation Initiative > Email: [email protected] Phone: +61 (0)3 903 55545 > http://www.vlsci.org.au/ http://twitter.com/vlsci > -- -- Carles Fenoy
