On Mon, 22 Apr 2013, Larry Ploetz wrote:
earlier:
We're bringing in an application that will have between 11 and 14 servers
running Red Hat linux. The vendor is recommending a job scheduler.
GNU's parallel has job scheduling capabilities, as long as you can set
up ssh keys/sessions/whatever that don't require entering a password
(e.g., use an ssh agent, predefine and use controlmaster/controlpath).
interesting -- thanks. It builds trivially under a Red Hat 6
series derived environment. Documentation at:
http://www.gnu.org/software/parallel/man.html#example__gnu_parallel_as_queue_system_batch_manager
for using it as a (remote and local) job submission system
We used the 'NQS' system, stabilized by the former Sterling
Software (now owned by IBM), which is available in an open
source variant, again in a Red Hat derived environment for
such purposes. It was well suited to the task of 'fanning
out, and then re-collating similar tasks across several
machine instances. Again, it builds trivially in a Red Hat 6
series derived environment. A short form look at using the
system is in the documentation by a third party is at:
http://www.eecis.udel.edu/documentation/nqs.html
... I have been meaning to re-write a setup, and a user's
'cheat-sheet' guide, but ...
A copy of the Queue manager sources is up at my FTP site:
ftp://ftp.owlriver.com/pub/mirror/ORC/nqs/
I see an RJE tool for non-TCP environments, documented by
Neale of Sine Nomine:
http://www.sinenomine.net/sites/www.sinenomine.net/files/NJEIPBridge.pdf
NASA Ames Research appears to have forked it into 'Portable
Batch Scheduler', and added a enhanced scheduler, but I cannot
immediately put my hands on a FOSS variant of it
http://static.usenix.org/publications/library/proceedings/als00/2000papers/papers/full_papers/bode/bode_html/
The commands appear to be substantially identical to NQS
-- Russ herrold
----------------------------------------------------------------------
For LINUX-390 subscribe / signoff / archive access instructions,
send email to [email protected] with the message: INFO LINUX-390 or visit
http://www.marist.edu/htbin/wlvindex?LINUX-390
----------------------------------------------------------------------
For more information on Linux on System z, visit
http://wiki.linuxvm.org/
