[
https://issues.apache.org/jira/browse/HADOOP-3876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12655416#action_12655416
]
David Litster commented on HADOOP-3876:
---------------------------------------
Sorry to add my $0.02 so late in the process, but since you already use Torque
and Condor to actually spawn the Hadoop Clusters and start jobs, have you
considered adding functionality to HOD to allow external widely-used schedulers
(such as the open-source Maui, Moab, PBSpro, LSF, etc. ) to control the
scheduling of HOD clusters and jobs via the above-mentioned API (or the
command-line or web service APIs)? This would allow sites that already have an
existing scheduler and want to add the ability to run Hadoop jobs to be able to
do so while taking advantage of their existing infrastructure in terms of
users, SLAs, priorities, accounts, groups, etc.
Thanks for all the effort!
> Hadoop Core should support source filesfor multiple schedulers
> --------------------------------------------------------------
>
> Key: HADOOP-3876
> URL: https://issues.apache.org/jira/browse/HADOOP-3876
> Project: Hadoop Core
> Issue Type: New Feature
> Reporter: Vivek Ratan
>
> Besides the default JT scheduling algorithm, there is work going on with at
> least two more schedulers (HADOOP-3445, HADOOP-3746). HADOOP-3412 makes it
> easier to plug in new schedulers into the JT. Where do we place the source
> files for various schedulers so that it's easy for users to choose their
> scheduler of choice during deployment, and easy for developers to add in more
> schedulers into the framework (without inundating it).
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
