[
https://issues.apache.org/jira/browse/HADOOP-3930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matei Zaharia updated HADOOP-3930:
----------------------------------
Description:
We need a way for job schedulers such as HADOOP-3445 and HADOOP-3476 to provide
info to display on the JobTracker web interface and in the CLI. The main things
needed seem to be:
* A way for schedulers to provide info to show in a column on the web UI and in
the CLI - something as simple as a single string, or a map<string, int> for
multiple parameters.
* Some sorting order for jobs - maybe a method to sort a list of jobs.
Let's figure out what the best way to do this is and implement it in the
existing schedulers.
My first-order proposal at an API: Augment the TaskScheduler with
* public Map<String, String> getSchedulingInfo(JobInProgress job) -- returns
key-value pairs which are displayed in columns on the web UI or the CLI for the
list of jobs.
* public Map<String, String> getSchedulingInfo(String queue) -- returns
key-value pairs which are displayed in columns on the web UI or the CLI for the
list of queues.
* public Comparator<JobInProgress> getJobComparator() -- returns a comparator
that can be used to determine the order in which jobs will be run, for sorting
the jobs in the CLI.
* public List<String> getQueues();
was:
We need a way for job schedulers such as HADOOP-3445 and HADOOP-3476 to provide
info to display on the JobTracker web interface and in the CLI. The main things
needed seem to be:
* A way for schedulers to provide info to show in a column on the web UI and in
the CLI - something as simple as a single string, or a map<string, int> for
multiple parameters.
* Some sorting order for jobs - maybe a method to sort a list of jobs.
Let's figure out what the best way to do this is and implement it in the
existing schedulers.
My first-order proposal at an API: Augment the TaskScheduler with
* public Map<String, String> getSchedulingInfo(JobInProgress job) -- returns
key-value pairs which are displayed in columns on the web UI or the CLI for the
list of jobs.
* public Map<String, String> getSchedulingInfo(String queue) -- returns
key-value pairs which are displayed in columns on the web UI or the CLI for the
list of queues.
* public Comparator<JobInProgress> getJobComparator() -- returns a comparator
that can be used to determine the order in which jobs will be run, for sorting
the jobs in the CLI.
> Decide how to integrate scheduler info into CLI and job tracker web page
> ------------------------------------------------------------------------
>
> Key: HADOOP-3930
> URL: https://issues.apache.org/jira/browse/HADOOP-3930
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Matei Zaharia
> Priority: Minor
>
> We need a way for job schedulers such as HADOOP-3445 and HADOOP-3476 to
> provide info to display on the JobTracker web interface and in the CLI. The
> main things needed seem to be:
> * A way for schedulers to provide info to show in a column on the web UI and
> in the CLI - something as simple as a single string, or a map<string, int>
> for multiple parameters.
> * Some sorting order for jobs - maybe a method to sort a list of jobs.
> Let's figure out what the best way to do this is and implement it in the
> existing schedulers.
> My first-order proposal at an API: Augment the TaskScheduler with
> * public Map<String, String> getSchedulingInfo(JobInProgress job) -- returns
> key-value pairs which are displayed in columns on the web UI or the CLI for
> the list of jobs.
> * public Map<String, String> getSchedulingInfo(String queue) -- returns
> key-value pairs which are displayed in columns on the web UI or the CLI for
> the list of queues.
> * public Comparator<JobInProgress> getJobComparator() -- returns a comparator
> that can be used to determine the order in which jobs will be run, for
> sorting the jobs in the CLI.
> * public List<String> getQueues();
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
