[
https://issues.apache.org/jira/browse/TEZ-2627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14635678#comment-14635678
]
Saikat edited comment on TEZ-2627 at 7/21/15 7:31 PM:
------------------------------------------------------
[~rajesh.balamohan] [~hitesh]
YARN-2003 got merged in hadoop trunk.
Can you please comment on the following approach:
We can create a new configuration tez.job.priority(default value of 0, based on
YARN-2003).
In TezClientUtils.java, createApplicationSubmissionContext(), we can read the
configuration(which can be hard coded or passed as CL arguement), to provide a
job priority to the submitted DAG.
The path for both session and non session mode, goes through this method before
submitting an application.
example usage:
hadoop jar tez_extract/tez-examples-0.8.0-SNAPSHOT.jar orderedwordcount
-Dtez.queue.name=<queuename> -Dtez.job.priority=4 <ip> <op>
was (Author: saikatr):
[~rajesh.balamohan] [~hitesh]
YARN-2003 got merged in hadoop trunk.
Can you please comment on the following approach:
We can create a new configuration tez.job.priority(default value of 0, based on
YARN-2003).
In TezClientUtils.java, createApplicationSubmissionContext(), we can read the
configuration(which can be hard coded or passed as CL arguement), to provide a
job priority to the submitted DAG.
example usage:
hadoop jar tez_extract/tez-examples-0.8.0-SNAPSHOT.jar orderedwordcount
-Dtez.queue.name=<queuename> -Dtez.job.priority=4 <ip> <op>
> Support for Tez Job Priorities
> ------------------------------
>
> Key: TEZ-2627
> URL: https://issues.apache.org/jira/browse/TEZ-2627
> Project: Apache Tez
> Issue Type: Improvement
> Reporter: Saikat
> Assignee: Saikat
>
> When a Tez Job is submitted via TezClient, an ApplicationSubmissionContext is
> created before submitting the job. ApplicationSubmissionContext has a
> priority field which can be used to provide a priority for the job.
> There is an ongoing effort in the Yarn Community to enable application
> priorities(https://issues.apache.org/jira/browse/YARN-1963).
> https://issues.apache.org/jira/browse/YARN-2003 implements the necessary
> changes in RM and Capacity Scheduler.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
