Richard Chen created YARN-2172:

             Summary: Suspend/Resume Hadoop Jobs
                 Key: YARN-2172
             Project: Hadoop YARN
          Issue Type: New Feature
          Components: resourcemanager, webapp
    Affects Versions: 2.2.0
         Environment: CentOS 6.5, Hadoop 2.2.0
            Reporter: Richard Chen
             Fix For: 2.2.0

In a multi-application cluster environment, jobs running inside Hadoop 
application may be of lower-priority than jobs running inside other 
applications like HBase. To give way to other higher-priority jobs inside 
Hadoop, a user or some cluster-level resource scheduling service should be able 
to suspend and/or resume some particular jobs within Hadoop application.

When target jobs inside Hadoop are suspended, those already allocated and 
running task containers will continue to run until their completion or active 
preemption by other ways. But no more new containers would be allocated to the 
target jobs. In contrast, when suspended jobs are put into resume mode, they 
will continue to run from the previous job progress and have new task 
containers allocated to complete the rest of the jobs.

This message was sent by Atlassian JIRA

Reply via email to