[jira] [Created] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
skrho created YARN-3758: --- Summary: The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container Key: YARN-3758 URL: https://issues.apache.org/jira/browse/YARN-3758 Project:

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568667#comment-14568667 ] Hadoop QA commented on YARN-3749: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated YARN-3758: Description: Hello there~~ I have 2 clusters First cluster is 5 node , default 1 application queue, Capacity

[jira] [Updated] (YARN-3706) Generalize native HBase writer for additional tables

2015-06-02 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joep Rottinghuis updated YARN-3706: --- Attachment: YARN-3726-YARN-2928.004.patch YARN-3726-YARN-2928.004.patch : - fixed bug in

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-06-02 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568789#comment-14568789 ] Varun Saxena commented on YARN-2962: Was waiting for an input from [~vinodkv] and

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568670#comment-14568670 ] Hadoop QA commented on YARN-3753: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3756) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
skrho created YARN-3756: --- Summary: The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container Key: YARN-3756 URL: https://issues.apache.org/jira/browse/YARN-3756 Project:

[jira] [Updated] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-02 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3753: -- Attachment: YARN-3753.2.patch RM failed to come up with java.io.IOException: Wait for ZKClient creation timed

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568797#comment-14568797 ] Hadoop QA commented on YARN-3753: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3591) Resource Localisation on a bad disk causes subsequent containers failure

2015-06-02 Thread Lavkesh Lahngir (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568834#comment-14568834 ] Lavkesh Lahngir commented on YARN-3591: --- [~zxu] :Can we get away without storing into

[jira] [Created] (YARN-3757) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
skrho created YARN-3757: --- Summary: The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container Key: YARN-3757 URL: https://issues.apache.org/jira/browse/YARN-3757 Project:

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

2015-06-02 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568682#comment-14568682 ] Rohith commented on YARN-3733: -- Updated the summary as per defect. DominantRC#compare() does

[jira] [Commented] (YARN-3170) YARN architecture document needs updating

2015-06-02 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568853#comment-14568853 ] Brahma Reddy Battula commented on YARN-3170: Updated patch..Kindly review!!

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568735#comment-14568735 ] Hadoop QA commented on YARN-3749: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Updated] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho updated YARN-3758: Description: Hello there~~ I have 2 clusters First cluster is 5 node , default 1 application queue, 8G Physical

[jira] [Updated] (YARN-3755) Log the command of launching containers

2015-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-3755: - Attachment: YARN-3755-2.patch Upload new patch to address the checkstyle issue Log the command of

[jira] [Resolved] (YARN-3757) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho resolved YARN-3757. - Resolution: Duplicate The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in

[jira] [Commented] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568790#comment-14568790 ] Naganarasimha G R commented on YARN-3758: - YARN-3756 and YARN-3757 are same as this

[jira] [Resolved] (YARN-3756) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread skrho (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] skrho resolved YARN-3756. - Resolution: Duplicate The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in

[jira] [Assigned] (YARN-3761) Set delegation token service address at the server side

2015-06-02 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3761: -- Assignee: Varun Saxena Set delegation token service address at the server side

[jira] [Updated] (YARN-3069) Document missing properties in yarn-default.xml

2015-06-02 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-3069: - Attachment: YARN-3069.011.patch Thanks Akira! New patch with the following changes: - Fix description

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Sergey Shelukhin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569548#comment-14569548 ] Sergey Shelukhin commented on YARN-1462: [~sseth] can you please comment on the

[jira] [Commented] (YARN-3069) Document missing properties in yarn-default.xml

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569646#comment-14569646 ] Hadoop QA commented on YARN-3069: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Siddharth Seth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569648#comment-14569648 ] Siddharth Seth commented on YARN-1462: -- ApplicationReport.newInstance is used by

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569773#comment-14569773 ] Jason Lowe commented on YARN-3585: -- +1 latest patch lgtm. Will commit this tomorrow if

[jira] [Updated] (YARN-2392) add more diags about app retry limits on AM failures

2015-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2392: - Priority: Minor (was: Major) add more diags about app retry limits on AM failures

[jira] [Commented] (YARN-3591) Resource Localisation on a bad disk causes subsequent containers failure

2015-06-02 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569727#comment-14569727 ] zhihai xu commented on YARN-3591: - Hi [~lavkesh], I think we can create a separate JIRA for

[jira] [Updated] (YARN-2392) add more diags about app retry limits on AM failures

2015-06-02 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated YARN-2392: - Attachment: YARN-2392-002.patch Patch 002 * in sync with trunk * uses String.format for a more

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-02 Thread Matthew Jacobs (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569778#comment-14569778 ] Matthew Jacobs commented on YARN-2194: -- I'm confused, does this mean that you'll

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

2015-06-02 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570039#comment-14570039 ] Craig Welch commented on YARN-3510: --- [~leftnoteasy] and I had some offline discussion.

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-02 Thread Matthew Jacobs (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570040#comment-14570040 ] Matthew Jacobs commented on YARN-2194: -- Thanks, [sidharta-s]. So the change would be

[jira] [Updated] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3762: --- Attachment: yarn-3762-1.patch Here is a patch that protects FSParentQueue members with

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570037#comment-14570037 ] Sidharta Seethana commented on YARN-2194: - There are two different issues here :

[jira] [Updated] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3762: --- Attachment: yarn-3762-1.patch Sorry, I forgot to rebase and included some HDFS change as well.

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569992#comment-14569992 ] Karthik Kambatla commented on YARN-3762: Changed it to critical and targeting

[jira] [Updated] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3762: --- Priority: Critical (was: Blocker) Target Version/s: 2.8.0 (was: 2.7.1)

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570007#comment-14570007 ] Zhijie Shen commented on YARN-3725: --- bq. is there a JIRA for the longer term fix? Yeah,

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

2015-06-02 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-10.patch Solved some comments Collect memory/cpu usage on the node

[jira] [Commented] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570082#comment-14570082 ] Hadoop QA commented on YARN-3762: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Created] (YARN-3762) FairScheduler: CME on FSParentQueue#getQueueUserAclInfo

2015-06-02 Thread Karthik Kambatla (JIRA)
Karthik Kambatla created YARN-3762: -- Summary: FairScheduler: CME on FSParentQueue#getQueueUserAclInfo Key: YARN-3762 URL: https://issues.apache.org/jira/browse/YARN-3762 Project: Hadoop YARN

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

2015-06-02 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570025#comment-14570025 ] Wangda Tan commented on YARN-3733: -- Took a look at the patch and discussion. Thanks for

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-02 Thread Philip Langdale (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569899#comment-14569899 ] Philip Langdale commented on YARN-2194: --- You can remount controllers if you retain

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569869#comment-14569869 ] Hadoop QA commented on YARN-2392: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3725) App submission via REST API is broken in secure mode due to Timeline DT service address is empty

2015-06-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569918#comment-14569918 ] Vinod Kumar Vavilapalli commented on YARN-3725: --- [~zjshen], is there a JIRA

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-02 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570202#comment-14570202 ] Chun Chen commented on YARN-3749: - Thanks for reviewing the patch, [~zxu] ! We should

[jira] [Assigned] (YARN-3558) Additional containers getting reserved from RM in case of Fair scheduler

2015-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G reassigned YARN-3558: - Assignee: Sunil G Additional containers getting reserved from RM in case of Fair scheduler

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

2015-06-02 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570171#comment-14570171 ] Zhijie Shen commented on YARN-3044: --- [~Naganarasimha], I'm fine with the last patch. Will

[jira] [Commented] (YARN-3755) Log the command of launching containers

2015-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570275#comment-14570275 ] Jeff Zhang commented on YARN-3755: -- bq. How about we let individual frameworks like

[jira] [Commented] (YARN-3755) Log the command of launching containers

2015-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570276#comment-14570276 ] Jeff Zhang commented on YARN-3755: -- Close it as won't fix Log the command of launching

[jira] [Commented] (YARN-2194) Cgroups cease to work in RHEL7

2015-06-02 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14570284#comment-14570284 ] Sidharta Seethana commented on YARN-2194: - [~mjacobs] , Yes, that is what I am

[jira] [Created] (YARN-3763) Support for fuzzy search in ATS

2015-06-02 Thread Jeff Zhang (JIRA)
Jeff Zhang created YARN-3763: Summary: Support for fuzzy search in ATS Key: YARN-3763 URL: https://issues.apache.org/jira/browse/YARN-3763 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-3763) Support fuzzy search in ATS

2015-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-3763: - Summary: Support fuzzy search in ATS (was: Support for fuzzy search in ATS) Support fuzzy search in ATS

[jira] [Updated] (YARN-3763) Support fuzzy search in ATS

2015-06-02 Thread Jeff Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jeff Zhang updated YARN-3763: - Description: Currently ATS only support exact match. Sometimes fuzzy match may be helpful when the

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568913#comment-14568913 ] Hadoop QA commented on YARN-3733: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568926#comment-14568926 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-Yarn-trunk #946 (See

[jira] [Created] (YARN-3759) Include command line, localization info and env vars on AM launch failure

2015-06-02 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3759: Summary: Include command line, localization info and env vars on AM launch failure Key: YARN-3759 URL: https://issues.apache.org/jira/browse/YARN-3759 Project:

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

2015-06-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568947#comment-14568947 ] Junping Du commented on YARN-41: bq. Junping Du I have updated the patch with review

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568920#comment-14568920 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #216 (See

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569171#comment-14569171 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2144 (See

[jira] [Updated] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

2015-06-02 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3733: - Attachment: 0001-YARN-3733.patch The updated patch that fixes for 2nd and 3rd scenarios(This issue scenario

[jira] [Commented] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

2015-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568880#comment-14568880 ] Sunil G commented on YARN-3733: --- Hi [~rohithsharma] Thanks for the detailed scenario.

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

2015-06-02 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569182#comment-14569182 ] Junping Du commented on YARN-41: Thanks [~devaraj.k] for updating the patch with addressing

[jira] [Updated] (YARN-3603) Application Attempts page confusing

2015-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3603: -- Attachment: 0002-YARN-3603.patch Attaching an updated version of patch. Also attaching screen shots of UI.

[jira] [Updated] (YARN-3603) Application Attempts page confusing

2015-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3603: -- Attachment: ahs1.png Application Attempts page confusing ---

[jira] [Updated] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3754: --- Priority: Critical (was: Major) Target Version/s: 2.7.1 Race condition when the

[jira] [Updated] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-3754: --- Target Version/s: 2.8.0 (was: 2.7.1) Race condition when the NodeManager is shutting down

[jira] [Commented] (YARN-3760) Log aggregation failures

2015-06-02 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3760?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569289#comment-14569289 ] Daryn Sharp commented on YARN-3760: --- Cancelled tokens trigger the retry proxy bug. Log

[jira] [Commented] (YARN-2962) ZKRMStateStore: Limit the number of znodes under a znode

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569262#comment-14569262 ] Karthik Kambatla commented on YARN-2962: YARN-3643 should help alleviate most of

[jira] [Created] (YARN-3760) Log aggregation failures

2015-06-02 Thread Daryn Sharp (JIRA)
Daryn Sharp created YARN-3760: - Summary: Log aggregation failures Key: YARN-3760 URL: https://issues.apache.org/jira/browse/YARN-3760 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-3758) The mininum memory setting(yarn.scheduler.minimum-allocation-mb) is not working in container

2015-06-02 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569237#comment-14569237 ] Jason Lowe commented on YARN-3758: -- First off, one should never set the heap size and the

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-02 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569267#comment-14569267 ] Karthik Kambatla commented on YARN-3753: Fix looks reasonable to me. RM failed to

[jira] [Commented] (YARN-41) The RM should handle the graceful shutdown of the NM.

2015-06-02 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569278#comment-14569278 ] Devaraj K commented on YARN-41: --- Thanks a lot [~djp] for your review and comments, I really

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569342#comment-14569342 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2162 (See

[jira] [Commented] (YARN-1462) AHS API and other AHS changes to handle tags for completed MR jobs

2015-06-02 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569322#comment-14569322 ] Hudson commented on YARN-1462: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #214 (See

[jira] [Commented] (YARN-3754) Race condition when the NodeManager is shutting down and container is launched

2015-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569381#comment-14569381 ] Sunil G commented on YARN-3754: --- [~bibinchundatt] Could u also please attach NM logs here.

[jira] [Commented] (YARN-3755) Log the command of launching containers

2015-06-02 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569347#comment-14569347 ] Vinod Kumar Vavilapalli commented on YARN-3755: --- We had this long ago in

[jira] [Created] (YARN-3761) Set delegation token service address at the server side

2015-06-02 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3761: - Summary: Set delegation token service address at the server side Key: YARN-3761 URL: https://issues.apache.org/jira/browse/YARN-3761 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2015-06-02 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569437#comment-14569437 ] Varun Vasudev commented on YARN-2618: - [~kasha] - should we commit this to the

[jira] [Commented] (YARN-2618) Avoid over-allocation of disk resources

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569453#comment-14569453 ] Hadoop QA commented on YARN-2618: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569456#comment-14569456 ] Xuan Gong commented on YARN-3753: - +1, LGTM. Check this in RM failed to come up with

[jira] [Commented] (YARN-3753) RM failed to come up with java.io.IOException: Wait for ZKClient creation timed out

2015-06-02 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569465#comment-14569465 ] Xuan Gong commented on YARN-3753: - Committed into branch-2.7. Thanks, Jian RM failed to

[jira] [Commented] (YARN-3591) Resource Localisation on a bad disk causes subsequent containers failure

2015-06-02 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14569480#comment-14569480 ] Sunil G commented on YARN-3591: --- If we have a new api which returns the present set of error

[jira] [Updated] (YARN-3733) DominantRC#compare() does not work as expected if cluster resource is empty

2015-06-02 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3733: - Summary: DominantRC#compare() does not work as expected if cluster resource is empty (was: On RM restart AM

[jira] [Commented] (YARN-3749) We should make a copy of configuration when init MiniYARNCluster with multiple RMs

2015-06-02 Thread Chun Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568586#comment-14568586 ] Chun Chen commented on YARN-3749: - bq. It looks like we need keep

[jira] [Commented] (YARN-3585) NodeManager cannot exit on SHUTDOWN event triggered and NM recovery is enabled

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568593#comment-14568593 ] Hadoop QA commented on YARN-3585: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||

[jira] [Commented] (YARN-3755) Log the command of launching containers

2015-06-02 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14568606#comment-14568606 ] Hadoop QA commented on YARN-3755: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ ||