[jira] [Commented] (YARN-4119) Expose the NM bind address as an env, so that AM can make use of it for exposing tracking URL

2015-09-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734333#comment-14734333 ] Naganarasimha G R commented on YARN-4119: - Synced up offline with [~varun_saxena] , When i modified

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734514#comment-14734514 ] Hudson commented on YARN-4121: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1092 (See

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734369#comment-14734369 ] Hudson commented on YARN-4121: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #354 (See

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Fix Version/s: (was: 2.7.1) > queue not remove from webpage(/cluster/scheduler) when delete queue in

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Affects Version/s: (was: 2.7.1) > queue not remove from webpage(/cluster/scheduler) when delete

[jira] [Created] (YARN-4127) RM fail with noAuth error if switched from non-failover mode to failover mode

2015-09-08 Thread Jian He (JIRA)
Jian He created YARN-4127: - Summary: RM fail with noAuth error if switched from non-failover mode to failover mode Key: YARN-4127 URL: https://issues.apache.org/jira/browse/YARN-4127 Project: Hadoop YARN

[jira] [Updated] (YARN-4081) Add support for multiple resource types in the Resource class

2015-09-08 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-4081: Attachment: YARN-4081-YARN-3926.007.patch Fix the whitespace issue and addressed some checkstyle

[jira] [Resolved] (YARN-4128) Correct logs in capacity scheduler while printing priority is acceptable for a queue

2015-09-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena resolved YARN-4128. Resolution: Not A Problem Did not have latest code. This has been fixed in YARN-3970 which has been

[jira] [Commented] (YARN-2019) Retrospect on decision of making RM crashed if any exception throw in ZKRMStateStore

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734299#comment-14734299 ] Hudson commented on YARN-2019: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #341 (See

[jira] [Commented] (YARN-2884) Proxying all AM-RM communications

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734298#comment-14734298 ] Hudson commented on YARN-2884: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #341 (See

[jira] [Commented] (YARN-4087) Followup fixes after YARN-2019 regarding RM behavior when state-store error occurs

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734300#comment-14734300 ] Hudson commented on YARN-4087: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #341 (See

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734343#comment-14734343 ] Hudson commented on YARN-4121: -- FAILURE: Integrated in Hadoop-trunk-Commit #8413 (See

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734399#comment-14734399 ] Hadoop QA commented on YARN-4126: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4126: --- Attachment: 0001-YARN-4126.patch Uploading patch for the same if you have started working on

[jira] [Updated] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4126: --- Attachment: 0002-YARN-4126.patch > RM should not issue delegation tokens in unsecure mode >

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734437#comment-14734437 ] Hudson commented on YARN-4121: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #361 (See

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734292#comment-14734292 ] Naganarasimha G R commented on YARN-4126: - Yes [~bibinchundatt] you are right, check is there but

[jira] [Assigned] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-4126: -- Assignee: Bibin A Chundatt > RM should not issue delegation tokens in unsecure mode >

[jira] [Updated] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3943: Attachment: YARN-3943.000.patch > Use separate threshold configurations for disk-full detection and >

[jira] [Created] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-09-08 Thread Naganarasimha G R (JIRA)
Naganarasimha G R created YARN-4129: --- Summary: Refactor the SystemMetricPublisher in RM to better support newer events Key: YARN-4129 URL: https://issues.apache.org/jira/browse/YARN-4129 Project:

[jira] [Created] (YARN-4128) Correct logs in capacity scheduler while printing priority is acceptable for a queue

2015-09-08 Thread Varun Saxena (JIRA)
Varun Saxena created YARN-4128: -- Summary: Correct logs in capacity scheduler while printing priority is acceptable for a queue Key: YARN-4128 URL: https://issues.apache.org/jira/browse/YARN-4128

[jira] [Updated] (YARN-4128) Correct logs in capacity scheduler while printing priority is acceptable for a queue

2015-09-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4128: --- Description: Spaces are missing between queuename and "for" and application id and "for". {noformat}

[jira] [Updated] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-09-08 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4129: Attachment: YARN-4129.YARN-2928.001.patch Hi [~djp] & [~sjlee0], Similar to the approach

[jira] [Commented] (YARN-2884) Proxying all AM-RM communications

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734407#comment-14734407 ] Hudson commented on YARN-2884: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2303 (See

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Labels: (was: YARN patch) > queue not remove from webpage(/cluster/scheduler) when delete queue in >

[jira] [Commented] (YARN-2884) Proxying all AM-RM communications

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734303#comment-14734303 ] Hudson commented on YARN-2884: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #353 (See

[jira] [Assigned] (YARN-4127) RM fail with noAuth error if switched from non-failover mode to failover mode

2015-09-08 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-4127: -- Assignee: Varun Saxena > RM fail with noAuth error if switched from non-failover mode to

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Attachment: YARN-4022.001.patch > queue not remove from webpage(/cluster/scheduler) when delete queue in

[jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734477#comment-14734477 ] Hadoop QA commented on YARN-4081: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734377#comment-14734377 ] Hadoop QA commented on YARN-3943: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734529#comment-14734529 ] Bibin A Chundatt commented on YARN-4126: Hi [~jianhe] Is this change as expected by you? Any change

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734597#comment-14734597 ] Hudson commented on YARN-4121: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #342 (See

[jira] [Commented] (YARN-3337) Provide YARN chaos monkey

2015-09-08 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734625#comment-14734625 ] Steve Loughran commented on YARN-3337: -- # For slider we have what we need: the API calls are in the AM

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Attachment: YARN-4022.002.patch Fix test bug & whitespace. > queue not remove from

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734751#comment-14734751 ] Hadoop QA commented on YARN-4022: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread forrestchen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] forrestchen updated YARN-4022: -- Labels: scheduler (was: ) > queue not remove from webpage(/cluster/scheduler) when delete queue in >

[jira] [Commented] (YARN-4129) Refactor the SystemMetricPublisher in RM to better support newer events

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734560#comment-14734560 ] Hadoop QA commented on YARN-4129: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3771) "final" behavior is not honored for YarnConfiguration.DEFAULT_YARN_APPLICATION_CLASSPATH since it is a String[]

2015-09-08 Thread nijel (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734602#comment-14734602 ] nijel commented on YARN-3771: - hi all, any comment on this change ? > "final" behavior is not honored for >

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734610#comment-14734610 ] Hudson commented on YARN-4121: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2281 (See

[jira] [Updated] (YARN-4130) Duplicate declaration of ApplicationId in RMAppManager

2015-09-08 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated YARN-4130: - Attachment: YARN-4130.00.patch > Duplicate declaration of ApplicationId in RMAppManager >

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734580#comment-14734580 ] Hadoop QA commented on YARN-4022: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3337) Provide YARN chaos monkey

2015-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734647#comment-14734647 ] Junping Du commented on YARN-3337: -- OK. Let me create a sub task with focusing on adding this API and CLI.

[jira] [Commented] (YARN-4121) Typos in capacity scheduler documentation.

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734611#comment-14734611 ] Hudson commented on YARN-4121: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2304 (See

[jira] [Created] (YARN-4130) Duplicate declaration of ApplicationId in RMAppManager

2015-09-08 Thread Kai Sasaki (JIRA)
Kai Sasaki created YARN-4130: Summary: Duplicate declaration of ApplicationId in RMAppManager Key: YARN-4130 URL: https://issues.apache.org/jira/browse/YARN-4130 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4110) RMappImpl and RmAppAttemptImpl should override hashcode() & equals()

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734717#comment-14734717 ] Hadoop QA commented on YARN-4110: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (YARN-4132) Nodemanagers should try harder to connect to the RM

2015-09-08 Thread Chang Li (JIRA)
Chang Li created YARN-4132: -- Summary: Nodemanagers should try harder to connect to the RM Key: YARN-4132 URL: https://issues.apache.org/jira/browse/YARN-4132 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

2015-09-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735452#comment-14735452 ] Vrushali C commented on YARN-3901: -- Thanks [~sjlee0] for the review! I will correct the variable ordering

[jira] [Commented] (YARN-3635) Get-queue-mapping should be a common interface of YarnScheduler

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3635?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735471#comment-14735471 ] Hadoop QA commented on YARN-3635: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

2015-09-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735384#comment-14735384 ] Sangjin Lee commented on YARN-3901: --- Thanks for the updated patch [~vrushalic]! I went over the new

[jira] [Commented] (YARN-4074) [timeline reader] implement support for querying for flows and flow runs

2015-09-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735545#comment-14735545 ] Sangjin Lee commented on YARN-4074: --- It'd be great if you could take a look at the latest patch and let

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735448#comment-14735448 ] zhihai xu commented on YARN-4096: - +1. Committing it in. > App local logs are leaked if log aggregation

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735497#comment-14735497 ] Hudson commented on YARN-4096: -- FAILURE: Integrated in Hadoop-trunk-Commit #8416 (See

[jira] [Commented] (YARN-4075) [reader REST API] implement support for querying for flows and flow runs

2015-09-08 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735541#comment-14735541 ] Sangjin Lee commented on YARN-4075: --- Sorry [~varun_saxena], it took me a while to review this. The patch

[jira] [Updated] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4126: --- Attachment: 0003-YARN-4126.patch Hi [~jianhe] Attaching patch after testcase updation.

[jira] [Updated] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-4096: Hadoop Flags: Reviewed > App local logs are leaked if log aggregation fails to initialize for the app >

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735537#comment-14735537 ] Hudson commented on YARN-4096: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1095 (See

[jira] [Commented] (YARN-4132) Nodemanagers should try harder to connect to the RM

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735533#comment-14735533 ] Hadoop QA commented on YARN-4132: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-4132) Nodemanagers should try harder to connect to the RM

2015-09-08 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4132: --- Attachment: YARN-4132.patch > Nodemanagers should try harder to connect to the RM >

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735490#comment-14735490 ] zhihai xu commented on YARN-4096: - thanks Jason for the contribution! Committed it to branch-2.7.2,

[jira] [Updated] (YARN-4132) Nodemanagers should try harder to connect to the RM

2015-09-08 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chang Li updated YARN-4132: --- Attachment: YARN-4132.2.patch fixed broken test in TestYarnConfigurationFields. The other broken tests are

[jira] [Commented] (YARN-4132) Nodemanagers should try harder to connect to the RM

2015-09-08 Thread Chang Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735683#comment-14735683 ] Chang Li commented on YARN-4132: [~jlowe] please help review the latest patch. Thanks! > Nodemanagers

[jira] [Updated] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-09-08 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-2410: -- Attachment: YARN-2410-v7.patch Modified ShuffleHandler to not use channel attachments. Moved MockNetty

[jira] [Updated] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

2015-09-08 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3901: - Attachment: YARN-3901-YARN-2928.5.patch Uploading patch v5 that incorporates Sangjin's review

[jira] [Updated] (YARN-1651) CapacityScheduler side changes to support increase/decrease container resource.

2015-09-08 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1651: - Attachment: YARN-1651-4.YARN-1197.patch Thanks comments! [~mding]. bq. I only mention this because

[jira] [Commented] (YARN-4132) Nodemanagers should try harder to connect to the RM

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735677#comment-14735677 ] Hadoop QA commented on YARN-4132: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735704#comment-14735704 ] Hudson commented on YARN-4096: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2307 (See

[jira] [Commented] (YARN-1651) CapacityScheduler side changes to support increase/decrease container resource.

2015-09-08 Thread MENG DING (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735676#comment-14735676 ] MENG DING commented on YARN-1651: - Hi, [~leftnoteasy] bq. I agree the general idea, and we should do the

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735672#comment-14735672 ] Hudson commented on YARN-4096: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #357 (See

[jira] [Updated] (YARN-3985) Make ReservationSystem persist state using RMStateStore reservation APIs

2015-09-08 Thread Anubhav Dhoot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Dhoot updated YARN-3985: Component/s: (was: fairscheduler) (was: capacityscheduler) > Make

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735714#comment-14735714 ] Hadoop QA commented on YARN-4126: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-3337) Provide YARN chaos monkey

2015-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734800#comment-14734800 ] Junping Du commented on YARN-3337: -- I think there is one difficulty here: it looks like we didn't keep

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735786#comment-14735786 ] Jian He commented on YARN-4126: --- yes, oozie has fixed its own. This is just YARN side fix. > RM should not

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735766#comment-14735766 ] Hadoop QA commented on YARN-2410: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735791#comment-14735791 ] Hudson commented on YARN-4096: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2284 (See

[jira] [Commented] (YARN-1651) CapacityScheduler side changes to support increase/decrease container resource.

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735859#comment-14735859 ] Hadoop QA commented on YARN-1651: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735787#comment-14735787 ] Jian He commented on YARN-4126: --- yes, oozie has fixed its own. This is just YARN side fix. > RM should not

[jira] [Issue Comment Deleted] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-4126: -- Comment: was deleted (was: yes, oozie has fixed its own. This is just YARN side fix.) > RM should not issue

[jira] [Commented] (YARN-4096) App local logs are leaked if log aggregation fails to initialize for the app

2015-09-08 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735837#comment-14735837 ] Hudson commented on YARN-4096: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #345 (See

[jira] [Created] (YARN-4133) Containers to be preempted leaks in FairScheduler preemption logic.

2015-09-08 Thread zhihai xu (JIRA)
zhihai xu created YARN-4133: --- Summary: Containers to be preempted leaks in FairScheduler preemption logic. Key: YARN-4133 URL: https://issues.apache.org/jira/browse/YARN-4133 Project: Hadoop YARN

[jira] [Commented] (YARN-2410) Nodemanager ShuffleHandler can possible exhaust file descriptors

2015-09-08 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14734931#comment-14734931 ] Jason Lowe commented on YARN-2410: -- Thanks for updating the patch! bq. The only reason was findbugs which

[jira] [Updated] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3943: Attachment: YARN-3943.000.patch > Use separate threshold configurations for disk-full detection and >

[jira] [Updated] (YARN-3943) Use separate threshold configurations for disk-full detection and disk-not-full detection.

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3943: Attachment: (was: YARN-3943.000.patch) > Use separate threshold configurations for disk-full detection

[jira] [Updated] (YARN-4131) Add API and CLI to kill container on given containerId

2015-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4131: - Attachment: YARN-4131-demo.patch Attach a demo patch, more test work is still needed. > Add API and CLI

[jira] [Updated] (YARN-3999) RM hangs on draining events

2015-09-08 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3999: -- Labels: 2.6.1-candidate (was: ) Adding to 2.6.1 from Jian's comment in the

[jira] [Commented] (YARN-4120) FSAppAttempt.getResourceUsage() should not take preemptedResource into account

2015-09-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735952#comment-14735952 ] Xianyin Xin commented on YARN-4120: --- Hi [~kasha], there's another issue in the current preemption logic,

[jira] [Commented] (YARN-4133) Containers to be preempted leaks in FairScheduler preemption logic.

2015-09-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735987#comment-14735987 ] Xianyin Xin commented on YARN-4133: --- Of course we can also address these problems one by one in different

[jira] [Updated] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4126: --- Attachment: 0004-YARN-4126.patch > RM should not issue delegation tokens in unsecure mode >

[jira] [Updated] (YARN-4086) Allow Aggregated Log readers to handle HAR files

2015-09-08 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-4086: Attachment: YARN-4086.002.patch The 002 patch makes that test less brittle. I also fixed the RAT

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

2015-09-08 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735887#comment-14735887 ] Joep Rottinghuis commented on YARN-3901: Thanks [~vrushalic]. I'm going to dig through the details

[jira] [Commented] (YARN-3901) Populate flow run data in the flow_run & flow activity tables

2015-09-08 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735900#comment-14735900 ] Joep Rottinghuis commented on YARN-3901: The one remaining issue we have to tackle is when there

[jira] [Commented] (YARN-4086) Allow Aggregated Log readers to handle HAR files

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735947#comment-14735947 ] Hadoop QA commented on YARN-4086: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-4133) Containers to be preempted leaks in FairScheduler preemption logic.

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-4133: Attachment: YARN-4133.000.patch > Containers to be preempted leaks in FairScheduler preemption logic. >

[jira] [Commented] (YARN-4133) Containers to be preempted leaks in FairScheduler preemption logic.

2015-09-08 Thread Xianyin Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735959#comment-14735959 ] Xianyin Xin commented on YARN-4133: --- Hi [~zxu], it seems the current preemption logic has many problems.

[jira] [Updated] (YARN-4133) Containers to be preempted leaks in FairScheduler preemption logic.

2015-09-08 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-4133: Description: Containers to be preempted leaks in FairScheduler preemption logic. It may cause missing

[jira] [Updated] (YARN-4131) Add API and CLI to kill container on given containerId

2015-09-08 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4131: - Attachment: YARN-4131-v1.patch Update patch with following updates: 1. Add ContainerKilledType in

[jira] [Updated] (YARN-4106) NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4106: --- Attachment: 0006-YARN-4106.patch > NodeLabels for NM in distributed mode is not updated even

[jira] [Commented] (YARN-4106) NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM

2015-09-08 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736025#comment-14736025 ] Bibin A Chundatt commented on YARN-4106: Hi [~leftnoteasy] Thnks for comments. Updates patch

[jira] [Commented] (YARN-4133) Containers to be preempted leaks in FairScheduler preemption logic.

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736052#comment-14736052 ] Hadoop QA commented on YARN-4133: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (YARN-4106) NodeLabels for NM in distributed mode is not updated even after clusterNodelabel addition in RM

2015-09-08 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14736112#comment-14736112 ] Hadoop QA commented on YARN-4106: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Created] (YARN-4134) FairScheduler preemption stops at queue level that all child queues are not over their fairshare

2015-09-08 Thread Xianyin Xin (JIRA)
Xianyin Xin created YARN-4134: - Summary: FairScheduler preemption stops at queue level that all child queues are not over their fairshare Key: YARN-4134 URL: https://issues.apache.org/jira/browse/YARN-4134

  1   2   >