[jira] [Updated] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3443: Attachment: YARN-3443.004.patch Patch with documentation fixes. Create a 'ResourceHandler'

[jira] [Updated] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3366: Attachment: YARN-3366.002.patch Uploading a patch that includes changes to

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482713#comment-14482713 ] Hadoop QA commented on YARN-3021: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482789#comment-14482789 ] Varun Vasudev commented on YARN-3366: - Thanks for the patch [~sidharta-s]! Feedback

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482688#comment-14482688 ] Hadoop QA commented on YARN-3443: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482717#comment-14482717 ] Hadoop QA commented on YARN-3404: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

2015-04-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482922#comment-14482922 ] Naganarasimha G R commented on YARN-3102: - Hi [~zhiguohong], I had actually

[jira] [Assigned] (YARN-2444) Primary filters added after first submission not indexed, cause exceptions in logs.

2015-04-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned YARN-2444: Assignee: Steve Loughran Primary filters added after first submission not indexed, cause

[jira] [Commented] (YARN-3102) Decommisioned Nodes not listed in Web UI

2015-04-07 Thread Hong Zhiguo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482891#comment-14482891 ] Hong Zhiguo commented on YARN-3102: --- I met the same problem. Hi, [~Naganarasimha], can I

[jira] [Assigned] (YARN-1394) RM to inform AMs when a container completed due to NM going offline -planned or unplanned

2015-04-07 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith reassigned YARN-1394: Assignee: Rohith RM to inform AMs when a container completed due to NM going offline -planned or

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482979#comment-14482979 ] Hudson commented on YARN-2429: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #156 (See

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482977#comment-14482977 ] Hudson commented on YARN-3273: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #156 (See

[jira] [Assigned] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-04-07 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3456: -- Assignee: Varun Saxena Improve handling of incomplete TimelineEntities

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482986#comment-14482986 ] Hudson commented on YARN-2429: -- FAILURE: Integrated in Hadoop-Yarn-trunk #890 (See

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14482984#comment-14482984 ] Hudson commented on YARN-3273: -- FAILURE: Integrated in Hadoop-Yarn-trunk #890 (See

[jira] [Commented] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-04-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483040#comment-14483040 ] Steve Loughran commented on YARN-3456: -- Stack trace when an entity with a null type is

[jira] [Created] (YARN-3456) Improve handling of incomplete TimelineEntities

2015-04-07 Thread Steve Loughran (JIRA)
Steve Loughran created YARN-3456: Summary: Improve handling of incomplete TimelineEntities Key: YARN-3456 URL: https://issues.apache.org/jira/browse/YARN-3456 Project: Hadoop YARN Issue

[jira] [Created] (YARN-3457) NPE when NodeManager.serviceInit fails and stopRecoveryStore called

2015-04-07 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-3457: -- Summary: NPE when NodeManager.serviceInit fails and stopRecoveryStore called Key: YARN-3457 URL: https://issues.apache.org/jira/browse/YARN-3457 Project: Hadoop

[jira] [Commented] (YARN-2801) Documentation development for Node labels requirment

2015-04-07 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483093#comment-14483093 ] Bibin A Chundatt commented on YARN-2801: [~leftnoteasy] Any update on documentation

[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483281#comment-14483281 ] Hadoop QA commented on YARN-3348: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3348: Attachment: apache-yarn-3348.0.patch Uploaded initial version of the patch. Most of the work is in a

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483319#comment-14483319 ] Hadoop QA commented on YARN-3293: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: apache-yarn-3293.4.patch Doh! Uploaded the stat instead of the patch. Uploading the real

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483233#comment-14483233 ] Hudson commented on YARN-2429: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #147 (See

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483231#comment-14483231 ] Hudson commented on YARN-3273: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #147 (See

[jira] [Updated] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-07 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 0006-YARN-2003.patch Hi [~leftnoteasy] Rebased the patch. This patch is independent of others. But

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483261#comment-14483261 ] Hudson commented on YARN-3273: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2088 (See

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483263#comment-14483263 ] Hudson commented on YARN-2429: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #2088 (See

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: apache-yarn-3293.3.patch {quote} General - it looks like the counters could possibly

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: (was: apache-yarn-3293.3.patch) Track and display capacity scheduler health metrics

[jira] [Updated] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated YARN-3021: Attachment: YARN-3021.007.patch Upload same patch again for another test. YARN's delegation-token

[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483424#comment-14483424 ] Hadoop QA commented on YARN-3348: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-04-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483486#comment-14483486 ] Xuan Gong commented on YARN-3294: - +1 lgtm. Will commit Allow dumping of Capacity

[jira] [Updated] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3293: Attachment: apache-yarn-3293.5.patch The findbug warnings are incorrect - the fields are used by

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Attachment: YARN-3046-no-test-v2.patch Forget to add code for finding of TimelineCollectorAddress in

[jira] [Commented] (YARN-1376) NM need to notify the log aggregation status to RM through Node heartbeat

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483392#comment-14483392 ] Junping Du commented on YARN-1376: -- Forget to mention, if RM can know log aggregation

[jira] [Commented] (YARN-3127) Apphistory url crashes when RM switches with ATS enabled

2015-04-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483396#comment-14483396 ] Naganarasimha G R commented on YARN-3127: - Hi [~xgong], If you have the bandwidth

[jira] [Commented] (YARN-3110) Few issues in ApplicationHistory web ui

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483371#comment-14483371 ] Hudson commented on YARN-3110: -- FAILURE: Integrated in Hadoop-trunk-Commit #7519 (See

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483416#comment-14483416 ] Hadoop QA commented on YARN-2003: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483417#comment-14483417 ] Hadoop QA commented on YARN-3021: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483429#comment-14483429 ] Allen Wittenauer commented on YARN-3348: {code} +doNotSetCols=0 +

[jira] [Commented] (YARN-3110) Few issues in ApplicationHistory web ui

2015-04-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483353#comment-14483353 ] Xuan Gong commented on YARN-3110: - Committed into trunk/branch-2. Thanks, Naganarasimha

[jira] [Updated] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3348: Attachment: apache-yarn-3348.1.patch Uploaded a new patch to fix release audit warning and failing

[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483373#comment-14483373 ] Varun Vasudev commented on YARN-3348: - Sorry, that last comment should have been The

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483432#comment-14483432 ] Junping Du commented on YARN-3431: -- Thanks [~zjshen] for the patch and [~gtCarrera9] for

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483445#comment-14483445 ] Hadoop QA commented on YARN-3293: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483498#comment-14483498 ] Junping Du commented on YARN-3391: -- Sorry for coming a little late. Thanks guys for good

[jira] [Updated] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3431: - Description: We have TimelineEntity and some other entities as subclass that inherit from it. However, we

[jira] [Commented] (YARN-1376) NM need to notify the log aggregation status to RM through Node heartbeat

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483419#comment-14483419 ] Junping Du commented on YARN-1376: -- bq. I didn't see where we remove element from

[jira] [Commented] (YARN-3443) Create a 'ResourceHandler' subsystem to ease addition of support for new resource types on the NM

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483489#comment-14483489 ] Varun Vasudev commented on YARN-3443: - +1, lgtm for the latest patch. Create a

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-04-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483490#comment-14483490 ] Xuan Gong commented on YARN-3294: - Committed into trunk/branch-2. Thanks, varun. Allow

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483518#comment-14483518 ] Hudson commented on YARN-3294: -- FAILURE: Integrated in Hadoop-trunk-Commit #7521 (See

[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage

2015-04-07 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483377#comment-14483377 ] Varun Vasudev commented on YARN-3348: - The attached patch applies only to trunk. Once I

[jira] [Commented] (YARN-3110) Few issues in ApplicationHistory web ui

2015-04-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483346#comment-14483346 ] Xuan Gong commented on YARN-3110: - +1 LGTM. Will commit Few issues in ApplicationHistory

[jira] [Commented] (YARN-3110) Few issues in ApplicationHistory web ui

2015-04-07 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483366#comment-14483366 ] Naganarasimha G R commented on YARN-3110: - Thanks for reviewing Commiting [~xgong]

[jira] [Updated] (YARN-1376) NM need to notify the log aggregation status to RM through Node heartbeat

2015-04-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1376: Attachment: Screen Shot 2015-04-07 at 9.30.42 AM.png NM need to notify the log aggregation status to RM

[jira] [Updated] (YARN-1376) NM need to notify the log aggregation status to RM through Node heartbeat

2015-04-07 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1376: Attachment: YARN-1376.2015-04-07.patch Address all the latest comments. NM need to notify the log

[jira] [Commented] (YARN-3293) Track and display capacity scheduler health metrics in web UI

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483668#comment-14483668 ] Hadoop QA commented on YARN-3293: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483666#comment-14483666 ] Hudson commented on YARN-2429: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #157 (See

[jira] [Commented] (YARN-3460) Test TestSecureRMRegistryOperations failed with IBM_JAVA JVM

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483827#comment-14483827 ] Hadoop QA commented on YARN-3460: - {color:red}-1 overall{color}. Here are the results of

[jira] [Created] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
Inigo Goiri created YARN-3458: - Summary: CPU resource monitoring in Windows Key: YARN-3458 URL: https://issues.apache.org/jira/browse/YARN-3458 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483664#comment-14483664 ] Hudson commented on YARN-3273: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #157 (See

[jira] [Commented] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes

2015-04-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483685#comment-14483685 ] Jian He commented on YARN-3439: --- IIUC, isn't this a long-standing issue that Ozzie doesn't

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483631#comment-14483631 ] Hadoop QA commented on YARN-3458: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Labels: containers metrics windows (was: ) CPU resource monitoring in Windows

[jira] [Moved] (YARN-3460) Test TestSecureRMRegistryOperations failed with IBM_JAVA JVM

2015-04-07 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran moved HADOOP-11810 to YARN-3460: --- Fix Version/s: (was: 3.0.0) Target Version/s: 2.8.0

[jira] [Updated] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3391: -- Attachment: YARN-3391.3.patch Clearly define flow ID/ flow run / flow version in API and storage

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483822#comment-14483822 ] Hadoop QA commented on YARN-3458: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483627#comment-14483627 ] Inigo Goiri commented on YARN-3458: --- Not sure if the patch has been created properly as

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Attachment: YARN-3458-2.patch Patch based on trunk. Let's see if Jenkins likes it. CPU resource

[jira] [Commented] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes

2015-04-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483698#comment-14483698 ] Jason Lowe commented on YARN-3439: -- I believe it is setting that to false, as that

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Attachment: YARN-3458-3.patch Git and I are getting through a rough relation, let's see if now... CPU

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483605#comment-14483605 ] Sidharta Seethana commented on YARN-3366: - Thanks for the review, [~vvasudev] .

[jira] [Commented] (YARN-1376) NM need to notify the log aggregation status to RM through Node heartbeat

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483660#comment-14483660 ] Hadoop QA commented on YARN-1376: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3426) Add jdiff support to YARN

2015-04-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483681#comment-14483681 ] Li Lu commented on YARN-3426: - The failed unit test also breaks in trunk. Will file a blocker

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483692#comment-14483692 ] Hadoop QA commented on YARN-3458: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3459) TestLog4jWarningErrorMetricsAppender breaks in trunk

2015-04-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483779#comment-14483779 ] Li Lu commented on YARN-3459: - Reproduced this failure on my local machine as well as Jenkins

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-04-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483808#comment-14483808 ] Vinod Kumar Vavilapalli commented on YARN-3361: --- Review of the tests -

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-07 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483588#comment-14483588 ] Junping Du commented on YARN-3046: -- Linked with MAPREDUCE-6189 - the test failure on trunk

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Attachment: YARN-3458-1.patch CPU resource monitoring in Windows --

[jira] [Commented] (YARN-3361) CapacityScheduler side changes to support non-exclusive node labels

2015-04-07 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483693#comment-14483693 ] Jian He commented on YARN-3361: --- Some comments on my side - should treat each limit

[jira] [Commented] (YARN-2429) LCE should blacklist based upon group

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483716#comment-14483716 ] Hudson commented on YARN-2429: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2106 (See

[jira] [Commented] (YARN-3273) Improve web UI to facilitate scheduling analysis and debugging

2015-04-07 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483714#comment-14483714 ] Hudson commented on YARN-3273: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2106 (See

[jira] [Created] (YARN-3459) TestLog4jWarningErrorMetricsAppender breaks in trunk

2015-04-07 Thread Li Lu (JIRA)
Li Lu created YARN-3459: --- Summary: TestLog4jWarningErrorMetricsAppender breaks in trunk Key: YARN-3459 URL: https://issues.apache.org/jira/browse/YARN-3459 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-3426) Add jdiff support to YARN

2015-04-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-3426: Attachment: YARN-3426-040715.patch Added license information to the four .xml API files. Add jdiff support to

[jira] [Created] (YARN-3461) Consolidate flow name/version/run defaults

2015-04-07 Thread Zhijie Shen (JIRA)
Zhijie Shen created YARN-3461: - Summary: Consolidate flow name/version/run defaults Key: YARN-3461 URL: https://issues.apache.org/jira/browse/YARN-3461 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-3391) Clearly define flow ID/ flow run / flow version in API and storage

2015-04-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483812#comment-14483812 ] Zhijie Shen commented on YARN-3391: --- bq. let's continue the discussion on a separated

[jira] [Commented] (YARN-3426) Add jdiff support to YARN

2015-04-07 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483837#comment-14483837 ] Hadoop QA commented on YARN-3426: - {color:red}-1 overall{color}. Here are the results of

[jira] [Resolved] (YARN-3439) RM fails to renew token when Oozie launcher leaves before sub-job finishes

2015-04-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe resolved YARN-3439. -- Resolution: Duplicate bq. IAC, this is a dup of YARN-3055. Agreed, closing as a duplicate. RM fails

[jira] [Commented] (YARN-3452) Bogus token usernames cause many invalid group lookups

2015-04-07 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483861#comment-14483861 ] Jason Lowe commented on YARN-3452: -- The extra lookups started in 2.6 releases, and it

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

2015-04-07 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14483874#comment-14483874 ] Inigo Goiri commented on YARN-3458: --- For the tests, I checked the original

[jira] [Updated] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

2015-04-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3366: Attachment: YARN-3366.003.patch Uploading patch incorporating code review feedback.

[jira] [Commented] (YARN-3426) Add jdiff support to YARN

2015-04-07 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484008#comment-14484008 ] Li Lu commented on YARN-3426: - Could not reproduce the mvn eclipse:eclipse failure locally. The

[jira] [Commented] (YARN-3055) The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer

2015-04-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484117#comment-14484117 ] Daryn Sharp commented on YARN-3055: --- On cursory glance, are you sure this isn't going to

[jira] [Commented] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

2015-04-07 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484032#comment-14484032 ] Zhijie Shen commented on YARN-3448: --- Jonathan, thanks for your contribution. It sounds an

[jira] [Commented] (YARN-3055) The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer

2015-04-07 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484201#comment-14484201 ] Daryn Sharp commented on YARN-3055: --- This appears to go back to the really old days of

[jira] [Updated] (YARN-3426) Add jdiff support to YARN

2015-04-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3426: -- Target Version/s: 2.8.0 (was: 2.7.0) bq. The bigger question is the duplication

[jira] [Commented] (YARN-2424) LCE should support non-cgroups, non-secure mode

2015-04-07 Thread Sidharta Seethana (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484058#comment-14484058 ] Sidharta Seethana commented on YARN-2424: - Here it is :

[jira] [Created] (YARN-3462) Patches applied for YARN-2424 are inconsistent between trunk and branch-2

2015-04-07 Thread Sidharta Seethana (JIRA)
Sidharta Seethana created YARN-3462: --- Summary: Patches applied for YARN-2424 are inconsistent between trunk and branch-2 Key: YARN-3462 URL: https://issues.apache.org/jira/browse/YARN-3462 Project:

[jira] [Commented] (YARN-3055) The token is not renewed properly if it's shared by jobs (oozie) in DelegationTokenRenewer

2015-04-07 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14484098#comment-14484098 ] Vinod Kumar Vavilapalli commented on YARN-3055: --- [~daryn]/[~jianhe], I

  1   2   >