[jira] [Commented] (YARN-4630) Remove useless boxing/unboxing code (Hadoop YARN)

[ https://issues.apache.org/jira/browse/YARN-4630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231657#comment-15231657 ] Akira AJISAKA commented on YARN-4630: - Hi [~sarutak], thank you for updating the patch. {code} public

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231612#comment-15231612 ] Sangjin Lee commented on YARN-3816: --- [~gtCarrera9], thanks much for posting an updated patch for this! I

[jira] [Updated] (YARN-4865) Track Reserved resources in ResourceUsage and QueueCapacities

[ https://issues.apache.org/jira/browse/YARN-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4865: -- Attachment: 0003-YARN-4865-addendum.patch Thank u [~leftnoteasy] and [~karams] Attached new patch. Test case

[jira] [Commented] (YARN-4425) Pluggable sharing policy for Partition Node Label resources

[ https://issues.apache.org/jira/browse/YARN-4425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231438#comment-15231438 ] Hadoop QA commented on YARN-4425: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4425) Pluggable sharing policy for Partition Node Label resources

[ https://issues.apache.org/jira/browse/YARN-4425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231431#comment-15231431 ] Wangda Tan commented on YARN-4425: -- [~Naganarasimha], [~xinxianyin], Read the doc and took a very high

[jira] [Commented] (YARN-4928) Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon

[ https://issues.apache.org/jira/browse/YARN-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231430#comment-15231430 ] Li Lu commented on YARN-4928: - My only concern is the import line raised by [~djp]. The findbugs warning is

[jira] [Commented] (YARN-4756) Unnecessary wait in Node Status Updater during reboot

[ https://issues.apache.org/jira/browse/YARN-4756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231422#comment-15231422 ] Hudson commented on YARN-4756: -- FAILURE: Integrated in Hadoop-trunk-Commit #9576 (See

[jira] [Commented] (YARN-4902) [Umbrella] Generalized and unified scheduling-strategies in YARN

[ https://issues.apache.org/jira/browse/YARN-4902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231401#comment-15231401 ] Wangda Tan commented on YARN-4902: -- Thanks reviews from [~asuresh]/[~subru]: Feedbacks to some of your

[jira] [Commented] (YARN-4771) Some containers can be skipped during log aggregation after NM restart

[ https://issues.apache.org/jira/browse/YARN-4771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231386#comment-15231386 ] Junping Du commented on YARN-4771: -- 002 patch LGTM. An additional fix is we'd better to use MonotonicTime

[jira] [Commented] (YARN-4756) Unnecessary wait in Node Status Updater during reboot

[ https://issues.apache.org/jira/browse/YARN-4756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231376#comment-15231376 ] Karthik Kambatla commented on YARN-4756: The patch seems reasonable to me. +1. Also, quite

[jira] [Commented] (YARN-4902) [Umbrella] Generalized and unified scheduling-strategies in YARN

[ https://issues.apache.org/jira/browse/YARN-4902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231365#comment-15231365 ] Subru Krishnan commented on YARN-4902: -- Thanks [~vinodkv], [~leftnoteasy], [~jianhe],[~vvasudev] and

[jira] [Comment Edited] (YARN-4865) Track Reserved resources in ResourceUsage and QueueCapacities

[ https://issues.apache.org/jira/browse/YARN-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231126#comment-15231126 ] Wangda Tan edited comment on YARN-4865 at 4/7/16 11:56 PM: --- [~sunilg], It seems

[jira] [Commented] (YARN-4865) Track Reserved resources in ResourceUsage and QueueCapacities

[ https://issues.apache.org/jira/browse/YARN-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231361#comment-15231361 ] Sunil G commented on YARN-4865: --- Thanks [~leftnoteasy]. I will add some more tests with this suggested

[jira] [Commented] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails when FairScheduler is the default

[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231351#comment-15231351 ] Karthik Kambatla commented on YARN-4927: Thanks for picking this up, [~bibinchundatt]. Few

[jira] [Updated] (YARN-4931) Preempted resources go back to the same application

[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-4931: - Description: Sometimes a queue that needs resources causes preemption - but the preempted

[jira] [Updated] (YARN-4931) Preempted resources go back to the same application

[ https://issues.apache.org/jira/browse/YARN-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miles Crawford updated YARN-4931: - Description: Sometimes a queue that needs resources causes preemption - but the preempted

[jira] [Created] (YARN-4931) Preempted resources go back to

Miles Crawford created YARN-4931: Summary: Preempted resources go back to Key: YARN-4931 URL: https://issues.apache.org/jira/browse/YARN-4931 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4851) Metric improvements for ATS v1.5 storage

[ https://issues.apache.org/jira/browse/YARN-4851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4851: Attachment: YARN-4851-trunk.001.patch First draft of the patch. In this patch I've added some metrics for the ATS

[jira] [Updated] (YARN-4733) [YARN-3368] Initial commit of new YARN web UI

[ https://issues.apache.org/jira/browse/YARN-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4733: - Summary: [YARN-3368] Initial commit of new YARN web UI (was: [YARN-3368] Commit initial web UI patch to

[jira] [Commented] (YARN-4514) [YARN-3368] Cleanup hardcoded configurations, such as RM/ATS addresses

[ https://issues.apache.org/jira/browse/YARN-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231152#comment-15231152 ] Hadoop QA commented on YARN-4514: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Reopened] (YARN-4514) [YARN-3368] Cleanup hardcoded configurations, such as RM/ATS addresses

[ https://issues.apache.org/jira/browse/YARN-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-4514: -- > [YARN-3368] Cleanup hardcoded configurations, such as RM/ATS addresses >

[jira] [Resolved] (YARN-4514) [YARN-3368] Cleanup hardcoded configurations, such as RM/ATS addresses

[ https://issues.apache.org/jira/browse/YARN-4514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-4514. -- Resolution: Fixed Have to resolve and reopen to set status to be patch available. > [YARN-3368] Cleanup

[jira] [Updated] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses.

[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4849: - Summary: [YARN-3368] cleanup code base, integrate web UI related build to mvn, and fix licenses. (was:

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and add licenses.

[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231135#comment-15231135 ] Wangda Tan commented on YARN-4849: -- Thanks for review, [~sunilg]. ASF license issue is not caused by the

[jira] [Commented] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails when FairScheduler is the default

[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231137#comment-15231137 ] Hadoop QA commented on YARN-4927: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4865) Track Reserved resources in ResourceUsage and QueueCapacities

[ https://issues.apache.org/jira/browse/YARN-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231126#comment-15231126 ] Wangda Tan commented on YARN-4865: -- [~sunilg], It seems this patch needs one more fix: {code} diff --git

[jira] [Commented] (YARN-4781) Support intra-queue preemption for fairness ordering policy.

[ https://issues.apache.org/jira/browse/YARN-4781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15231088#comment-15231088 ] Wangda Tan commented on YARN-4781: -- [~sunilg], We should make sure this JIRA contains infrastructure that

[jira] [Commented] (YARN-4552) NM ResourceLocalizationService should check and initialize local filecache dir (and log dir) even if NM recover is enabled.

[ https://issues.apache.org/jira/browse/YARN-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230992#comment-15230992 ] Junping Du commented on YARN-4552: -- Hi [~vinodkv], I cannot reproduce this issue in current 2.7 branch. I

[jira] [Updated] (YARN-4552) NM ResourceLocalizationService should check and initialize local filecache dir (and log dir) even if NM recover is enabled.

[ https://issues.apache.org/jira/browse/YARN-4552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4552: - Target Version/s: (was: 2.8.0, 2.7.3, 2.6.5) > NM ResourceLocalizationService should check and

[jira] [Updated] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails when FairScheduler is the default

[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4927: --- Assignee: Bibin A Chundatt (was: Karthik Kambatla) >

[jira] [Commented] (YARN-4821) Have a separate NM timeline publishing-interval

[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230903#comment-15230903 ] Naganarasimha G R commented on YARN-4821: - Thanks for the comments [~vinodkv], bq. We should

[jira] [Commented] (YARN-4821) Have a separate NM timeline publishing-interval

[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230813#comment-15230813 ] Vinod Kumar Vavilapalli commented on YARN-4821: --- bq. This proposal is simply to use a

[jira] [Updated] (YARN-4821) Have a separate NM timeline publishing-interval

[ https://issues.apache.org/jira/browse/YARN-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-4821: -- Summary: Have a separate NM timeline publishing-interval (was: have a separate

[jira] [Commented] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails when FairScheduler is the default

[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230544#comment-15230544 ] Bibin A Chundatt commented on YARN-4927: [~kasha] Apologies for not considering case whr default

[jira] [Updated] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails when FairScheduler is the default

[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4927: --- Attachment: 0001-YARN-4927.patch > TestRMHA#testTransitionedToActiveRefreshFail fails when

[jira] [Updated] (YARN-4929) Fix unit test case failures because of removing the minimum wait time for attempt.

[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4929: --- Description: The following unit test cases failed because of we remove the minimum wait time for attempt in

[jira] [Commented] (YARN-4757) [Umbrella] Simplified discovery of services via DNS mechanisms

[ https://issues.apache.org/jira/browse/YARN-4757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230523#comment-15230523 ] Jonathan Maron commented on YARN-4757: -- Sounds like a good approach to me. > [Umbrella] Simplified

[jira] [Commented] (YARN-3461) Consolidate flow name/version/run defaults

[ https://issues.apache.org/jira/browse/YARN-3461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230522#comment-15230522 ] Varun Saxena commented on YARN-3461: Latest patch LGTM. Will commit it shortly. > Consolidate flow

[jira] [Commented] (YARN-4928) Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon

[ https://issues.apache.org/jira/browse/YARN-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230433#comment-15230433 ] Hadoop QA commented on YARN-4928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4928) Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon

[ https://issues.apache.org/jira/browse/YARN-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230422#comment-15230422 ] Junping Du commented on YARN-4928: -- 003 patch looks good in general. A NIT is we don't use below import

[jira] [Commented] (YARN-4928) Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon

[ https://issues.apache.org/jira/browse/YARN-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230408#comment-15230408 ] Gergely Novák commented on YARN-4928: - Sorry, I used on older (incompatible) branch for the patch, v003

[jira] [Updated] (YARN-4928) Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon

[ https://issues.apache.org/jira/browse/YARN-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergely Novák updated YARN-4928: Attachment: YARN-4928.003.patch > Some yarn.server.timeline.* tests fail on Windows attempting to

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230349#comment-15230349 ] Varun Vasudev commented on YARN-4876: - Thanks for the document [~asuresh]! Here are my initial

[jira] [Comment Edited] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230349#comment-15230349 ] Varun Vasudev edited comment on YARN-4876 at 4/7/16 2:52 PM: - Thanks for the

[jira] [Commented] (YARN-4928) Some yarn.server.timeline.* tests fail on Windows attempting to use a test root path containing a colon

[ https://issues.apache.org/jira/browse/YARN-4928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230307#comment-15230307 ] Gergely Novák commented on YARN-4928: - Uploaded a new patch (v.002) that seems to work as originally

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230296#comment-15230296 ] Bibin A Chundatt commented on YARN-3971: Test failure looks like not related to patch attached.Due

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230253#comment-15230253 ] Varun Saxena commented on YARN-3959: I mean should be doable for 1st milestone. > Store application

[jira] [Commented] (YARN-4924) NM recovery race can lead to container not cleaned up

[ https://issues.apache.org/jira/browse/YARN-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230248#comment-15230248 ] Jason Lowe commented on YARN-4924: -- Yeah, now that the NM registers with the list of apps it thinks are

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230172#comment-15230172 ] Hadoop QA commented on YARN-3971: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4927) TestRMHA#testTransitionedToActiveRefreshFail fails when FairScheduler is the default

[ https://issues.apache.org/jira/browse/YARN-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230159#comment-15230159 ] Karthik Kambatla commented on YARN-4927: IIUC, the test is using CS to force a failure of

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15230003#comment-15230003 ] Bibin A Chundatt commented on YARN-3971: [~Naganarasimha] Instead of state based approach have

[jira] [Commented] (YARN-4002) make ResourceTrackerService.nodeHeartbeat more concurrent

[ https://issues.apache.org/jira/browse/YARN-4002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229904#comment-15229904 ] Hadoop QA commented on YARN-4002: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and add licenses.

[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229834#comment-15229834 ] Hadoop QA commented on YARN-4849: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3959) Store application related configurations in Timeline Service v2

[ https://issues.apache.org/jira/browse/YARN-3959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229792#comment-15229792 ] Varun Saxena commented on YARN-3959: [~sjlee0], IIUC this is for reporting configs from MapReduce AM.

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4907: --- Description: There are some inconsistencies among these {{waitForState}} in {{MockRM}}: 1. Some

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4907: --- Description: There are some inconsistencies among these {{waitForState}} in {{MockRM}}: 1. Some

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4907: --- Description: There are some inconsistencies among these {{waitForState}} in {{MockRM}}: 1. Some

[jira] [Updated] (YARN-4907) Make all MockRM#waitForState consistent.

[ https://issues.apache.org/jira/browse/YARN-4907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4907: --- Description: There are some inconsistencies among these {{waitForState}} in {{MockRM}}: 1. Some return a

[jira] [Updated] (YARN-4929) Fix unit test case failures because of removing the minimum wait time for attempt.

[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4929: --- Summary: Fix unit test case failures because of removing the minimum wait time for attempt. (was: Fix unit

[jira] [Commented] (YARN-4849) [YARN-3368] cleanup code base, integrate web UI related build to mvn, and add licenses.

[ https://issues.apache.org/jira/browse/YARN-4849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15229743#comment-15229743 ] Sunil G commented on YARN-4849: --- Thanks [~leftnoteasy]. I think latest patch looks fine. +1 > [YARN-3368]