[jira] [Commented] (YARN-3514) Active directory usernames like domain\login cause YARN failures

2015-04-20 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503666#comment-14503666 ] Chris Nauroth commented on YARN-3514: - [~john.lil...@redpoint.net], thank you for the

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing MR events to v2 ATS

2015-04-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504118#comment-14504118 ] Sangjin Lee commented on YARN-3046: --- Looks fine for the most part. One small point:

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

2015-04-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503760#comment-14503760 ] Thomas Graves commented on YARN-3294: - [~xgong] [~vvasudev] I saw this show up in the

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing MR events to ATS

2015-04-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Summary: [Event producers] Implement MapReduce AM writing MR events to ATS (was: [Event producers]

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing MR events to v2 ATS

2015-04-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Summary: [Event producers] Implement MapReduce AM writing MR events to v2 ATS (was: [Event producers]

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503751#comment-14503751 ] Jian He commented on YARN-3494: --- Rohith, thanks for working on this ! couple comments: -

[jira] [Commented] (YARN-3445) NM notify RM on running Apps in NM-RM heartbeat

2015-04-20 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503775#comment-14503775 ] Vinod Kumar Vavilapalli commented on YARN-3445: --- This doesn't sound right. RM

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503865#comment-14503865 ] Hadoop QA commented on YARN-3434: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3445) NM notify RM on running Apps in NM-RM heartbeat

2015-04-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503931#comment-14503931 ] Junping Du commented on YARN-3445: -- bq. This doesn't sound right. RM already knows what is

[jira] [Updated] (YARN-3387) container complete message couldn't pass to am if am restarted and rm changed

2015-04-20 Thread sandflee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-3387: --- Attachment: YARN-3387.002.patch ut added container complete message couldn't pass to am if am restarted and

[jira] [Commented] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504081#comment-14504081 ] Rohith commented on YARN-3492: -- I verified Hadoop-2.7 RC with same configurations attached in

[jira] [Commented] (YARN-3468) NM should not blindly rename usercache/filecache/nmPrivate on restart

2015-04-20 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504093#comment-14504093 ] Sangjin Lee commented on YARN-3468: --- Sorry this fell off my radar. {code} 1094

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: YARN-2498.patch) Respect labels in preemption policy of capacity scheduler

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: yarn-2498-implementation-notes.pdf) Respect labels in preemption policy of capacity

[jira] [Updated] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-20 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-3434: Attachment: YARN-3434.patch Upmerged to latest Interaction between reservations and userlimit can

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Description: There're 3 stages in ProportionalCapacityPreemptionPolicy, # Recursively calculate

[jira] [Updated] (YARN-3413) Node label attributes (like exclusive or not) should be able to set when addToClusterNodeLabels and shouldn't be changed during runtime

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3413: - Attachment: YARN-3413.2.patch Attached ver.2 patch, rebased to latest trunk and fixed findbugs warning.

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503991#comment-14503991 ] Wangda Tan commented on YARN-3410: -- While committing, I found conflicts happens while

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

2015-04-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503994#comment-14503994 ] zhihai xu commented on YARN-3464: - thanks [~jlowe] and [~kasha], bq. changing the logic

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: YARN-2498.1.patch Attached new initial patch. (ver.1) Respect labels in preemption policy of

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2740: Attachment: YARN-2740.20150421-1.patch Thanks for the review comments [~wangda], I have

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing MR events to v2 ATS

2015-04-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504066#comment-14504066 ] Zhijie Shen commented on YARN-3046: --- Hopefully we can agree the scope of this jira to add

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503552#comment-14503552 ] Wangda Tan commented on YARN-3463: -- Great! I will commit this today if no opposite

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503750#comment-14503750 ] Wangda Tan commented on YARN-2740: -- Retriggered Jenkins. ResourceManager side should

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Summary: Respect labels in preemption policy of capacity scheduler for inter-queue preemption (was:

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

2015-04-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503800#comment-14503800 ] Zhijie Shen commented on YARN-3134: --- [~vrushalic], so entity relationship will also be

[jira] [Commented] (YARN-3387) container complete message couldn't pass to am if am restarted and rm changed

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504109#comment-14504109 ] Hadoop QA commented on YARN-3387: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503551#comment-14503551 ] Junping Du commented on YARN-3046: -- Thanks [~sjlee0] for review and comments! bq. So am I

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503692#comment-14503692 ] Wangda Tan commented on YARN-2498: -- Short notes about this patch: - It indepdently

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

2015-04-20 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Attachment: YARN-3046-v5.patch Update patch to address latest comments from [~sjlee0], verify it works

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503792#comment-14503792 ] Wangda Tan commented on YARN-2740: -- Hi [~Naganarasimha], After reread our conversation, I

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503919#comment-14503919 ] Wangda Tan commented on YARN-3434: -- [~tgraves], thanks for updating, some comments on

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.72.patch Fix a findbugs Implement a FairOrderingPolicy

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-04-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504124#comment-14504124 ] zhihai xu commented on YARN-3491: - Hi [~wilfreds], thanks for the review. A directory goes

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-20 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503648#comment-14503648 ] Inigo Goiri commented on YARN-3481: --- [~vinodkc] thanks for fixing the JIRA; these are my

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: STALED-YARN-2498.zip Since patch+designdoc is already staled, make them to be an archive and

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: YARN-2498.patch) Respect labels in preemption policy of capacity scheduler

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503848#comment-14503848 ] Wangda Tan commented on YARN-2004: -- [~jlowe], [~sunilg]: 1) Regarding to per-queue

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503955#comment-14503955 ] Hadoop QA commented on YARN-2740: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.70.patch Up to date with same patch index on [YARN-3463], still one todo, which is

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503975#comment-14503975 ] Wangda Tan commented on YARN-3410: -- Committing... YARN admin should be able to remove

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504022#comment-14504022 ] Hudson commented on YARN-3463: -- SUCCESS: Integrated in Hadoop-trunk-Commit #7620 (See

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

2015-04-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503588#comment-14503588 ] Karthik Kambatla commented on YARN-3464: bq. So I'd look into changing the logic

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: YARN-2498.patch) Respect labels in preemption policy of capacity scheduler

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503745#comment-14503745 ] Wangda Tan commented on YARN-2498: -- Linked to YARN-3515, which is to support intra-queue

[jira] [Updated] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3319: -- Attachment: YARN-3319.71.patch with fair config support, sizeBasedWeight config support Implement a

[jira] [Created] (YARN-3514) Active directory usernames like domain\login cause YARN failures

2015-04-20 Thread john lilley (JIRA)
john lilley created YARN-3514: - Summary: Active directory usernames like domain\login cause YARN failures Key: YARN-3514 URL: https://issues.apache.org/jira/browse/YARN-3514 Project: Hadoop YARN

[jira] [Created] (YARN-3515) Support intra-queue non-exclusive container allocation within a LeafQueue

2015-04-20 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-3515: Summary: Support intra-queue non-exclusive container allocation within a LeafQueue Key: YARN-3515 URL: https://issues.apache.org/jira/browse/YARN-3515 Project: Hadoop YARN

[jira] [Commented] (YARN-2556) Tool to measure the performance of the timeline server

2015-04-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503791#comment-14503791 ] Zhijie Shen commented on YARN-2556: --- Do we have any plan to get this jira in recently?

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503916#comment-14503916 ] Hadoop QA commented on YARN-2498: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: YARN-2498.2.patch Attached ver.2, fixed findbugs warning, release audit warning and test

[jira] [Commented] (YARN-3468) NM should not blindly rename usercache/filecache/nmPrivate on restart

2015-04-20 Thread Siqi Li (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504151#comment-14504151 ] Siqi Li commented on YARN-3468: --- Got it. I will modify the patch as you suggested NM should

[jira] [Created] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-20 Thread zhihai xu (JIRA)
zhihai xu created YARN-3516: --- Summary: killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status. Key: YARN-3516 URL: https://issues.apache.org/jira/browse/YARN-3516

[jira] [Updated] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3431: -- Attachment: YARN-3431.5.patch Sub resources of timeline entity needs to be passed to a separate

[jira] [Updated] (YARN-3489) RMServerUtils.validateResourceRequests should only obtain queue info once

2015-04-20 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-3489: --- Attachment: YARN-3489.02.patch RMServerUtils.validateResourceRequests should only obtain queue info

[jira] [Commented] (YARN-3511) Add errors and warnings page to ATS

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504210#comment-14504210 ] Hadoop QA commented on YARN-3511: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3516: Attachment: YARN-3516.000.patch killing ContainerLocalizer action doesn't take effect when private

[jira] [Commented] (YARN-3319) Implement a FairOrderingPolicy

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504176#comment-14504176 ] Hadoop QA commented on YARN-3319: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3516: Description: killing ContainerLocalizer action doesn't take effect when private localizer receives

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

2015-04-20 Thread Zhijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504394#comment-14504394 ] Zhijie Shen commented on YARN-3431: --- [~sjlee0], thanks for your comments. I addressed

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504164#comment-14504164 ] Hadoop QA commented on YARN-2498: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504188#comment-14504188 ] Naganarasimha G R commented on YARN-2740: - [~wangda], Seems like most of the test

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504242#comment-14504242 ] Rohith commented on YARN-3410: -- Sure, I will create the patch for branch-2 and upload it.

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504162#comment-14504162 ] Hadoop QA commented on YARN-2740: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

2015-04-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504198#comment-14504198 ] Jian He commented on YARN-3503: --- lgtm. thanks Varun ! Expose disk utilization percentage

[jira] [Updated] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3410: - Attachment: 0004-YARN-3410-branch-2.patch Updated the patch for branch-2 YARN admin should be able to remove

[jira] [Updated] (YARN-3511) Add errors and warnings page to ATS

2015-04-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3511: Attachment: YARN-3511.001.patch Uploaded patch. It also adds a tools section to make the AHS web ui

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

2015-04-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504219#comment-14504219 ] Sunil G commented on YARN-2004: --- Thank you [~jlowe] {noformat} @@ -327,6 +328,29 @@ private

[jira] [Commented] (YARN-3413) Node label attributes (like exclusive or not) should be able to set when addToClusterNodeLabels and shouldn't be changed during runtime

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504130#comment-14504130 ] Hadoop QA commented on YARN-3413: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504150#comment-14504150 ] Brahma Reddy Battula commented on YARN-3410: 004-Patch overall LGTM,, One minor

[jira] [Commented] (YARN-3516) killing ContainerLocalizer action doesn't take effect when private localizer receives FETCH_FAILURE status.

2015-04-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3516?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504283#comment-14504283 ] zhihai xu commented on YARN-3516: - Hi [~xgong], Could you review the patch

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504312#comment-14504312 ] Hadoop QA commented on YARN-3410: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3410) YARN admin should be able to remove individual application records from RMStateStore

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14504290#comment-14504290 ] Rohith commented on YARN-3410: -- Its already handled in that patch. YARN admin should be able

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

2015-04-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503540#comment-14503540 ] Jason Lowe commented on YARN-3464: -- We shouldn't leave a ContainerLocalizer lingering

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502707#comment-14502707 ] Rohith commented on YARN-3494: -- One self review is move below code to setupQueueConfigs. Will

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502713#comment-14502713 ] Hadoop QA commented on YARN-3494: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3177) Fix the order of the parameters in YarnConfiguration

2015-04-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502750#comment-14502750 ] Brahma Reddy Battula commented on YARN-3177: Agreed with chris..Hence closing

[jira] [Commented] (YARN-3177) Fix the order of the parameters in YarnConfiguration

2015-04-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502746#comment-14502746 ] Brahma Reddy Battula commented on YARN-3177: Closing this issue.. Fix the

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

2015-04-20 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502813#comment-14502813 ] Wilfred Spiegelenburg commented on YARN-3491: - Could this change not cause a

[jira] [Resolved] (YARN-3177) Fix the order of the parameters in YarnConfiguration

2015-04-20 Thread Brahma Reddy Battula (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved YARN-3177. Resolution: Not A Problem Fix the order of the parameters in YarnConfiguration

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502635#comment-14502635 ] Rohith commented on YARN-3494: -- Updated the patch adding metric for AMResourceLimit,

[jira] [Updated] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

2015-04-20 Thread Rohith (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3494: - Attachment: 0001-YARN-3494.patch Expose AM resource limit and user limit in QueueMetrics

[jira] [Resolved] (YARN-3502) Expose number of unhealthy disks on NM via JMX

2015-04-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev resolved YARN-3502. - Resolution: Won't Fix Expose number of unhealthy disks on NM via JMX

[jira] [Commented] (YARN-3502) Expose number of unhealthy disks on NM via JMX

2015-04-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502888#comment-14502888 ] Varun Vasudev commented on YARN-3502: - There is a lot of common work between this and

[jira] [Updated] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

2015-04-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Summary: Expose disk utilization percentage and bad disk counts on NM via JMX (was: Expose disk

[jira] [Updated] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

2015-04-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Attachment: YARN-3503.0.patch First cut of the patch. Currently exposes the information only via

[jira] [Updated] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

2015-04-20 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3497: - Attachment: YARN-3497.002.patch Thanks for the review, Jian! I updated the patch to use this.conf when

[jira] [Updated] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

2015-04-20 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Description: It would be useful to expose the disk utilization as well as the number of bad local

[jira] [Commented] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

2015-04-20 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14502951#comment-14502951 ] Hadoop QA commented on YARN-3503: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

2015-04-20 Thread zhihai xu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503258#comment-14503258 ] zhihai xu commented on YARN-3464: - Thanks [~kasha] for the detail explanation. For the

[jira] [Commented] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

2015-04-20 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503283#comment-14503283 ] Hudson commented on YARN-3497: -- FAILURE: Integrated in Hadoop-trunk-Commit #7617 (See

[jira] [Updated] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

2015-04-20 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3492: -- Target Version/s: 2.7.1 (was: 2.7.0) bq. I took your mapred-site.xml and

[jira] [Updated] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

2015-04-20 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 00010-YARN-2003.patch Removing dependency with YARN-2004. Support to process Job priority from

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

2015-04-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503339#comment-14503339 ] Naganarasimha G R commented on YARN-2729: - [~wangda], any updates on this patch

[jira] [Commented] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

2015-04-20 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503265#comment-14503265 ] Jian He commented on YARN-3497: --- looks good , + 1 ContainerManagementProtocolProxy modifies

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-20 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503302#comment-14503302 ] Wangda Tan commented on YARN-3463: -- bq. I have to say I prefer getInfo to getStatusMessage

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

2015-04-20 Thread Craig Welch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.70.patch Ok, getInfo it is, attached Integrate OrderingPolicy Framework with

[jira] [Updated] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

2015-04-20 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3481: -- Priority: Major (was: Minor) Report NM aggregated container resource

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

2015-04-20 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2740: Attachment: YARN-2740.20150420-1.patch Hi [~wangda], i have updated the patch with the

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

2015-04-20 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14503328#comment-14503328 ] Karthik Kambatla commented on YARN-3464: [~jlowe] - do you think any of my earlier

  1   2   >