[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.016.patch Fixing javadoc and test failure. [~leftnoteasy] and [~templedf],

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104777#comment-16104777 ] Hadoop QA commented on YARN-6802: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-07-28 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104776#comment-16104776 ] Manikandan R commented on YARN-6492: [~Naganarasimha] Thanks for review and suggestions. [~sunilg],

[jira] [Commented] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104753#comment-16104753 ] Naganarasimha G R commented on YARN-6898: - [~daemon], At least in scheduler page we already show

[jira] [Commented] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105270#comment-16105270 ] Sunil G commented on YARN-6898: --- [~daemon] Thanks for sharing your comments. Adding to

[jira] [Updated] (YARN-6802) Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI

2017-07-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6802: --- Summary: Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI (was: Support

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105036#comment-16105036 ] YunFan Zhou commented on YARN-6842: --- [~yufeigu] Hi, YuFei. I am sorry for paying your attention to this

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105280#comment-16105280 ] Sunil G commented on YARN-6842: --- Is this issue in similar line with YARN-6890? With out jumping into much

[jira] [Commented] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105042#comment-16105042 ] Naganarasimha G R commented on YARN-6898: - [~daemon], I think you got me wrong, sorry if i

[jira] [Updated] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-6593: - Attachment: YARN-6593.008.patch Fixing last checkstyle/javadoc issue. > [API]

[jira] [Assigned] (YARN-65) Reduce RM app memory footprint once app has completed

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-65: - Assignee: Manikandan R (was: Naganarasimha G R) > Reduce RM app memory footprint once app

[jira] [Updated] (YARN-6842) Implement a new access type for queue

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6842: Fix Version/s: (was: 2.8.2) > Implement a new access type for queue >

[jira] [Updated] (YARN-6788) Improve performance of resource profile branch

2017-07-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6788: -- Attachment: YARN-6788-YARN-3926.017.patch missed a file. updating a cleaner version > Improve performance of

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105168#comment-16105168 ] Naganarasimha G R commented on YARN-65: --- Thanks for working on it [~maniraj...@gmail.com] based on the

[jira] [Commented] (YARN-6734) Ensure sub-application user is extracted & sent to timeline service

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105249#comment-16105249 ] Varun Saxena commented on YARN-6734: +1. Will commit it shortly. > Ensure sub-application user is

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-07-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105284#comment-16105284 ] Sunil G commented on YARN-6492: --- Thanks [~maniraj...@gmail.com], I ll take a look in this ticket in a short

[jira] [Commented] (YARN-6802) Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI

2017-07-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105297#comment-16105297 ] Yufei Gu commented on YARN-6802: Thanks for the patch, [~daemon]. Committed to trunk. Doesn't apply to

[jira] [Commented] (YARN-6888) Refactor AppLevelTimelineCollector such that RM does not have aggregator threads created

2017-07-28 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104494#comment-16104494 ] Rohith Sharma K S commented on YARN-6888: - committing shortly > Refactor AppLevelTimelineCollector

[jira] [Commented] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104515#comment-16104515 ] Yufei Gu commented on YARN-6864: Thanks for the patch, [~templedf]. Committed to trunk and branch-2. >

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-07-28 Thread Zheng Shao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104500#comment-16104500 ] Zheng Shao commented on YARN-2915: -- Thanks [~subru] and [~curino]. This is very relevant to us at Uber

[jira] [Commented] (YARN-6864) FSPreemptionThread cleanup for readability

2017-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104535#comment-16104535 ] Hudson commented on YARN-6864: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12064 (See

[jira] [Updated] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-07-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6727: --- Attachment: YARN-6727.001.patch [~sunilg] and [~naganarasimha...@apache.org] Uploading in

[jira] [Comment Edited] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-07-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104553#comment-16104553 ] Bibin A Chundatt edited comment on YARN-6727 at 7/28/17 8:19 AM: - [~sunilg]

[jira] [Updated] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou updated YARN-6802: -- Attachment: YARN-6802.003.patch > Support view leaf queue am resource usage in RM web ui >

[jira] [Commented] (YARN-6802) Support view leaf queue am resource usage in RM web ui

2017-07-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16104711#comment-16104711 ] YunFan Zhou commented on YARN-6802: --- Thank YuFei, I have uploaded a new patch. > Support view leaf

[jira] [Commented] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105022#comment-16105022 ] YunFan Zhou commented on YARN-6898: --- [~Naganarasimha] Thank Naganarasimha, I think it is very useful

[jira] [Assigned] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] YunFan Zhou reassigned YARN-6898: - Assignee: YunFan Zhou > RM node labels page should display total used resources of each label. >

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105063#comment-16105063 ] Naganarasimha G R commented on YARN-6842: - Hi [~daemon], Please ensure that *FIX VERSION* is never

[jira] [Commented] (YARN-6842) Implement a new access type for queue

2017-07-28 Thread YunFan Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105120#comment-16105120 ] YunFan Zhou commented on YARN-6842: --- Thank Naganarasimha G R, In fact, the original intention of the

[jira] [Updated] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-6870: - Attachment: YARN-6870-v3.patch > ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization

[jira] [Commented] (YARN-6872) Ensure apps could run given NodeLabels are disabled post RM switchover/restart

2017-07-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105743#comment-16105743 ] Jian He commented on YARN-6872: --- isRecovery flag is already passed into

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105786#comment-16105786 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105798#comment-16105798 ] Brook Zhou commented on YARN-6870: -- Findbugs warnings are from existing code not in this patch. >

[jira] [Commented] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105674#comment-16105674 ] Giovanni Matteo Fumarola commented on YARN-6853: Fixed the whitespaces in v2. > Add MySql

[jira] [Updated] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6853: --- Attachment: YARN-6853-YARN-2915.v2.patch > Add MySql Scripts for

[jira] [Updated] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6853: --- Parent Issue: YARN-2915 (was: YARN-5597) > Add MySql Scripts for

[jira] [Commented] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105719#comment-16105719 ] Hadoop QA commented on YARN-6853: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6757: - Attachment: YARN-6757.003.patch > Refactor the usage of >

[jira] [Commented] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105732#comment-16105732 ] Wangda Tan commented on YARN-6726: -- Thanks [~shaneku...@gmail.com], my only concern is the new added

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105741#comment-16105741 ] Hadoop QA commented on YARN-6897: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105771#comment-16105771 ] Giovanni Matteo Fumarola commented on YARN-6897: I did not add junit tests since it is a

[jira] [Updated] (YARN-5514) Clarify DecommissionType.FORCEFUL comment

2017-07-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-5514: -- Issue Type: Sub-task (was: Bug) Parent: YARN-914 > Clarify

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105796#comment-16105796 ] Konstantinos Karanasos commented on YARN-6593: -- Sounds good, thanks [~leftnoteasy] and

[jira] [Commented] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105644#comment-16105644 ] Hadoop QA commented on YARN-6853: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105675#comment-16105675 ] Hadoop QA commented on YARN-6757: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105689#comment-16105689 ] Wangda Tan commented on YARN-6593: -- Latest patch looks good, +1, I will commit it next Tue (give a couple

[jira] [Updated] (YARN-5197) RM leaks containers if running container disappears from node update

2017-07-28 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-5197: -- Priority: Critical (was: Major) > RM leaks containers if running container

[jira] [Commented] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105795#comment-16105795 ] Hadoop QA commented on YARN-6870: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105807#comment-16105807 ] Subru Krishnan commented on YARN-6853: -- Thanks for the patch [~giovanni.fumarola], it looks the MySQL

[jira] [Created] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-07-28 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-6901: Summary: A CapacityScheduler app->LeafQueue deadlock found in branch-2.8 Key: YARN-6901 URL: https://issues.apache.org/jira/browse/YARN-6901 Project: Hadoop YARN

[jira] [Updated] (YARN-6901) A CapacityScheduler app->LeafQueue deadlock found in branch-2.8

2017-07-28 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6901: - Attachment: YARN-6901.branch-2.8.001.patch Attached ver.001 patch for branch-2.8. [~sunilg], could you

[jira] [Updated] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6897: --- Attachment: YARN-6897.v1.patch > Refactoring RMWebServices by moving some util

[jira] [Commented] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105408#comment-16105408 ] Hadoop QA commented on YARN-6130: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6898) RM node labels page should display total used resources of each label.

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105474#comment-16105474 ] Naganarasimha G R commented on YARN-6898: - [~sunilg], Yes we can show but its add on, as its

[jira] [Updated] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6897: - Parent Issue: YARN-2915 (was: YARN-5597) > Refactoring RMWebServices by moving some util methods

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105479#comment-16105479 ] Subru Krishnan commented on YARN-6897: -- The patch is very straightforward. [~giovanni.fumarola], can

[jira] [Commented] (YARN-6788) Improve performance of resource profile branch

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105499#comment-16105499 ] Hadoop QA commented on YARN-6788: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6900: - Parent Issue: YARN-5597 (was: YARN-2915) > ZooKeeper based implementation of the

[jira] [Commented] (YARN-6895) Preemption reservation may cause regular reservation leaks

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105536#comment-16105536 ] Hadoop QA commented on YARN-6895: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-07-28 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105618#comment-16105618 ] Junping Du commented on YARN-5464: -- [~rkanter], do you have bandwidth on this in short term? If not, I

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105626#comment-16105626 ] Giovanni Matteo Fumarola commented on YARN-6897: Fixed the Yetus warnings in V2. I run the

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6757: - Attachment: YARN-6757.002.patch > Refactor the usage of >

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105581#comment-16105581 ] Miklos Szegedi commented on YARN-6757: -- Thanks. I updated the documentation including the html. I

[jira] [Commented] (YARN-6895) Preemption reservation may cause regular reservation leaks

2017-07-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105632#comment-16105632 ] Miklos Szegedi commented on YARN-6895: -- I verified and TestSubmitApplicationWithRMHA fails without the

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2017-07-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105521#comment-16105521 ] Naganarasimha G R commented on YARN-2919: - Hi [~jianhe] & [~djp], If you guys still feel its better

[jira] [Updated] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6853: --- Attachment: (was: YARN-6853.proto.patch) > Add MySql Scripts for

[jira] [Updated] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6853: --- Attachment: YARN-6853.v1.patch > Add MySql Scripts for FederationStateStore >

[jira] [Commented] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105569#comment-16105569 ] Hadoop QA commented on YARN-6853: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6853: --- Attachment: YARN-6853-YARN-2915.v1.patch > Add MySql Scripts for

[jira] [Commented] (YARN-6853) Add MySql Scripts for FederationStateStore

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105607#comment-16105607 ] Giovanni Matteo Fumarola commented on YARN-6853: Attached the new patch with the correct

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2017-07-28 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105617#comment-16105617 ] Andrew Wang commented on YARN-5464: --- Ping, is someone going to take this? Beta1 is fast approaching. >

[jira] [Updated] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6897: --- Attachment: YARN-6897.v2.patch > Refactoring RMWebServices by moving some util

[jira] [Updated] (YARN-6802) Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI

2017-07-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6802: --- Fix Version/s: (was: 2.8.0) 3.0.0-beta1 2.9.0 > Add Max AM Resource

[jira] [Updated] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6897: --- Attachment: YARN-6897.v1.patch > Refactoring RMWebServices by moving some util

[jira] [Commented] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105396#comment-16105396 ] Arun Suresh commented on YARN-6870: --- Thanks for the patch Brook, Looks like the javadoc issue is due to

[jira] [Resolved] (YARN-6847) [ATSv2] NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena resolved YARN-6847. Resolution: Duplicate > [ATSv2] NPE in RM while starting timeline collector on recovery after >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6900: - Description: YARN-5408 defines the unified {{FederationStateStore}} API. This JIRA tracks an

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6900: - Hadoop Flags: (was: Reviewed) > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6900: - Target Version/s: 3.0.0-beta1 (was: YARN-2915) > ZooKeeper based implementation of the

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6900: - Component/s: federation > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6895) Preemption reservation may cause regular reservation leaks

2017-07-28 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-6895: - Attachment: YARN-6895.000.patch > Preemption reservation may cause regular reservation leaks >

[jira] [Commented] (YARN-6847) [ATSv2] NPE in RM while starting timeline collector on recovery after explicit failover

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105415#comment-16105415 ] Varun Saxena commented on YARN-6847: Have backported YARN-6102 to branches YARN-5355 and

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-YARN-5355.06.patch > [ATSv2 Security] Generate a delegation token for AM when

[jira] [Commented] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105455#comment-16105455 ] Hadoop QA commented on YARN-6897: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: (was: YARN-6130-YARN-5355.06.patch) > [ATSv2 Security] Generate a delegation token for

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-YARN-5355.06.patch > [ATSv2 Security] Generate a delegation token for AM when

[jira] [Assigned] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-6900: Assignee: Inigo Goiri (was: Ellen Hui) > ZooKeeper based implementation of the

[jira] [Created] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6900: Summary: ZooKeeper based implementation of the FederationStateStore Key: YARN-6900 URL: https://issues.apache.org/jira/browse/YARN-6900 Project: Hadoop YARN

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6900: - Description: YARN-5408 defines the unified {{FederationStateStore}} API. Currently we only support

[jira] [Commented] (YARN-6802) Add Max AM Resource and AM Resource Usage to Leaf Queue View in FairScheduler WebUI

2017-07-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105353#comment-16105353 ] Hudson commented on YARN-6802: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12067 (See

[jira] [Assigned] (YARN-6621) Validate Placement Constraints

2017-07-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos reassigned YARN-6621: Assignee: Konstantinos Karanasos > Validate Placement Constraints >

[jira] [Updated] (YARN-6621) Validate Placement Constraints

2017-07-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-6621: - Summary: Validate Placement Constraints (was: Validator for Placement

[jira] [Resolved] (YARN-6899) Validate Placement Constraints

2017-07-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos resolved YARN-6899. -- Resolution: Duplicate Duplicate of YARN-6621. > Validate Placement Constraints

[jira] [Commented] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105398#comment-16105398 ] Arun Suresh commented on YARN-6870: --- +1 pending the javadoc fix >

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: YARN-6130-YARN-5355.06.patch > [ATSv2 Security] Generate a delegation token for AM when

[jira] [Updated] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-6870: - Attachment: YARN-6870-v2.patch Thanks, made the change. > ResourceUtilization/ContainersMonitorImpl is

[jira] [Updated] (YARN-6130) [ATSv2 Security] Generate a delegation token for AM when app collector is created and pass it to AM via NM and RM

2017-07-28 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-6130: --- Attachment: (was: YARN-6130-YARN-5355.06.patch) > [ATSv2 Security] Generate a delegation token for

[jira] [Updated] (YARN-6897) Refactoring RMWebServices by moving some util methods in RMWebAppUtil

2017-07-28 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-6897: --- Attachment: (was: YARN-6897.v1.patch) > Refactoring RMWebServices by

[jira] [Updated] (YARN-6870) ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization as a float, which is imprecise

2017-07-28 Thread Brook Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brook Zhou updated YARN-6870: - Attachment: YARN-6870-v1.patch > ResourceUtilization/ContainersMonitorImpl is calculating CPU utilization

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-07-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16105328#comment-16105328 ] Hadoop QA commented on YARN-6593: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >