[jira] [Commented] (YARN-7962) Race Condition When Stopping DelegationTokenRenewer

2018-04-23 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447673#comment-16447673 ] Wilfred Spiegelenburg commented on YARN-7962: - Sorry for the delay was caught up in other

[jira] [Updated] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

2018-04-23 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] kyungwan nam updated YARN-8179: --- Attachment: YARN-8179.002.patch > Preemption does not happen due to natural_termination_factor when

[jira] [Updated] (YARN-8177) Documentation changes for auto creation of Leaf Queues with node label

2018-04-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-8177: -- Summary: Documentation changes for auto creation of Leaf Queues with node label (was: Fix documentation for

[jira] [Commented] (YARN-5151) [YARN-3368] Support kill application from new YARN UI

2018-04-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447741#comment-16447741 ] Sunil G commented on YARN-5151: --- [~GergelyNovak] Thanks for rebasing. I was doing some more testing with

[jira] [Commented] (YARN-7956) [UI2] Avoid duplicating Components link under Services//Components

2018-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447736#comment-16447736 ] Hudson commented on YARN-7956: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14045 (See

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

2018-04-23 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447705#comment-16447705 ] kyungwan nam commented on YARN-8179: Attached a patch with test case. and it will normalize up only if

[jira] [Commented] (YARN-8177) Documentation changes for auto creation of Leaf Queues with node label

2018-04-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447769#comment-16447769 ] Hudson commented on YARN-8177: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14046 (See

[jira] [Commented] (YARN-7668) Remove unused variables from ContainerLocalizer

2018-04-23 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16447873#comment-16447873 ] ASF GitHub Bot commented on YARN-7668: -- GitHub user dedunumax opened a pull request:

[jira] [Created] (YARN-8199) Loggng fileSize of NM local files

2018-04-23 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-8199: --- Summary: Loggng fileSize of NM local files Key: YARN-8199 URL: https://issues.apache.org/jira/browse/YARN-8199 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-04-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448323#comment-16448323 ] Eric Yang commented on YARN-7781: - [~gsaha] I think it is more meaningful to have real working examples.

[jira] [Commented] (YARN-8064) Docker ".cmd" files should not be put in hadoop.tmp.dir

2018-04-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8064?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448347#comment-16448347 ] Eric Badger commented on YARN-8064: --- Thanks, [~eyang] for the commits and [~shaneku...@gmail.com] and

[jira] [Commented] (YARN-6495) check docker container's exit code when writing to cgroup task files

2018-04-23 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448353#comment-16448353 ] Eric Badger commented on YARN-6495: --- I think that the whole error checking is related. It shouldn't be a

[jira] [Commented] (YARN-8187) [UI2] clicking on Individual Nodes does not contain breadcums in Nodes Page

2018-04-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448392#comment-16448392 ] genericqa commented on YARN-8187: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8198) Add Security-Related HTTP Response Header in Yarn WEBUIs.

2018-04-23 Thread Kanwaljeet Sachdev (JIRA)
Kanwaljeet Sachdev created YARN-8198: Summary: Add Security-Related HTTP Response Header in Yarn WEBUIs. Key: YARN-8198 URL: https://issues.apache.org/jira/browse/YARN-8198 Project: Hadoop YARN

[jira] [Assigned] (YARN-8198) Add Security-Related HTTP Response Header in Yarn WEBUIs.

2018-04-23 Thread Kanwaljeet Sachdev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanwaljeet Sachdev reassigned YARN-8198: Assignee: Kanwaljeet Sachdev > Add Security-Related HTTP Response Header in Yarn

[jira] [Updated] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-04-23 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-8191: -- Attachment: YARN-8191.001.patch > Fair scheduler: queue deletion without RM restart >

[jira] [Commented] (YARN-8151) Yarn RM Epoch should wrap around

2018-04-23 Thread Young Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448579#comment-16448579 ] Young Chen commented on YARN-8151: -- Which comment are you referring to specifically? I'll update it.

[jira] [Commented] (YARN-8183) yClient for Kill Application stuck in infinite loop with message "Waiting for Application to be killed"

2018-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448511#comment-16448511 ] Wangda Tan commented on YARN-8183: -- Thanks [~suma.shivaprasad],  Overall the fix looks good. Not related

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-04-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448549#comment-16448549 ] Eric Yang commented on YARN-7939: - [~csingh] [~shaneku...@gmail.com] Upgrade log attached for your review.

[jira] [Updated] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-04-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7939: Attachment: upgrade_logs.tgz > Yarn Service Upgrade: add support to upgrade a component instance >

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-04-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448982#comment-16448982 ] Chandni Singh commented on YARN-7939: - Couple of bugs discovered by [~shaneku...@gmail.com] 1. If the

[jira] [Created] (YARN-8200) Backport resource types/GPU features to branch-2

2018-04-23 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-8200: --- Summary: Backport resource types/GPU features to branch-2 Key: YARN-8200 URL: https://issues.apache.org/jira/browse/YARN-8200 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-04-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448776#comment-16448776 ] genericqa commented on YARN-8191: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3962) If we change node manager identity to run as virtual account, then resource localization service fails to start with incorrect permission

2018-04-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448775#comment-16448775 ] genericqa commented on YARN-3962: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-04-23 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8193: Attachment: YARN-8193.001.patch > YARN RM hangs abruptly (stops allocating resources) when running

[jira] [Commented] (YARN-7781) Update YARN-Services-Examples.md to be in sync with the latest code

2018-04-23 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448901#comment-16448901 ] Gour Saha commented on YARN-7781: - [~eyang], I agree with your point and I think we should update the

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

2018-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448943#comment-16448943 ] Wangda Tan commented on YARN-8200: -- [~jhung], I would suggest to try use 3.x instead back porting this to

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-04-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449113#comment-16449113 ] genericqa commented on YARN-7654: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8178) [Umbrella] Resource Over-commitment Based on Opportunistic Container Preemption

2018-04-23 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448997#comment-16448997 ] Zian Chen commented on YARN-8178: - Hi [~asuresh] , sure that would be great if I can be helpful on the code

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

2018-04-23 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449023#comment-16449023 ] Chris Douglas commented on YARN-8200: - bq. I would suggest to try use 3.x instead back porting this to

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

2018-04-23 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449000#comment-16449000 ] Konstantin Shvachko commented on YARN-8200: --- Hey [~leftnoteasy], we discussed it in [this

[jira] [Commented] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449075#comment-16449075 ] Wangda Tan commented on YARN-4606: -- Thanks [~eepayne] / [~maniraj...@gmail.com] for working on the fix. I

[jira] [Assigned] (YARN-4606) CapacityScheduler: applications could get starved because computation of #activeUsers considers pending apps

2018-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-4606: Assignee: (was: Wangda Tan) > CapacityScheduler: applications could get starved because

[jira] [Updated] (YARN-7654) Support ENTRY_POINT for docker container

2018-04-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7654: Attachment: YARN-7654.016.patch > Support ENTRY_POINT for docker container >

[jira] [Commented] (YARN-8178) [Umbrella] Resource Over-commitment Based on Opportunistic Container Preemption

2018-04-23 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448986#comment-16448986 ] Zian Chen commented on YARN-8178: - Hi [~asuresh], [~kkaranasos] , really appreciate your comments and show 

[jira] [Commented] (YARN-7654) Support ENTRY_POINT for docker container

2018-04-23 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448984#comment-16448984 ] Eric Yang commented on YARN-7654: - Patch 16 is changed to support env-file only without -e parameters. The

[jira] [Updated] (YARN-8178) [Umbrella] Resource Over-commitment Based on Opportunistic Container Preemption

2018-04-23 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8178: Attachment: Resource Over-commitment Based on Opportunistic Container Preemption.pdf > [Umbrella] Resource

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-04-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449089#comment-16449089 ] genericqa commented on YARN-8193: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7892) Revisit NodeAttribute class structure

2018-04-23 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-7892: Attachment: YARN-7892-YARN-3409.003.patch > Revisit NodeAttribute class structure >

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

2018-04-23 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449312#comment-16449312 ] Wangda Tan commented on YARN-8200: -- [~chris.douglas], I think [~sunilg] has already pointed out, the

[jira] [Updated] (YARN-8198) Add Security-Related HTTP Response Header in Yarn WEBUIs.

2018-04-23 Thread Kanwaljeet Sachdev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kanwaljeet Sachdev updated YARN-8198: - Attachment: YARN-8198.001.patch > Add Security-Related HTTP Response Header in Yarn

[jira] [Commented] (YARN-8200) Backport resource types/GPU features to branch-2

2018-04-23 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449284#comment-16449284 ] Sunil G commented on YARN-8200: --- Hi [~jhung] YARN-3926 has two parts of the work. Supporting multiple

[jira] [Commented] (YARN-7892) Revisit NodeAttribute class structure

2018-04-23 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449311#comment-16449311 ] genericqa commented on YARN-7892: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-04-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7939: Attachment: YARN-7939.009.patch > Yarn Service Upgrade: add support to upgrade a component instance

[jira] [Commented] (YARN-7939) Yarn Service Upgrade: add support to upgrade a component instance

2018-04-23 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16449328#comment-16449328 ] Chandni Singh commented on YARN-7939: - [~eyang] Uploaded patch 9 that handles the following: 1. Manage

[jira] [Commented] (YARN-8151) Yarn RM Epoch should wrap around

2018-04-23 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448633#comment-16448633 ] Íñigo Goiri commented on YARN-8151: --- For the comments, I'm referring to this: initialize epoch file with

[jira] [Commented] (YARN-8004) Add unit tests for inter queue preemption for dominant resource calculator

2018-04-23 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448646#comment-16448646 ] Zian Chen commented on YARN-8004: - Hi [~eepayne] , Please allow me to explain here a little bit. The tests

[jira] [Commented] (YARN-8004) Add unit tests for inter queue preemption for dominant resource calculator

2018-04-23 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16448652#comment-16448652 ] Zian Chen commented on YARN-8004: - Hi [~sunilg] , thanks for your comments, I think here is one thing I