[jira] [Commented] (YARN-7015) Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers

2017-08-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127418#comment-16127418 ] Arun Suresh commented on YARN-7015: --- cc: [~kasha], [~haibochen], [~kkaranasos],

[jira] [Updated] (YARN-7015) Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers

2017-08-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7015: -- Description: YARN-5085 adds support for change of container execution type (Promotion/Demotion).

[jira] [Commented] (YARN-6882) AllocationFileLoaderService.reloadAllocations() should use the diamond operator

2017-08-15 Thread Larry Lo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127368#comment-16127368 ] Larry Lo commented on YARN-6882: Cool, really appreciate it. >

[jira] [Created] (YARN-7015) Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers

2017-08-15 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7015: - Summary: Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers Key: YARN-7015 URL: https://issues.apache.org/jira/browse/YARN-7015 Project:

[jira] [Updated] (YARN-7015) Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers

2017-08-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-7015: -- Description: YARN-5085 adds support for change of container execution type (Promotion/Demotion).

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-08-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127608#comment-16127608 ] Manikandan R commented on YARN-65: -- Fixed checkstyle issues. Test case failure is not related to this patch.

[jira] [Updated] (YARN-65) Reduce RM app memory footprint once app has completed

2017-08-15 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-65: - Attachment: YARN-65.009.patch > Reduce RM app memory footprint once app has completed >

[jira] [Commented] (YARN-6780) ResourceWeights.toString() cleanup

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127370#comment-16127370 ] Hadoop QA commented on YARN-6780: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7014) container-executor has off-by-one error which can corrupt the heap

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127387#comment-16127387 ] Hadoop QA commented on YARN-7014: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127493#comment-16127493 ] Eric Badger commented on YARN-6988: --- [~vvasudev], if we just increase the EXECUTOR_PATH_MAX then we would

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127494#comment-16127494 ] Eric Badger commented on YARN-6623: --- I'll review the patch sometime this week > Add support to turn off

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127660#comment-16127660 ] Hadoop QA commented on YARN-6781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6780) ResourceWeights.toString() cleanup

2017-08-15 Thread weiyuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127381#comment-16127381 ] weiyuan commented on YARN-6780: --- [~templedf], the patch is updated again, thanks for your reminder. >

[jira] [Assigned] (YARN-7015) Handle Container ExecType update (Promotion/Demotion) in cgroups resource handlers

2017-08-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reassigned YARN-7015: Assignee: Miklos Szegedi > Handle Container ExecType update (Promotion/Demotion) in cgroups

[jira] [Commented] (YARN-7014) container-executor has off-by-one error which can corrupt the heap

2017-08-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127528#comment-16127528 ] Eric Badger commented on YARN-7014: --- I'm +1 (non-binding) for the change. Because it's such a specific

[jira] [Updated] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Tang Lin updated YARN-6781: -- Attachment: YARN-6781.001.patch > ResourceUtils.initializeResourcesMap() takes an unnecessary Map

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127563#comment-16127563 ] Daniel Templeton commented on YARN-6781: LGTM. Let's see what Jenkins says. >

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127591#comment-16127591 ] Daniel Templeton commented on YARN-6781: Looks like you need to rebase. >

[jira] [Commented] (YARN-6739) Crash NM at start time if oversubscription is on but LinuxContainerExcutor or cgroup is off

2017-08-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127664#comment-16127664 ] Haibo Chen commented on YARN-6739: -- As a follow up, turn on cpu & memory cgroup and strict resource usage

[jira] [Commented] (YARN-5146) [YARN-3368] Supports Fair Scheduler in new YARN UI

2017-08-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127457#comment-16127457 ] Sunil G commented on YARN-5146: --- +1 committing shortly. > [YARN-3368] Supports Fair Scheduler in new YARN UI

[jira] [Updated] (YARN-5146) Support for Fair Scheduler in new YARN UI

2017-08-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-5146: -- Summary: Support for Fair Scheduler in new YARN UI (was: [YARN-3368] Supports Fair Scheduler in new YARN UI) >

[jira] [Updated] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Tang Lin updated YARN-6781: -- Attachment: YARN-6781-YARN-3926.002.patch > ResourceUtils.initializeResourcesMap() takes an unnecessary

[jira] [Commented] (YARN-6996) Change javax.cache library implementation from JSR107 to Apache Geronimo

2017-08-15 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127671#comment-16127671 ] Ray Chiang commented on YARN-6996: -- Thanks [~subru] and [~busbey]! > Change javax.cache library

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127433#comment-16127433 ] Yu-Tang Lin commented on YARN-6781: --- Hi Daniel, thanks for submit this issue. I would like to take this

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127436#comment-16127436 ] Hadoop QA commented on YARN-6959: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7014) container-executor has off-by-one error which can corrupt the heap

2017-08-15 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127522#comment-16127522 ] Shane Kumpf commented on YARN-7014: --- Thanks for identifying the issue and the patch [~jlowe]. I have

[jira] [Commented] (YARN-6623) Add support to turn off launching privileged containers in the container-executor

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127536#comment-16127536 ] Hadoop QA commented on YARN-6623: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127568#comment-16127568 ] Hadoop QA commented on YARN-6781: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127673#comment-16127673 ] Vrushali C commented on YARN-6820: -- Okay, so the branch-2 branch name is " YARN-5355_branch2 " . Here

[jira] [Assigned] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Yu-Tang Lin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yu-Tang Lin reassigned YARN-6781: - Assignee: Yu-Tang Lin > ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127533#comment-16127533 ] Daniel Templeton commented on YARN-6610: I would expect a small performance dip, because the code

[jira] [Commented] (YARN-5146) Support for Fair Scheduler in new YARN UI

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127526#comment-16127526 ] Hudson commented on YARN-5146: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12190 (See

[jira] [Updated] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6964: --- Attachment: YARN-6964.006.patch Per offline discussion, 1, 2.1, 3, and 4 are fine. Attaching

[jira] [Created] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread sarun (JIRA)
sarun created YARN-7017: --- Summary: Enable preemption for a single queue. Key: YARN-7017 URL: https://issues.apache.org/jira/browse/YARN-7017 Project: Hadoop YARN Issue Type: New Feature

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127790#comment-16127790 ] Hadoop QA commented on YARN-6964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7014) container-executor has off-by-one error which can corrupt the heap

2017-08-15 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nathan Roberts updated YARN-7014: - Fix Version/s: 3.0.0-beta1 > container-executor has off-by-one error which can corrupt the heap >

[jira] [Commented] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127883#comment-16127883 ] Vrushali C commented on YARN-6820: -- Thanks [~jlowe] , appreciate it. > Restrict read access to

[jira] [Updated] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-15 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-6988: -- Attachment: YARN-6988.001.patch Attaching a patch to increase the size of the docker commands to 128 KB.

[jira] [Comment Edited] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127996#comment-16127996 ] Arun Suresh edited comment on YARN-7019 at 8/15/17 10:43 PM: - [~jlowe], given

[jira] [Created] (YARN-7020) TestAMRMProxy#testAMRMProxyTokenRenewal is flakey

2017-08-15 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-7020: --- Summary: TestAMRMProxy#testAMRMProxyTokenRenewal is flakey Key: YARN-7020 URL: https://issues.apache.org/jira/browse/YARN-7020 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-15 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127696#comment-16127696 ] Jian He commented on YARN-6959: --- [~yqwang], TestFairScheduler is failing with the patch , can you take a look

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6589: - Issue Type: Sub-task (was: Bug) Parent: YARN-3926 > Recover all resources when NM restart >

[jira] [Created] (YARN-7016) Consider using ZKCuratorManager in CuratorService

2017-08-15 Thread JIRA
Íñigo Goiri created YARN-7016: - Summary: Consider using ZKCuratorManager in CuratorService Key: YARN-7016 URL: https://issues.apache.org/jira/browse/YARN-7016 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-6992) "Kill application" button is present even if the application is FINISHED in RM UI

2017-08-15 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6992: --- Description: Kill button should not be displayed for FAILED, KILLED and FINISHED apps > "Kill

[jira] [Created] (YARN-7018) Interface for adding extra behavior to node heartbeats

2017-08-15 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7018: Summary: Interface for adding extra behavior to node heartbeats Key: YARN-7018 URL: https://issues.apache.org/jira/browse/YARN-7018 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7014) container-executor has off-by-one error which can corrupt the heap

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127889#comment-16127889 ] Hudson commented on YARN-7014: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12191 (See

[jira] [Commented] (YARN-6257) CapacityScheduler REST API produces incorrect JSON - JSON object operationsInfo contains deplicate key

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127958#comment-16127958 ] Wangda Tan commented on YARN-6257: -- [~Tao Yang], Thanks for explanation, I just checked

[jira] [Updated] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread sarun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sarun updated YARN-7017: Priority: Major (was: Critical) > Enable preemption for a single queue. > - > >

[jira] [Updated] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread sarun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sarun updated YARN-7017: Priority: Critical (was: Major) > Enable preemption for a single queue. > - > >

[jira] [Updated] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7017: --- Component/s: capacity scheduler > Enable preemption for a single queue. >

[jira] [Commented] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127774#comment-16127774 ] Eric Payne commented on YARN-7017: -- Thanks [~saruntek] for raising this issue. {quote} As of today the

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-15 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6820: - Fix Version/s: YARN-5355-branch-2 Thanks, Vrushali! I committed the branch-2 patch to YARN-5355_branch2.

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127978#comment-16127978 ] Daniel Templeton commented on YARN-6610: My previous comment about performance was assuming that

[jira] [Commented] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127996#comment-16127996 ] Arun Suresh commented on YARN-7019: --- [~jlowe], given that Container reuse, espescially Tez's

[jira] [Commented] (YARN-65) Reduce RM app memory footprint once app has completed

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-65?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127700#comment-16127700 ] Hadoop QA commented on YARN-65: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime

[jira] [Comment Edited] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127774#comment-16127774 ] Eric Payne edited comment on YARN-7017 at 8/15/17 7:56 PM: --- Thanks [~saruntek]

[jira] [Commented] (YARN-7014) container-executor has off-by-one error which can corrupt the heap

2017-08-15 Thread Nathan Roberts (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127824#comment-16127824 ] Nathan Roberts commented on YARN-7014: -- +1 on the patch. I will commit shortly. Thanks [~jlowe] for

[jira] [Created] (YARN-7019) Ability for applications to notify YARN about container reuse

2017-08-15 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7019: Summary: Ability for applications to notify YARN about container reuse Key: YARN-7019 URL: https://issues.apache.org/jira/browse/YARN-7019 Project: Hadoop YARN

[jira] [Updated] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-15 Thread Aaron Gresch (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron Gresch updated YARN-6736: --- Attachment: YARN-6736-YARN-5355.002.patch > Consider writing to both ats v1 & v2 from RM for smoother

[jira] [Updated] (YARN-6992) "Kill application" button is present even if the application is FINISHED in RM UI

2017-08-15 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6992: --- Attachment: YARN-6992.001.patch > "Kill application" button is present even if the application

[jira] [Updated] (YARN-6992) "Kill application" button is present even if the application is FINISHED in RM UI

2017-08-15 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-6992: --- Description: Kill button should not be displayed for FAILED, KILLED and FINISHED apps in

[jira] [Commented] (YARN-6736) Consider writing to both ats v1 & v2 from RM for smoother upgrades

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127919#comment-16127919 ] Hadoop QA commented on YARN-6736: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6892) Improve API implementation in Resources and DominantResourceCalculator in align to ResourceInformation

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6892: - Attachment: YARN-6892-YARN-3926.004.patch Fixed findbugs warning in the .004 patch. > Improve API

[jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127949#comment-16127949 ] Hadoop QA commented on YARN-6988: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6610: --- Attachment: YARN-6610.YARN-3926.006.patch Added unit tests and fixed an error. >

[jira] [Commented] (YARN-6589) Recover all resources when NM restart

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127712#comment-16127712 ] Wangda Tan commented on YARN-6589: -- Thanks [~fly_in_gis] for reporting and working on this JIRA.

[jira] [Updated] (YARN-6589) Recover all resources when NM restart

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6589: - Priority: Blocker (was: Major) > Recover all resources when NM restart >

[jira] [Updated] (YARN-7017) Enable preemption for a single queue.

2017-08-15 Thread sarun (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sarun updated YARN-7017: Description: *PROBLEM* How to enable preemption on a single queue in a cluster? *DESCRIPTION* As of today the only

[jira] [Commented] (YARN-6992) "Kill application" button is present even if the application is FINISHED in RM UI

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16127982#comment-16127982 ] Hadoop QA commented on YARN-6992: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-15 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuqi Wang updated YARN-6959: Attachment: YARN-6959-branch-2.7.003.patch > RM may allocate wrong AM Container for new attempt >

[jira] [Commented] (YARN-6959) RM may allocate wrong AM Container for new attempt

2017-08-15 Thread Yuqi Wang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128348#comment-16128348 ] Yuqi Wang commented on YARN-6959: - [~jianhe] I updated the new patch for 2.7, do you know how to trigger

[jira] [Updated] (YARN-6376) Exceptions caused by synchronous putEntities requests can be swallowed

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6376: - Labels: atsv2-hbase yarn-5355-merge-blocker (was: yarn-5355-merge-blocker) > Exceptions caused by

[jira] [Created] (YARN-7021) TestResourceUtils to be moved to yarn-common

2017-08-15 Thread Sunil G (JIRA)
Sunil G created YARN-7021: - Summary: TestResourceUtils to be moved to yarn-common Key: YARN-7021 URL: https://issues.apache.org/jira/browse/YARN-7021 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Comment Edited] (YARN-7011) yarn-daemon.sh is not respecting --config option

2017-08-15 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128024#comment-16128024 ] Sumana Sathish edited comment on YARN-7011 at 8/15/17 11:08 PM: Hi [~aw],

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128055#comment-16128055 ] Wangda Tan commented on YARN-5764: -- [~devaraj.k], Thanks for updating the patch, I checked the latest

[jira] [Commented] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-15 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128068#comment-16128068 ] Wangda Tan commented on YARN-6610: -- [~templedf], bq. My previous comment about performance was assuming

[jira] [Updated] (YARN-6610) DominantResourceCalculator.getResourceAsValue() dominant param is no longer appropriate

2017-08-15 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6610: --- Attachment: YARN-6610.YARN-3926.perf.patch Here's a patch that adds a special case for # res

[jira] [Commented] (YARN-7020) TestAMRMProxy#testAMRMProxyTokenRenewal is flakey

2017-08-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128120#comment-16128120 ] Hadoop QA commented on YARN-7020: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-08-15 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-6900: -- Attachment: YARN-6900-011.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6741) Deleting all children of a Parent Queue on refresh throws exception

2017-08-15 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-6741: Attachment: YARN-6745-branch-2.005.patch Thanks [~bibinchundatt], Have uploaded a patch for

[jira] [Updated] (YARN-3053) [Security] Review and implement authentication in ATS v.2

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3053: - Fix Version/s: YARN-5355 > [Security] Review and implement authentication in ATS v.2 >

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6047: - Fix Version/s: YARN-5355 > Documentation updates for TimelineService v2 >

[jira] [Commented] (YARN-6988) container-executor fails for docker when command length > 4096 B

2017-08-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128325#comment-16128325 ] Varun Vasudev commented on YARN-6988: - Sounds good [~ebadger]. > container-executor fails for docker

[jira] [Updated] (YARN-3649) Allow configurable prefix for hbase table names (like prod, exp, test etc)

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-3649: - Labels: YARN-5355 atsv2-hbase (was: YARN-5355) > Allow configurable prefix for hbase table names (like

[jira] [Updated] (YARN-5229) Refactor #isApplicationEntity and #getApplicationEvent from HBaseTimelineWriterImpl

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5229: - Labels: YARN-5355 atsv2-hbase (was: YARN-5355) > Refactor #isApplicationEntity and #getApplicationEvent

[jira] [Updated] (YARN-7021) TestResourceUtils to be moved to hadoop-yarn-api package

2017-08-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7021: -- Summary: TestResourceUtils to be moved to hadoop-yarn-api package (was: TestResourceUtils to be moved to

[jira] [Commented] (YARN-6965) Duplicate instantiation in FairSchedulerQueueInfo

2017-08-15 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128323#comment-16128323 ] Akira Ajisaka commented on YARN-6965: - +1, checking this in. > Duplicate instantiation in

[jira] [Updated] (YARN-6979) Add flag to allow all container updates to be initiated via NodeHeartbeatResponse

2017-08-15 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6979: -- Description: Currently, only the Container Resource increase command is sent to the NM via

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128350#comment-16128350 ] Sunil G commented on YARN-6781: --- Jenkins came clean. Looks fine to me as well. Committing the same as post

[jira] [Updated] (YARN-6820) Restrict read access to timelineservice v2 data

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6820: - Component/s: (was: timelineserver) timelinereader > Restrict read access to

[jira] [Commented] (YARN-6781) ResourceUtils.initializeResourcesMap() takes an unnecessary Map parameter

2017-08-15 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128362#comment-16128362 ] Sunil G commented on YARN-6781: --- Sorry. During commit, I tried to compile whole hadoop and found compilation

[jira] [Updated] (YARN-6733) Add table for storing sub-application entities

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6733: - Labels: atsv2-subapp (was: ) > Add table for storing sub-application entities >

[jira] [Updated] (YARN-6094) Update the coprocessor to be a dynamically loaded one

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6094: - Labels: atsv2-hbase yarn-5355-merge-blocker (was: yarn-5355-merge-blocker) > Update the coprocessor to be

[jira] [Updated] (YARN-6316) Provide help information and documentation for TimelineSchemaCreator

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6316: - Labels: atsv2-hbase (was: ) > Provide help information and documentation for TimelineSchemaCreator >

[jira] [Updated] (YARN-6253) FlowAcitivityColumnPrefix.store(byte[] rowKey, ...) drops timestamp

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6253: - Labels: atsv2-hbase yarn-5355-merge-blocker (was: yarn-5355-merge-blocker) >

[jira] [Updated] (YARN-5980) Update documentation for single node hbase deploy

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5980: - Labels: atsv2-hbase yarn-5355-merge-blocker (was: yarn-5355-merge-blocker) > Update documentation for

[jira] [Commented] (YARN-6804) Allow custom hostname for docker containers in native services

2017-08-15 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128329#comment-16128329 ] Varun Vasudev commented on YARN-6804: - [~jianhe] - can you backport the NM pieces to branch-2 and

[jira] [Updated] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5928: - Labels: atsv2-hbase (was: ) > Move ATSv2 HBase backend code into a new module that is only dependent at

[jira] [Commented] (YARN-6965) Duplicate instantiation in FairSchedulerQueueInfo

2017-08-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16128343#comment-16128343 ] Hudson commented on YARN-6965: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12195 (See

[jira] [Updated] (YARN-6707) [ATSv2] Update HBase version to 1.2.6

2017-08-15 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-6707: - Labels: atsv2-hbase (was: ) > [ATSv2] Update HBase version to 1.2.6 >

  1   2   >