[jira] [Commented] (YARN-6102) On failover RM can crash due to unregistered event to AsyncDispatcher

2017-07-05 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075932#comment-16075932 ] Rohith Sharma K S commented on YARN-6102: - thanks [~ajithshetty] and [~Naganarasimha] for

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2017-07-05 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075901#comment-16075901 ] Jian He commented on YARN-2919: --- got a question, [~Naganarasimha], could you elaborate what the race

[jira] [Commented] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

2017-07-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075807#comment-16075807 ] Hadoop QA commented on YARN-6355: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-07-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075782#comment-16075782 ] Hadoop QA commented on YARN-6742: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-07-05 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yeliang Cang updated YARN-6742: --- Attachment: YARN-6742-003.patch > Minor mistakes in "The YARN Service Registry" docs >

[jira] [Commented] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-07-05 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075753#comment-16075753 ] Yeliang Cang commented on YARN-6742: Yes, I think you are right! Thanks, [~shaneku...@gmail.com], and I

[jira] [Updated] (YARN-6355) Preprocessor framework for AM and Client interactions with the RM

2017-07-05 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-6355: -- Attachment: YARN-6355.003.patch Updated patch based on suggestions from [~subru] > Preprocessor

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075708#comment-16075708 ] Yufei Gu commented on YARN-6757: Thanks [~templedf]'s review. I will take this as the offline discussion

[jira] [Commented] (YARN-6764) Simplify the logic in FairScheduler#attemptScheduling

2017-07-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075550#comment-16075550 ] Hadoop QA commented on YARN-6764: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2919) Potential race between renew and cancel in DelegationTokenRenwer

2017-07-05 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2919?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075512#comment-16075512 ] Junping Du commented on YARN-2919: -- Latest patch LGTM. +1. Will commit it tomorrow if no further comments

[jira] [Created] (YARN-6765) CGroupsHandlerImpl.initializeControllerPaths() should include cause when chaining exceptions

2017-07-05 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6765: -- Summary: CGroupsHandlerImpl.initializeControllerPaths() should include cause when chaining exceptions Key: YARN-6765 URL: https://issues.apache.org/jira/browse/YARN-6765

[jira] [Commented] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075459#comment-16075459 ] Daniel Templeton commented on YARN-6757: Thanks for the patch, [~miklos.szeg...@cloudera.com]. A

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-07-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075457#comment-16075457 ] Jason Lowe commented on YARN-6708: -- Thanks for updating the patch! We're almost there, just some cleanup

[jira] [Commented] (YARN-6720) Support updating FPGA related constraint node label after FPGA device re-configuration

2017-07-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075443#comment-16075443 ] Wangda Tan commented on YARN-6720: -- [~tangzhankun]/[~zyluo], bq. YARN-3409 Wouldn't be a blocker since

[jira] [Commented] (YARN-6752) Display reserved resources in web UI per application

2017-07-05 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075438#comment-16075438 ] Abdullah Yousufi commented on YARN-6752: Definitely, perhaps we could combine the vcores and memory

[jira] [Updated] (YARN-6726) Fix issues with docker commands executed by container-executor

2017-07-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6726: -- Summary: Fix issues with docker commands executed by container-executor (was: Fix issues with docker

[jira] [Updated] (YARN-6726) Fix issues with docker commands in container-executor

2017-07-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-6726: -- Summary: Fix issues with docker commands in container-executor (was: Support additional docker commands

[jira] [Commented] (YARN-6752) Display reserved resources in web UI per application

2017-07-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075420#comment-16075420 ] Daniel Templeton commented on YARN-6752: Thanks. Latest patch looks good. I just tested the patch

[jira] [Commented] (YARN-6761) Fix build for YARN-3926 branch

2017-07-05 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075418#comment-16075418 ] Wangda Tan commented on YARN-6761: -- Thanks Varun for the patch, I think we should keep the

[jira] [Updated] (YARN-6752) Display reserved resources in web UI per application

2017-07-05 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-6752: --- Attachment: YARN-6752.003.patch > Display reserved resources in web UI per application >

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6757: --- Description: We should add the ability to specify a custom cgroup path. This is how the

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075317#comment-16075317 ] Eric Payne commented on YARN-2113: -- The TestRMRestart test failure looks like it's the same as YARN-6759.

[jira] [Updated] (YARN-6757) Refactor the usage of yarn.nodemanager.linux-container-executor.cgroups.mount-path

2017-07-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6757: --- Description: We should add the ability to specify a custom cgroup path. This is how the

[jira] [Commented] (YARN-6752) Display reserved resources in web UI per application

2017-07-05 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075299#comment-16075299 ] Daniel Templeton commented on YARN-6752: Thanks for the patch, [~ayousufi]. Looks like you have

[jira] [Commented] (YARN-6759) TestRMRestart.testRMRestartWaitForPreviousAMToFinish is failing in trunk

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075279#comment-16075279 ] Eric Payne commented on YARN-6759: -- Please note that this is not just failing in trunk. It fails for me in

[jira] [Updated] (YARN-6764) Simplify the logic in FairScheduler#attemptScheduling

2017-07-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6764: --- Attachment: YARN-6764.001.patch > Simplify the logic in FairScheduler#attemptScheduling >

[jira] [Updated] (YARN-6764) Simplify the logic in FairScheduler#attemptScheduling

2017-07-05 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-6764: --- Priority: Trivial (was: Major) > Simplify the logic in FairScheduler#attemptScheduling >

[jira] [Created] (YARN-6764) Simplify the logic in FairScheduler#attemptScheduling

2017-07-05 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-6764: -- Summary: Simplify the logic in FairScheduler#attemptScheduling Key: YARN-6764 URL: https://issues.apache.org/jira/browse/YARN-6764 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-07-05 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075202#comment-16075202 ] Jason Lowe commented on YARN-6708: -- Sorry for the delay, was out of the office for a bit. Please hold off

[jira] [Commented] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-07-05 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16075104#comment-16075104 ] Shane Kumpf commented on YARN-6742: --- Thanks for taking the time to review the entire document, [~Cyl]!

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074977#comment-16074977 ] Hadoop QA commented on YARN-2113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074780#comment-16074780 ] Sunil G commented on YARN-2113: --- Hi [~eepayne] I think branch-2.8 patch is fine. I guess i made a mistake

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: YARN-2113.branch-2.0020.patch > Add cross-user preemption within CapacityScheduler's

[jira] [Updated] (YARN-2113) Add cross-user preemption within CapacityScheduler's leaf-queue

2017-07-05 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-2113: - Attachment: (was: YARN-2113.branch-2.0020.patch) > Add cross-user preemption within

[jira] [Created] (YARN-6763) TestProcfsBasedProcessTree#testProcessTree fails in trunk

2017-07-05 Thread Bibin A Chundatt (JIRA)
Bibin A Chundatt created YARN-6763: -- Summary: TestProcfsBasedProcessTree#testProcessTree fails in trunk Key: YARN-6763 URL: https://issues.apache.org/jira/browse/YARN-6763 Project: Hadoop YARN

[jira] [Commented] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-07-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074561#comment-16074561 ] Bibin A Chundatt commented on YARN-6727: Thank you [~sunilg] for explanation {quote} Is safer for

[jira] [Comment Edited] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-07-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074561#comment-16074561 ] Bibin A Chundatt edited comment on YARN-6727 at 7/5/17 10:40 AM: - Thank you

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-07-05 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074546#comment-16074546 ] Naganarasimha G R commented on YARN-6708: - [~jlowe], Findbugs is not related to the patch and is

[jira] [Commented] (YARN-6727) Improve getQueueUserAcls API to query for specific queue and user

2017-07-05 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074516#comment-16074516 ] Sunil G commented on YARN-6727: --- I guess I ll put my thoughts more clearer for better clarity in terms of

[jira] [Commented] (YARN-6759) TestRMRestart.testRMRestartWaitForPreviousAMToFinish is failing in trunk

2017-07-05 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074502#comment-16074502 ] Bibin A Chundatt commented on YARN-6759: {code} public static void waitFor(Supplier check, int

[jira] [Commented] (YARN-6759) TestRMRestart.testRMRestartWaitForPreviousAMToFinish is failing in trunk

2017-07-05 Thread Feng Yuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074448#comment-16074448 ] Feng Yuan commented on YARN-6759: - final int maxRetry = 10; final RMApp rmAppForCheck = rmApp;