[jira] [Commented] (YARN-9847) ZKRMStateStore will cause zk connection loss when writing huge data into znode

2019-09-23 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/YARN-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936353#comment-16936353 ] Wang, Xinglong commented on YARN-9847: -- [~tangzhankun]

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936346#comment-16936346 ] Hadoop QA commented on YARN-9730: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9847) ZKRMStateStore will cause zk connection loss when writing huge data into znode

2019-09-23 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936333#comment-16936333 ] Zhankun Tang commented on YARN-9847: [~suxingfate], thanks for the clarification! Is this duplicated

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936329#comment-16936329 ] Zhankun Tang commented on YARN-9011: [~pbacsko], Thanks for the elaboration. Not sure if I understand

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2019-09-23 Thread qiuliang (Jira)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936320#comment-16936320 ] qiuliang commented on YARN-7599: Hello [~botong], Thank you every much, the patch is helpful to us. Now, I

[jira] [Commented] (YARN-9736) Recursively configure app ordering policies

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936316#comment-16936316 ] Jonathan Hung commented on YARN-9736: - Attach 001 patch which inherits app ordering policy and its

[jira] [Updated] (YARN-9736) Recursively configure app ordering policies

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9736: Attachment: YARN-9736.001.patch > Recursively configure app ordering policies >

[jira] [Assigned] (YARN-9736) Recursively configure app ordering policies

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-9736: --- Assignee: Jonathan Hung > Recursively configure app ordering policies >

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936266#comment-16936266 ] Jonathan Hung commented on YARN-9730: - Thanks Haibo. Uploaded 003 patch which is 002, but rebased on

[jira] [Updated] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9730: Attachment: YARN-9730.003.patch > Support forcing configured partitions to be exclusive based on

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-09-23 Thread Haibo Chen (Jira)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936262#comment-16936262 ] Haibo Chen commented on YARN-9730: -- I see. Thanks for the clarification, [~jhung]. There are some minor

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936190#comment-16936190 ] Hadoop QA commented on YARN-9762: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936159#comment-16936159 ] Hudson commented on YARN-9762: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17359 (See

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936158#comment-16936158 ] Jonathan Hung commented on YARN-9762: - Committed to trunk/branch-3.2/branch-3.1/branch-2. Thanks

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16936120#comment-16936120 ] Jonathan Hung commented on YARN-9762: - Thanks [~mkumar1984], in general it looks fine, I uploaded 03

[jira] [Updated] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9762: Attachment: YARN-9762.03.patch > Add submission context label to audit logs >

[jira] [Commented] (YARN-9851) Make execution type check compatiable

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935989#comment-16935989 ] Hadoop QA commented on YARN-9851: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-09-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935893#comment-16935893 ] Szilard Nemeth commented on YARN-8199: -- Hi [~rohithsharma]! I indeed missed to include the YARN-id in

[jira] [Commented] (YARN-9717) Add more logging to container-executor about issues with directory creation or permissions

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935885#comment-16935885 ] Peter Bacsko commented on YARN-9717: As discussed with [~snemeth], the problem that we faced had

[jira] [Resolved] (YARN-9717) Add more logging to container-executor about issues with directory creation or permissions

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko resolved YARN-9717. Resolution: Won't Fix > Add more logging to container-executor about issues with directory creation

[jira] [Commented] (YARN-9511) [JDK11] TestAuxServices#testRemoteAuxServiceClassPath YarnRuntimeException: The remote jarfile should not be writable by group or others. The current Permission is 436

2019-09-23 Thread Szilard Nemeth (Jira)
[ https://issues.apache.org/jira/browse/YARN-9511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935882#comment-16935882 ] Szilard Nemeth commented on YARN-9511: -- Hi [~seanlau] / [~adam.antal]! You can take this over if you

[jira] [Commented] (YARN-9847) ZKRMStateStore will cause zk connection loss when writing huge data into znode

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935880#comment-16935880 ] Hadoop QA commented on YARN-9847: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9552) FairScheduler: NODE_UPDATE can cause NoSuchElementException

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935862#comment-16935862 ] Peter Bacsko commented on YARN-9552: [~giovanni.fumarola] [~sunilg] could you guys review & commit the

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935844#comment-16935844 ] Peter Bacsko commented on YARN-9840: One more thing - this enhancement should be documented. Please

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935837#comment-16935837 ] Hadoop QA commented on YARN-9840: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935821#comment-16935821 ] Hadoop QA commented on YARN-9762: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9851) Make execution type check compatiable

2019-09-23 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9851: --- Attachment: YARN-9851-001.patch > Make execution type check compatiable >

[jira] [Commented] (YARN-9537) Add configuration to disable AM preemption

2019-09-23 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935811#comment-16935811 ] zhoukang commented on YARN-9537: [~yufeigu] could you help retest this patch? > Add configuration to

[jira] [Assigned] (YARN-9851) Make execution type check compatiable

2019-09-23 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang reassigned YARN-9851: -- Assignee: zhoukang > Make execution type check compatiable > - > >

[jira] [Updated] (YARN-9851) Make execution type check compatiable

2019-09-23 Thread zhoukang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9851: --- Affects Version/s: 3.1.2 > Make execution type check compatiable > - > >

[jira] [Created] (YARN-9851) Make execution type check compatiable

2019-09-23 Thread zhoukang (Jira)
zhoukang created YARN-9851: -- Summary: Make execution type check compatiable Key: YARN-9851 URL: https://issues.apache.org/jira/browse/YARN-9851 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-9840) Capacity scheduler: add support for Secondary Group rule mapping

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935757#comment-16935757 ] Peter Bacsko commented on YARN-9840: Thanks for the patch [~maniraj...@gmail.com]. I triggered a

[jira] [Commented] (YARN-9847) ZKRMStateStore will cause zk connection loss when writing huge data into znode

2019-09-23 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/YARN-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935747#comment-16935747 ] Wang, Xinglong commented on YARN-9847: -- I see https://issues.apache.org/jira/browse/YARN-5006

[jira] [Commented] (YARN-9847) ZKRMStateStore will cause zk connection loss when writing huge data into znode

2019-09-23 Thread Wang, Xinglong (Jira)
[ https://issues.apache.org/jira/browse/YARN-9847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935745#comment-16935745 ] Wang, Xinglong commented on YARN-9847: -- [~tangzhankun] It will only truncate the diagnostic string to

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935731#comment-16935731 ] Peter Bacsko edited comment on YARN-9011 at 9/23/19 10:38 AM: -- [~adam.antal]

[jira] [Comment Edited] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935731#comment-16935731 ] Peter Bacsko edited comment on YARN-9011 at 9/23/19 10:38 AM: -- [~adam.antal]

[jira] [Commented] (YARN-9011) Race condition during decommissioning

2019-09-23 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935731#comment-16935731 ] Peter Bacsko commented on YARN-9011: [~adam.antal] so the problem is that {{ResourceTrackerService}}

[jira] [Updated] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Manoj Kumar (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Kumar updated YARN-9762: -- Attachment: (was: YARN-9762.02.patch) > Add submission context label to audit logs >

[jira] [Commented] (YARN-9762) Add submission context label to audit logs

2019-09-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935696#comment-16935696 ] Hadoop QA commented on YARN-9762: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-9627) DelegationTokenRenewer could block transitionToStandy

2019-09-23 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935581#comment-16935581 ] Bibin A Chundatt edited comment on YARN-9627 at 9/23/19 8:47 AM: -

[jira] [Commented] (YARN-9627) DelegationTokenRenewer could block transitionToStandy

2019-09-23 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16935581#comment-16935581 ] Bibin A Chundatt commented on YARN-9627: [~maniraj...@gmail.com] This issue is more like what do