[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067533#comment-16067533 ] Daniel Templeton commented on YARN-6743: Yep, [~lori.lob...@cloudera.com], this patch is fine.

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Lori Loberg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067531#comment-16067531 ] Lori Loberg commented on YARN-6743: --- Does that mean YARN-6743 is still okay? I read through the last half

[jira] [Updated] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6743: --- Affects Version/s: 2.9.0 > yarn.resourcemanager.zk-max-znode-size.bytes description needs

[jira] [Updated] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6743: --- Target Version/s: 2.9.0, 3.0.0-beta1 (was: 3.0.0-beta1) >

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067495#comment-16067495 ] Daniel Templeton commented on YARN-6743: Looks like the spaces are added in the branch-2 patch of

[jira] [Commented] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-06-28 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067471#comment-16067471 ] Ray Chiang commented on YARN-6150: -- I thought I had done this before, but the latest version of this patch

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067451#comment-16067451 ] Sunil G commented on YARN-6678: --- I think we might need to debug more here as I am still getting test error.

[jira] [Commented] (YARN-6280) Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

2017-06-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067442#comment-16067442 ] Hudson commented on YARN-6280: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11947 (See

[jira] [Commented] (YARN-5311) Document graceful decommission CLI and usage

2017-06-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067408#comment-16067408 ] Hudson commented on YARN-5311: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11946 (See

[jira] [Commented] (YARN-6280) Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067406#comment-16067406 ] Sunil G commented on YARN-6280: --- Committed to trunk. [~cltlfcjin], could you please help to share branch-2

[jira] [Updated] (YARN-6280) Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6280: -- Summary: Introduce deselect query param to skip ResourceRequest from getApp/getApps REST API (was: Add a query

[jira] [Commented] (YARN-6746) SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067373#comment-16067373 ] Sunil G commented on YARN-6746: --- Yes [~templedf]. Thanks for pointing out. We stopped using this after

[jira] [Assigned] (YARN-6746) SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code

2017-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton reassigned YARN-6746: -- Assignee: Deepti Sawhney (was: Daniel Templeton) >

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067360#comment-16067360 ] Sunil G commented on YARN-4161: --- I got your point. I was trying to point out to an existing configuration in

[jira] [Created] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-06-28 Thread Sunil G (JIRA)
Sunil G created YARN-6747: - Summary: TestFSAppStarvation.testPreemptionEnable fails intermittently Key: YARN-6747 URL: https://issues.apache.org/jira/browse/YARN-6747 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067322#comment-16067322 ] Hadoop QA commented on YARN-6678: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-06-28 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067299#comment-16067299 ] Wei Yan commented on YARN-4161: --- Thanks for the comments [~sunilg]. For the configuration names, I followed

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-06-28 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067273#comment-16067273 ] Jian He commented on YARN-6594: --- got a question, any reason we add one more level abstraction for

[jira] [Commented] (YARN-4161) Capacity Scheduler : Assign single or multiple containers per heart beat driven by configuration

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067270#comment-16067270 ] Sunil G commented on YARN-4161: --- Thanks [~ywskycn] for rebasing the patch. Few high level comments # Could

[jira] [Commented] (YARN-4589) Diagnostics for localization timeouts is lacking

2017-06-28 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067262#comment-16067262 ] Eric Badger commented on YARN-4589: --- It's on my list, but is a pretty low priority right now. I'm not

[jira] [Commented] (YARN-6629) NPE occurred when container allocation proposal is applied but its resource requests are removed before

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067251#comment-16067251 ] Sunil G commented on YARN-6629: --- Thanks for the detailed analysis [~Tao Yang]. Few questions: # Is this

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067231#comment-16067231 ] Hudson commented on YARN-6743: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11943 (See

[jira] [Created] (YARN-6746) SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code

2017-06-28 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-6746: -- Summary: SchedulerUtils.checkResourceRequestMatchingNodePartition() is dead code Key: YARN-6746 URL: https://issues.apache.org/jira/browse/YARN-6746 Project:

[jira] [Commented] (YARN-4589) Diagnostics for localization timeouts is lacking

2017-06-28 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067197#comment-16067197 ] Yufei Gu commented on YARN-4589: [~lichangleo] and [~ebadger], does anyone of you plan to work on this? >

[jira] [Commented] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-06-28 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067193#comment-16067193 ] Ray Chiang commented on YARN-6150: -- Unit test failure looks identical to YARN-5728. >

[jira] [Commented] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067186#comment-16067186 ] Sunil G commented on YARN-6714: --- Test case failures are unrelated. Also raised a ticket to handle FS test

[jira] [Commented] (YARN-6678) Committer thread crashes with IllegalStateException in async-scheduling mode of CapacityScheduler

2017-06-28 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067179#comment-16067179 ] Sunil G commented on YARN-6678: --- Kicked jenkins to see a clean a run again. > Committer thread crashes with

[jira] [Commented] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067170#comment-16067170 ] Hadoop QA commented on YARN-6150: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067155#comment-16067155 ] Daniel Templeton commented on YARN-6743: Latest patch LGTM. +1 >

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16067137#comment-16067137 ] Hadoop QA commented on YARN-6743: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2017-06-28 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066988#comment-16066988 ] Jonathan Hung commented on YARN-6492: - OK, sounds good. Looking forward to the patch! > Generate queue

[jira] [Assigned] (YARN-6492) Generate queue metrics for each partition

2017-06-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-6492: --- Assignee: Manikandan R (was: Naganarasimha G R) > Generate queue metrics for each

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066975#comment-16066975 ] Jason Lowe commented on YARN-6708: -- bq. Tried this approach earlier didnt work out since

[jira] [Updated] (YARN-6150) TestContainerManagerSecurity tests for Yarn Server are flakey

2017-06-28 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-6150: - Attachment: YARN-6150.007.patch Adding Akira's suggested change. > TestContainerManagerSecurity tests for

[jira] [Updated] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Lori Loberg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lori Loberg updated YARN-6743: -- Attachment: YARN-6743.002.patch replaced tabs with spaces >

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066922#comment-16066922 ] Hadoop QA commented on YARN-6743: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-28 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066845#comment-16066845 ] Bibin A Chundatt commented on YARN-6708: {quote} As far as the umask is concerned, you should be

[jira] [Updated] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Lori Loberg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lori Loberg updated YARN-6743: -- Attachment: YARN-6743.001.patch > yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces

[jira] [Commented] (YARN-6708) Nodemanager container crash after ext3 folder limit

2017-06-28 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066725#comment-16066725 ] Jason Lowe commented on YARN-6708: -- bq. If Node manager service and users are in different group should be

[jira] [Assigned] (YARN-6744) Recover component information on YARN native services AM restart

2017-06-28 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-6744: Assignee: (was: Billie Rinaldi) > Recover component information on YARN native services

[jira] [Commented] (YARN-6593) [API] Introduce Placement Constraint object

2017-06-28 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1601#comment-1601 ] Konstantinos Karanasos commented on YARN-6593: -- Hi [~wangda], I will be traveling starting

[jira] [Commented] (YARN-6720) Support updating FPGA related constraint node label after FPGA device re-configuration

2017-06-28 Thread Zhongyue Nah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066397#comment-16066397 ] Zhongyue Nah commented on YARN-6720: [~leftnoteasy] YARN-3409 Wouldn't be a blocker since this JIRA is

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-06-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066392#comment-16066392 ] Shane Kumpf edited comment on YARN-4266 at 6/28/17 12:16 PM: - Thanks for taking

[jira] [Comment Edited] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-06-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066392#comment-16066392 ] Shane Kumpf edited comment on YARN-4266 at 6/28/17 12:16 PM: - Thanks for taking

[jira] [Commented] (YARN-4266) Allow whitelisted users to disable user re-mapping/squashing when launching docker containers

2017-06-28 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066392#comment-16066392 ] Shane Kumpf commented on YARN-4266: --- Thanks for taking the time to answer my questions, [~ebadger]. I'm

[jira] [Created] (YARN-6745) Cannot parse correct Spark 2.x jars classpath in YARN on Windows

2017-06-28 Thread Yun Tang (JIRA)
Yun Tang created YARN-6745: -- Summary: Cannot parse correct Spark 2.x jars classpath in YARN on Windows Key: YARN-6745 URL: https://issues.apache.org/jira/browse/YARN-6745 Project: Hadoop YARN

[jira] [Commented] (YARN-6714) RM crashed with IllegalStateException while handling APP_ATTEMPT_REMOVED event when async-scheduling enabled in CapacityScheduler

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066312#comment-16066312 ] Hadoop QA commented on YARN-6714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6743) yarn.resourcemanager.zk-max-znode-size.bytes description needs spaces in yarn-default.xml

2017-06-28 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066184#comment-16066184 ] Naganarasimha G R commented on YARN-6743: - [~l...@cloudera.com], Its a simple fix, would you mind

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-28 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066063#comment-16066063 ] Hadoop QA commented on YARN-6467: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6742) Minor mistakes in "The YARN Service Registry" docs

2017-06-28 Thread Yeliang Cang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16066034#comment-16066034 ] Yeliang Cang commented on YARN-6742: [~ste...@apache.org], what is your opinion? Thank you! > Minor

[jira] [Commented] (YARN-6738) LevelDBCacheTimelineStore should reuse ObjectMapper instances

2017-06-28 Thread Zoltan Haindrich (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065963#comment-16065963 ] Zoltan Haindrich commented on YARN-6738: Thank you for adding me to the contributor list... and for