[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218151#comment-16218151 ] Hudson commented on YARN-7389: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13132 (See

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-10-24 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218149#comment-16218149 ] Sunil G commented on YARN-6953: --- +1. Committing later today if there are no objections. > Clean up

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-24 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218118#comment-16218118 ] Varun Saxena commented on YARN-7190: bq. I am wondering why the commit was not propagated from trunk

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218108#comment-16218108 ] Haibo Chen commented on YARN-7389: -- TestFSAppStarvation.testPreemptionEnabled is tracked at YARN-6747. +1

[jira] [Updated] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7289: Attachment: YARN-7289.004.patch > Application lifetime does not work with FairScheduler >

[jira] [Commented] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218094#comment-16218094 ] Rohith Sharma K S commented on YARN-7289: - I just realized that if there are any other schedulers

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218085#comment-16218085 ] Hadoop QA commented on YARN-7386: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7289) Application lifetime does not work with FairScheduler

2017-10-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7289: Summary: Application lifetime does not work with FairScheduler (was:

[jira] [Commented] (YARN-7376) YARN top ACLs

2017-10-24 Thread Varun Vasudev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218080#comment-16218080 ] Varun Vasudev commented on YARN-7376: - [~jhung] -- this is implemented on the client side. The user can

[jira] [Updated] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4827: --- Attachment: YARN-4827.003.patch Thanks [~subru] for the review. Uploaded patch v3 for your comments. >

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-24 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218052#comment-16218052 ] Manikandan R commented on YARN-7159: [~leftnoteasy] Thanks for your review. {quote}I agree with what

[jira] [Commented] (YARN-7276) Federation Router Web Service fixes

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218039#comment-16218039 ] Hadoop QA commented on YARN-7276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-24 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218017#comment-16218017 ] Misha Dmitriev commented on YARN-7320: -- [~wangda] I confirm the problem. Sorry about this. It is

[jira] [Commented] (YARN-7171) RM UI should sort memory / cores numerically

2017-10-24 Thread wangchengwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16218018#comment-16218018 ] wangchengwei commented on YARN-7171: This is a bug cause by

[jira] [Reopened] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S reopened YARN-7190: - bq. I am wondering why the commit was not propagated from trunk but instead done directly in

[jira] [Reopened] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reopened YARN-7320: -- > Duplicate LiteralByteStrings in > SystemCredentialsForAppsProto.credentialsForApp_ >

[jira] [Commented] (YARN-7320) Duplicate LiteralByteStrings in SystemCredentialsForAppsProto.credentialsForApp_

2017-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217976#comment-16217976 ] Wangda Tan commented on YARN-7320: -- [~rkanter], [~mi...@cloudera.com], It looks like this patch breaks

[jira] [Updated] (YARN-7224) Support GPU isolation for docker container

2017-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7224: - Attachment: YARN-7224.007.patch Attached ver.7 patch, fixed warnings / javadocs, UT failure is not

[jira] [Commented] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217963#comment-16217963 ] Hadoop QA commented on YARN-4827: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-10-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217958#comment-16217958 ] Subru Krishnan commented on YARN-7190: -- [~varun_saxena]/[~vrushalic] (cc [~jlowe]/[~rohithsharma]),

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276.008.patch > Federation Router Web Service fixes >

[jira] [Commented] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-10-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217950#comment-16217950 ] Subru Krishnan commented on YARN-4827: -- Thanks [~yufeigu] for the patch. It looks good, have a couple

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217947#comment-16217947 ] Hadoop QA commented on YARN-7390: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-10-24 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated YARN-7386: - Attachment: YARN-7386.02.patch > Duplicate Strings in various places in Yarn memory >

[jira] [Commented] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217940#comment-16217940 ] Hadoop QA commented on YARN-7389: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7276) Federation Router Web Service fixes

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217939#comment-16217939 ] Hadoop QA commented on YARN-7276: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-10-24 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217934#comment-16217934 ] Misha Dmitriev commented on YARN-7386: -- At least some test failures are real, and happen because

[jira] [Commented] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217916#comment-16217916 ] Hadoop QA commented on YARN-7386: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217906#comment-16217906 ] Hadoop QA commented on YARN-7326: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4827: --- Attachment: YARN-4827.002.patch Patch v2 to fix white space issue. > Document configuration of

[jira] [Updated] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-10-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-6124: - Attachment: YARN-6124.wip.2.patch Uploaded wip (wip.2) patch to get early feedbacks, will add more UTs and

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217874#comment-16217874 ] Haibo Chen commented on YARN-7388: -- There was no unit test failure even though it return -1. I think it is

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217873#comment-16217873 ] Hadoop QA commented on YARN-6394: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217870#comment-16217870 ] Hadoop QA commented on YARN-4827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7224) Support GPU isolation for docker container

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217868#comment-16217868 ] Hadoop QA commented on YARN-7224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217867#comment-16217867 ] Hadoop QA commented on YARN-7388: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217866#comment-16217866 ] Hadoop QA commented on YARN-7358: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217854#comment-16217854 ] Eric Yang edited comment on YARN-7197 at 10/24/17 11:17 PM: [~ebadger] You are

[jira] [Commented] (YARN-7102) NM heartbeat stuck when responseId overflows MAX_INT

2017-10-24 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217861#comment-16217861 ] Botong Huang commented on YARN-7102: Thanks for the investigation! I will take a close look... > NM

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217854#comment-16217854 ] Eric Yang edited comment on YARN-7197 at 10/24/17 11:12 PM: [~ebadger] You are

[jira] [Commented] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2017-10-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217855#comment-16217855 ] Jian He commented on YARN-5447: --- [~asuresh], in yarn service we are rely on allocateRequestId as a mapping

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217854#comment-16217854 ] Eric Yang edited comment on YARN-7197 at 10/24/17 11:07 PM: [~ebadger] You are

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217854#comment-16217854 ] Eric Yang commented on YARN-7197: - [~ebadger] You are correct on all points, and mounting parent directory

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276.007.patch > Federation Router Web Service fixes >

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276-branch-2.004.patch YARN-7190 in branch-2 tuned the way the classpath was setup. I

[jira] [Updated] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7390: --- Description: All reservation related test cases failed when {{TestYarnClient}} runs against Fair Scheduler. To

[jira] [Updated] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7390: --- Attachment: YARN-7390.001.patch > All reservation related test cases failed when TestYarnClient runs against

[jira] [Created] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-10-24 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-7390: -- Summary: All reservation related test cases failed when TestYarnClient runs against Fair Scheduler. Key: YARN-7390 URL: https://issues.apache.org/jira/browse/YARN-7390 Project:

[jira] [Updated] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7326: Attachment: YARN-7326.yarn-native-services.007.patch Updated the logic to apply filtering local DNS server

[jira] [Updated] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7326: Attachment: (was: YARN-7326.yarn-native-services.007.patch) > Add recursion support and configure

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217795#comment-16217795 ] Eric Badger edited comment on YARN-7197 at 10/24/17 10:12 PM: -- Actually,

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-10-24 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217796#comment-16217796 ] Chandni Singh commented on YARN-7371: - Added some logging and looks like the {{allocationRequestId}} of

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217795#comment-16217795 ] Eric Badger commented on YARN-7197: --- Actually, thinking about this more, I'm wondering if this blacklist

[jira] [Updated] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7389: Attachment: YARN-7389.001.patch The 001 patch removes the hardcoded {{CapacityScheduler}} and adds a

[jira] [Updated] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7389: Affects Version/s: (was: 2.9.0) > Make TestResourceManager Scheduler agnostic >

[jira] [Updated] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-7389: Target Version/s: 3.0.0 (was: 2.9.0, 3.0.0) > Make TestResourceManager Scheduler agnostic >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217791#comment-16217791 ] Jason Lowe commented on YARN-4511: -- Yeah for a dev branch scenario it greatly reduces the number of

[jira] [Created] (YARN-7389) Make TestResourceManager Scheduler agnostic

2017-10-24 Thread Robert Kanter (JIRA)
Robert Kanter created YARN-7389: --- Summary: Make TestResourceManager Scheduler agnostic Key: YARN-7389 URL: https://issues.apache.org/jira/browse/YARN-7389 Project: Hadoop YARN Issue Type:

[jira] [Comment Edited] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217758#comment-16217758 ] Eric Yang edited comment on YARN-7326 at 10/24/17 9:53 PM: --- Fix white space

[jira] [Commented] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

2017-10-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217765#comment-16217765 ] Hudson commented on YARN-7385: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13130 (See

[jira] [Updated] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7326: Attachment: YARN-7326.yarn-native-services.007.patch Fix white space issues, the test failure isn't related

[jira] [Commented] (YARN-4827) Document configuration of ReservationSystem for FairScheduler

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217745#comment-16217745 ] Hadoop QA commented on YARN-4827: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217739#comment-16217739 ] Hadoop QA commented on YARN-7326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217737#comment-16217737 ] Daniel Templeton commented on YARN-7336: LGTM. Can we do anything about the ugly hash method in

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217727#comment-16217727 ] Haibo Chen commented on YARN-4511: -- Thanks [~jlowe] for the comment. My apologies for raising alarms by

[jira] [Updated] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7336: - Attachment: YARN-7336.000.patch > Unsafe cast from long to int Resource.hashCode() method >

[jira] [Updated] (YARN-3661) Basic Federation UI

2017-10-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3661: - Parent Issue: YARN-2915 (was: YARN-5597) > Basic Federation UI > > >

[jira] [Commented] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217721#comment-16217721 ] Jian He commented on YARN-6394: --- The new patch renamed ConfigFile#props to properties and the

[jira] [Updated] (YARN-7386) Duplicate Strings in various places in Yarn memory

2017-10-24 Thread Misha Dmitriev (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Misha Dmitriev updated YARN-7386: - Attachment: YARN-7386.01.patch > Duplicate Strings in various places in Yarn memory >

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.02.patch > Support specifying YARN related params in the service REST

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: (was: YARN-6394.yarn-native-services.02.patch) > Support specifying YARN related params in the

[jira] [Commented] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217713#comment-16217713 ] Haibo Chen commented on YARN-7358: -- Updated the patch to address the checkstyle indentation issue. >

[jira] [Updated] (YARN-7358) TestZKConfigurationStore and TestLeveldbConfigurationStore should explicitly set capacity scheduler

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7358: - Attachment: YARN-7358.01.patch > TestZKConfigurationStore and TestLeveldbConfigurationStore should

[jira] [Updated] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7388: - Attachment: YARN-7388.00.patch > TestAMRestart should be scheduler agnostic >

[jira] [Commented] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217703#comment-16217703 ] Yufei Gu commented on YARN-7385: Get two +1. Yeah! Thanks guys. > TestFairScheduler#testUpdateDemand and

[jira] [Updated] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7385: --- Fix Version/s: 3.1.0 > TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are > failing

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217700#comment-16217700 ] Jason Lowe commented on YARN-4511: -- bq. I can the patch up if we are willing to check in the rest of the

[jira] [Created] (YARN-7388) TestAMRestart should be scheduler agnostic

2017-10-24 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7388: Summary: TestAMRestart should be scheduler agnostic Key: YARN-7388 URL: https://issues.apache.org/jira/browse/YARN-7388 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-7353) Docker permitted volumes don't properly check for directories

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217698#comment-16217698 ] Eric Yang commented on YARN-7353: - [~vvasudev] Sure, I cherry-pick them to branch-3.0 and branch-2. >

[jira] [Updated] (YARN-7353) Docker permitted volumes don't properly check for directories

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7353: Fix Version/s: 3.0.0 2.9.0 > Docker permitted volumes don't properly check for

[jira] [Updated] (YARN-7326) Add recursion support and configure RegistryDNS to lookup upstream

2017-10-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-7326: - Summary: Add recursion support and configure RegistryDNS to lookup upstream (was: Some issues in

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217693#comment-16217693 ] Eric Badger commented on YARN-7197: --- [~eyang] bq. Symlink are banned to prevent mistakes. I can lift the

[jira] [Updated] (YARN-3661) Basic Federation UI

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-3661: -- Fix Version/s: 3.0 2.9.0 > Basic Federation UI > > >

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217689#comment-16217689 ] Íñigo Goiri commented on YARN-3661: --- Thanks for the review [~curino]. Tested locally and it works.

[jira] [Updated] (YARN-7045) Remove FSLeafQueue#addAppSchedulable

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7045: --- Fix Version/s: 3.0.0 > Remove FSLeafQueue#addAppSchedulable > > >

[jira] [Commented] (YARN-7289) TestApplicationLifetimeMonitor.testApplicationLifetimeMonitor times out

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217685#comment-16217685 ] Miklos Szegedi commented on YARN-7289: -- The issues are YARN-6747, YARN-7385, YARN-7385 and YARN-7387

[jira] [Created] (YARN-7387) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7387: Summary: org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestIncreaseAllocationExpirer fails intermittently Key: YARN-7387 URL:

[jira] [Commented] (YARN-7045) Remove FSLeafQueue#addAppSchedulable

2017-10-24 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217683#comment-16217683 ] Yufei Gu commented on YARN-7045: Committed it to branch-3.0. > Remove FSLeafQueue#addAppSchedulable >

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217679#comment-16217679 ] Haibo Chen commented on YARN-4511: -- bq. Have another patch for the changes to the swapContainer etc. The

[jira] [Commented] (YARN-3661) Basic Federation UI

2017-10-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-3661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217672#comment-16217672 ] Íñigo Goiri commented on YARN-3661: --- The problem is that {{TestRouterWebServicesREST}} cannot start and

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217638#comment-16217638 ] Eric Yang edited comment on YARN-7197 at 10/24/17 8:37 PM: --- [~ebadger] Symlink

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217638#comment-16217638 ] Eric Yang edited comment on YARN-7197 at 10/24/17 8:36 PM: --- [~ebadger] Symlink

[jira] [Comment Edited] (YARN-6747) TestFSAppStarvation.testPreemptionEnable fails intermittently

2017-10-24 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217577#comment-16217577 ] Miklos Szegedi edited comment on YARN-6747 at 10/24/17 8:36 PM: The first

[jira] [Commented] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

2017-10-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217646#comment-16217646 ] Daniel Templeton commented on YARN-7385: Yep, I second that +1. >

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217638#comment-16217638 ] Eric Yang edited comment on YARN-7197 at 10/24/17 8:32 PM: --- [~ebadger] Symlink

[jira] [Commented] (YARN-6384) Add configuratin to set max cpu usage when strict-resource-usage is false with cgroups

2017-10-24 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217644#comment-16217644 ] Daniel Templeton commented on YARN-6384: A couple comments: # Should this feature be on by default

[jira] [Updated] (YARN-6394) Support specifying YARN related params in the service REST API

2017-10-24 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6394: -- Attachment: YARN-6394.yarn-native-services.02.patch > Support specifying YARN related params in the service REST

[jira] [Commented] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

2017-10-24 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217641#comment-16217641 ] Robert Kanter commented on YARN-7385: - +1 LGTM > TestFairScheduler#testUpdateDemand and

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217638#comment-16217638 ] Eric Yang commented on YARN-7197: - [~ebadger] Symlink are banned to prevent mistakes. I can lift the

[jira] [Commented] (YARN-7385) TestFairScheduler#testUpdateDemand and TestFSLeafQueue#testUpdateDemand are failing with NPE

2017-10-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16217632#comment-16217632 ] Hadoop QA commented on YARN-7385: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >