[jira] [Created] (YARN-4795) ContainerMetrics drops records

2016-03-11 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-4795: -- Summary: ContainerMetrics drops records Key: YARN-4795 URL: https://issues.apache.org/jira/browse/YARN-4795 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4719: --- Attachment: yarn-4719-6.patch > Add a helper library to maintain node state and allows common

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: YARN-4108.9.patch > CapacityScheduler: Improve preemption to preempt only those containers

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191596#comment-15191596 ] Karthik Kambatla commented on YARN-4719: bq. Can we make ClusterNodeTracker an interface and make

[jira] [Updated] (YARN-4784) fair scheduler: defaultQueueSchedulingPolicy should not accept fifo as a value

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4784: --- Fix Version/s: (was: 2.9.0) > fair scheduler: defaultQueueSchedulingPolicy should not

[jira] [Updated] (YARN-4784) fair scheduler: defaultQueueSchedulingPolicy should not accept fifo as a value

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4784: --- Component/s: (was: yarn) > fair scheduler: defaultQueueSchedulingPolicy should not accept

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191556#comment-15191556 ] Karthik Kambatla commented on YARN-3054: Also, the approach being proposed on YARN-4752 doesn't

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191554#comment-15191554 ] Karthik Kambatla commented on YARN-3054: Also, the approach being proposed on YARN-4752 doesn't

[jira] [Updated] (YARN-4792) FairScheduler should do sanity checks on its configuration

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-4792: --- Component/s: (was: yarn) > FairScheduler should do sanity checks on its configuration >

[jira] [Resolved] (YARN-1961) Fair scheduler preemption doesn't work for non-leaf queues

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved YARN-1961. Resolution: Won't Fix Closing this as "Won't Fix". Please reopen if there is a good reason

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2016-03-11 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated YARN-4006: - Attachment: YARN-4006-branch-trunk.patch Updated to handle an error.. Sample code coming shortly > YARN

[jira] [Updated] (YARN-4006) YARN ATS Alternate Kerberos HTTP Authentication Changes

2016-03-11 Thread Greg Senia (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Greg Senia updated YARN-4006: - Attachment: (was: YARN-4006-branch-trunk.patch) > YARN ATS Alternate Kerberos HTTP Authentication

[jira] [Commented] (YARN-3054) Preempt policy in FairScheduler may cause mapreduce job never finish

2016-03-11 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191538#comment-15191538 ] Karthik Kambatla commented on YARN-3054: Thanks [~peng.zhang]. I understand it now. The elegant

[jira] [Commented] (YARN-4150) Failure in TestNMClient because nodereports were not available

2016-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191537#comment-15191537 ] Hadoop QA commented on YARN-4150: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191518#comment-15191518 ] Hadoop QA commented on YARN-4108: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4545) Allow YARN distributed shell to use ATS v1.5 APIs

2016-03-11 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191508#comment-15191508 ] Naganarasimha G R commented on YARN-4545: - Hi [~gtCarrera], Overall approach is fine and having the

[jira] [Commented] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-11 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191478#comment-15191478 ] Giovanni Matteo Fumarola commented on YARN-4117: Increase the timeout for the tests. > End

[jira] [Updated] (YARN-4117) End to end unit test with mini YARN cluster for AMRMProxy Service

2016-03-11 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-4117: --- Attachment: YARN-4117.v4.patch > End to end unit test with mini YARN cluster

[jira] [Commented] (YARN-4794) Distributed shell app gets stuck on stopping containers after App completes

2016-03-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191453#comment-15191453 ] Jian He commented on YARN-4794: --- there's a dead lock in NMClient. In NMClientImpl#startContainer, it first

[jira] [Updated] (YARN-4794) Distributed shell app gets stuck on stopping containers after App completes

2016-03-11 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumana Sathish updated YARN-4794: - Description: Distributed shell app gets stuck on stopping containers after App completes with the

[jira] [Updated] (YARN-4794) Distributed shell app gets stuck on stopping containers after App completes

2016-03-11 Thread Sumana Sathish (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sumana Sathish updated YARN-4794: - Description: Distributed shell app gets stuck on stopping containers after App completes with the

[jira] [Assigned] (YARN-4794) Distributed shell app gets stuck on stopping containers after App completes

2016-03-11 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He reassigned YARN-4794: - Assignee: Jian He > Distributed shell app gets stuck on stopping containers after App completes >

[jira] [Commented] (YARN-4150) Failure in TestNMClient because nodereports were not available

2016-03-11 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191429#comment-15191429 ] Robert Kanter commented on YARN-4150: - I'd say that the test failures were unrelated given the patch,

[jira] [Created] (YARN-4794) Distributed shell app gets stuck on stopping containers after App completes

2016-03-11 Thread Sumana Sathish (JIRA)
Sumana Sathish created YARN-4794: Summary: Distributed shell app gets stuck on stopping containers after App completes Key: YARN-4794 URL: https://issues.apache.org/jira/browse/YARN-4794 Project:

[jira] [Commented] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191411#comment-15191411 ] Hadoop QA commented on YARN-4789: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-998) Persistent resource change during NM/RM restart

2016-03-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191389#comment-15191389 ] Junping Du commented on YARN-998: - Thanks Kenji for providing a sample patch. Several improvements should

[jira] [Commented] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191386#comment-15191386 ] Gera Shegalov commented on YARN-4789: - Thanks Jason, this is indeed the case. The question is whether

[jira] [Commented] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191384#comment-15191384 ] Gera Shegalov commented on YARN-4789: - The patch is throwing an exception only when both the user and

[jira] [Commented] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191371#comment-15191371 ] Jason Lowe commented on YARN-4789: -- This looks related to MAPREDUCE-6491. > Provide helpful exception for

[jira] [Created] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2016-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
Vinod Kumar Vavilapalli created YARN-4793: - Summary: [Umbrella] Simplified API layer for services and beyond Key: YARN-4793 URL: https://issues.apache.org/jira/browse/YARN-4793 Project: Hadoop

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191351#comment-15191351 ] Wangda Tan commented on YARN-4719: -- Looks good to me in general, +1 One nit: CS#reintializeQueues:

[jira] [Commented] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191345#comment-15191345 ] Sangjin Lee commented on YARN-4789: --- Thanks for filing the issue and the patch [~jira.shegalov]! This

[jira] [Commented] (YARN-4719) Add a helper library to maintain node state and allows common queries

2016-03-11 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191326#comment-15191326 ] Arun Suresh commented on YARN-4719: --- Can we make {{ClusterNodeTracker}} an interface and make the current

[jira] [Updated] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-11 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4108: - Attachment: YARN-4108.8.patch Attached ver.8, fixed javac warnings and test failures. >

[jira] [Created] (YARN-4792) FairScheduler should do sanity checks on its configuration

2016-03-11 Thread Yufei Gu (JIRA)
Yufei Gu created YARN-4792: -- Summary: FairScheduler should do sanity checks on its configuration Key: YARN-4792 URL: https://issues.apache.org/jira/browse/YARN-4792 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-4790) Per user blacklist node for user specific error for container launch failure.

2016-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191217#comment-15191217 ] Vinod Kumar Vavilapalli commented on YARN-4790: --- I agree with the problem statement but not

[jira] [Commented] (YARN-4686) MiniYARNCluster.start() returns before cluster is completely started

2016-03-11 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191211#comment-15191211 ] Eric Badger commented on YARN-4686: --- Thanks for finding this failure, [~eepayne]. I narrowed down the

[jira] [Commented] (YARN-4678) Cluster used capacity is > 100 when container reserved

2016-03-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191208#comment-15191208 ] Sunil G commented on YARN-4678: --- [~brahmareddy] Thanks for sharing the scenario. We have made changes only

[jira] [Resolved] (YARN-4791) Per user blacklist node for user specific error for container launch failure.

2016-03-11 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli resolved YARN-4791. --- Resolution: Duplicate Closing as duplicate. > Per user blacklist node for

[jira] [Commented] (YARN-4791) Per user blacklist node for user specific error for container launch failure.

2016-03-11 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15191110#comment-15191110 ] Sunil G commented on YARN-4791: --- [~djp] Is its same as YARN-4790? > Per user blacklist node for user

[jira] [Created] (YARN-4791) Per user blacklist node for user specific error for container launch failure.

2016-03-11 Thread Junping Du (JIRA)
Junping Du created YARN-4791: Summary: Per user blacklist node for user specific error for container launch failure. Key: YARN-4791 URL: https://issues.apache.org/jira/browse/YARN-4791 Project: Hadoop

[jira] [Created] (YARN-4790) Per user blacklist node for user specific error for container launch failure.

2016-03-11 Thread Junping Du (JIRA)
Junping Du created YARN-4790: Summary: Per user blacklist node for user specific error for container launch failure. Key: YARN-4790 URL: https://issues.apache.org/jira/browse/YARN-4790 Project: Hadoop

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

2016-03-11 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-313: Release Note: After this patch, the feature to support NM resource dynamically configuration is completed,

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

2016-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190870#comment-15190870 ] Hadoop QA commented on YARN-2883: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190773#comment-15190773 ] Gera Shegalov commented on YARN-4789: - I see the following options to deal with it: # silently

[jira] [Updated] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Gera Shegalov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gera Shegalov updated YARN-4789: Attachment: YARN-4789.001.patch > Provide helpful exception for non-PATH-like conflict with

[jira] [Created] (YARN-4789) Provide helpful exception for non-PATH-like conflict with admin.user.env

2016-03-11 Thread Gera Shegalov (JIRA)
Gera Shegalov created YARN-4789: --- Summary: Provide helpful exception for non-PATH-like conflict with admin.user.env Key: YARN-4789 URL: https://issues.apache.org/jira/browse/YARN-4789 Project: Hadoop

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2016-03-11 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15190704#comment-15190704 ] Hadoop QA commented on YARN-4108: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-2883) Queuing of container requests in the NM

2016-03-11 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2883: - Attachment: YARN-2883-trunk.004.patch Attaching patch that applies directly to