[jira] [Updated] (YARN-6001) Improve moveApplicationQueues command line

2016-12-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6001: -- Description: As an example, below command is used to move an application across queue. {noformat}./yarn

[jira] [Commented] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747640#comment-15747640 ] Hadoop QA commented on YARN-6002: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6001) Improve moveApplicationQueues command line

2016-12-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-6001: -- Attachment: YARN-6001.0001.patch Uploading an initial version of patch. cc/[~rohithsharma] [~jianhe] and

[jira] [Created] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Raul Gutierrez Segales (JIRA)
Raul Gutierrez Segales created YARN-6002: Summary: Range support when serving a container log Key: YARN-6002 URL: https://issues.apache.org/jira/browse/YARN-6002 Project: Hadoop YARN

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747759#comment-15747759 ] zhangyubiao commented on YARN-5995: --- "RemoveAppCallNumOps" : 3540, "RemoveAppCallAvgTime" : 340.0,

[jira] [Comment Edited] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747759#comment-15747759 ] zhangyubiao edited comment on YARN-5995 at 12/14/16 9:11 AM: -

[jira] [Created] (YARN-6001) Improve moveApplicationQueues command line

2016-12-14 Thread Sunil G (JIRA)
Sunil G created YARN-6001: - Summary: Improve moveApplicationQueues command line Key: YARN-6001 URL: https://issues.apache.org/jira/browse/YARN-6001 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Raul Gutierrez Segales (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Gutierrez Segales updated YARN-6002: - Attachment: YARN-6002.patch > Range support when serving a container log >

[jira] [Commented] (YARN-6001) Improve moveApplicationQueues command line

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747674#comment-15747674 ] Hadoop QA commented on YARN-6001: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5866) [YARN-3368] Fix few issues reported by jshint in new YARN UI

2016-12-14 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-5866: --- Attachment: YARN-5866.005.patch > [YARN-3368] Fix few issues reported by jshint in new YARN UI >

[jira] [Updated] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-12-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-4994: Fix Version/s: (was: 2.7.0) > Use MiniYARNCluster with try-with-resources in tests >

[jira] [Updated] (YARN-5931) Document timeout interfaces CLI and REST APIs

2016-12-14 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-5931: Attachment: YARN-5931.1.patch Updating patch fixing review comments. I have made other

[jira] [Commented] (YARN-4994) Use MiniYARNCluster with try-with-resources in tests

2016-12-14 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15747887#comment-15747887 ] Akira Ajisaka commented on YARN-4994: - Thanks [~boky01] for the contribution.

[jira] [Updated] (YARN-5938) Minor refactoring to OpportunisticContainerAllocatorAMService

2016-12-14 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5938: -- Description: Minor code re-organization to do the following: # The

[jira] [Commented] (YARN-5421) Add daemon start and stop audit logs

2016-12-14 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748090#comment-15748090 ] Naganarasimha G R commented on YARN-5421: - Hi [~aw], Any concerns in logging this ? if not shall we

[jira] [Commented] (YARN-5888) [YARN-3368] Improve unit tests for YARN UI

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748231#comment-15748231 ] Hadoop QA commented on YARN-5888: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748311#comment-15748311 ] Sunil G commented on YARN-5995: --- I think you can extend a custom class from "MetricsSource" and could use

[jira] [Updated] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhangyubiao updated YARN-5995: -- Attachment: YARN-5995.patch > Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition >

[jira] [Commented] (YARN-5866) [YARN-3368] Fix few issues reported by jshint in new YARN UI

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748209#comment-15748209 ] Hadoop QA commented on YARN-5866: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748295#comment-15748295 ] Varun Saxena commented on YARN-5995: I think we should not use FSOpDurations. We can have a separate

[jira] [Commented] (YARN-5931) Document timeout interfaces CLI and REST APIs

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748366#comment-15748366 ] Hadoop QA commented on YARN-5931: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5888) [YARN-3368] Improve unit tests for YARN UI

2016-12-14 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-5888: --- Attachment: YARN-5888.002.patch > [YARN-3368] Improve unit tests for YARN UI >

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748393#comment-15748393 ] Hadoop QA commented on YARN-5995: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Raul Gutierrez Segales (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Gutierrez Segales updated YARN-6002: - Attachment: (was: YARN-6002.patch) > Range support when serving a container

[jira] [Updated] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Raul Gutierrez Segales (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Gutierrez Segales updated YARN-6002: - Attachment: YARN-6002-branch-2.7.001.patch > Range support when serving a

[jira] [Updated] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Raul Gutierrez Segales (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raul Gutierrez Segales updated YARN-6002: - Affects Version/s: 2.7.3 Fix Version/s: 2.7.4 > Range support when serving

[jira] [Commented] (YARN-6002) Range support when serving a container log

2016-12-14 Thread Raul Gutierrez Segales (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748843#comment-15748843 ] Raul Gutierrez Segales commented on YARN-6002: -- The provided implementation is actually

[jira] [Created] (YARN-6003) yarn-ui build failure caused by debug 2.4.0

2016-12-14 Thread Akira Ajisaka (JIRA)
Akira Ajisaka created YARN-6003: --- Summary: yarn-ui build failure caused by debug 2.4.0 Key: YARN-6003 URL: https://issues.apache.org/jira/browse/YARN-6003 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-5421) Add daemon start and stop audit logs

2016-12-14 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15748668#comment-15748668 ] Allen Wittenauer commented on YARN-5421: bq. Yes this came up as its part of our security audit

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-14 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749453#comment-15749453 ] Jason Lowe commented on YARN-5889: -- I think I can get behind a proposal that preserves the FIFO/priority

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749484#comment-15749484 ] Wangda Tan commented on YARN-5889: -- We should be able to make resource-used-by-active-users always

[jira] [Updated] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5976: - Attachment: YARN-5976.002.wip.patch Uploading patch v2. This patch now adds hbase 1.2.4 and removes all

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: (was: YARN-5967-yarn-native-services.02.patch) > Fix slider core module findbugs warnings >

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: YARN-5967-yarn-native-services.02.patch > Fix slider core module findbugs warnings >

[jira] [Updated] (YARN-5756) Add state-machine implementation for queues

2016-12-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5756: Attachment: YARN-5756.6.patch > Add state-machine implementation for queues >

[jira] [Commented] (YARN-5756) Add state-machine implementation for queues

2016-12-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749691#comment-15749691 ] Xuan Gong commented on YARN-5756: - Thanks for the comments, [~leftnoteasy] Have uploaded a new patch to

[jira] [Updated] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5928: - Attachment: YARN-5928-YARN-5355.03.patch > Move ATSv2 HBase backend code into a new module that is only

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749371#comment-15749371 ] Haibo Chen commented on YARN-5928: -- TestTokenClientRMService.testTokenRenewalWrongUser failure is

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749605#comment-15749605 ] Hadoop QA commented on YARN-5976: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5756) Add state-machine implementation for queues

2016-12-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5756?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-5756: Attachment: YARN-5756.6.patch > Add state-machine implementation for queues >

[jira] [Updated] (YARN-5996) Native services AM kills app on AMRMClientAsync onError call

2016-12-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-5996: - Attachment: YARN-5996-yarn-native-services.002.patch > Native services AM kills app on

[jira] [Commented] (YARN-5999) AMRMClientAsync will stop if any exceptions thrown on allocate call

2016-12-14 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749408#comment-15749408 ] Billie Rinaldi commented on YARN-5999: -- +1. The patch looks good to me. I tried it out with YARN-5996

[jira] [Comment Edited] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749484#comment-15749484 ] Wangda Tan edited comment on YARN-5889 at 12/14/16 9:06 PM: We should be able

[jira] [Updated] (YARN-5987) NM configured command to collect heap dump of preempted container

2016-12-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5987: - Attachment: YARN-5987.000.patch Since this is a new feature it applies only, if the container is

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749064#comment-15749064 ] Chris Trezzo commented on YARN-5797: Jira filed: YARN-6004 > Add metrics to the node manager for

[jira] [Commented] (YARN-5889) Improve user-limit calculation in capacity scheduler

2016-12-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749129#comment-15749129 ] Wangda Tan commented on YARN-5889: -- Thanks [~jlowe], [~eepayne]. bq. As such I'm not sure I agree with

[jira] [Commented] (YARN-6001) Improve moveApplicationQueues command line

2016-12-14 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749002#comment-15749002 ] Yufei Gu commented on YARN-6001: Thanks [~sunilg] for working on this. What about use keyword

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749171#comment-15749171 ] Jian He commented on YARN-4126: --- The rest are test refactorings which are good to have, IMO > RM should not

[jira] [Commented] (YARN-5987) NM configured command to collect heap dump of preempted container

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749196#comment-15749196 ] Hadoop QA commented on YARN-5987: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5600) Allow setting yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-12-14 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-5600: - Attachment: YARN-5600.016.patch Fixing a comment > Allow setting

[jira] [Updated] (YARN-5579) Resourcemanager should surface failed state store operation prominently

2016-12-14 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated YARN-5579: - Description: I found the following in Resourcemanager log when I tried to figure out why application got stuck in

[jira] [Created] (YARN-6004) Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines

2016-12-14 Thread Chris Trezzo (JIRA)
Chris Trezzo created YARN-6004: -- Summary: Refactor TestResourceLocalizationService#testDownloadingResourcesOnContainer so that it is less than 150 lines Key: YARN-6004 URL:

[jira] [Commented] (YARN-4126) RM should not issue delegation tokens in unsecure mode

2016-12-14 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749152#comment-15749152 ] Robert Kanter commented on YARN-4126: - [~jianhe], the commit you did to revert this simply changes the

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Li Lu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749184#comment-15749184 ] Li Lu commented on YARN-5976: - Let's remove the Phoenix dependency and revert affected patches. We can work on

[jira] [Updated] (YARN-5764) NUMA awareness support for launching containers

2016-12-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-5764: Attachment: NUMA Awareness for YARN Containers.pdf Please find the attached proposal document and provide

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749206#comment-15749206 ] Vrushali C commented on YARN-5976: -- Sounds good, thanks [~gtCarrera9], I will update the patch

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749734#comment-15749734 ] Junping Du commented on YARN-5709: -- [~kasha] (or [~ka...@cloudera.com]), do you have plan to backport this

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749878#comment-15749878 ] Jonathan Hung commented on YARN-5734: - Uploaded v2 design doc containing changes based on discussion.

[jira] [Commented] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749738#comment-15749738 ] Hadoop QA commented on YARN-5967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4844) Add getMemorySize/getVirtualCoresSize to o.a.h.y.api.records.Resource

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749834#comment-15749834 ] Jian He commented on YARN-4844: --- looks good > Add getMemorySize/getVirtualCoresSize to

[jira] [Commented] (YARN-5996) Native services AM kills app on AMRMClientAsync onError call

2016-12-14 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749886#comment-15749886 ] Gour Saha commented on YARN-5996: - [~billie.rinaldi] the 002 patch looks good to me. The only thing that

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749705#comment-15749705 ] Hadoop QA commented on YARN-5928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5764) NUMA awareness support for launching containers

2016-12-14 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Devaraj K updated YARN-5764: Attachment: YARN-5764-v0.patch Attaching the patch for this. > NUMA awareness support for launching

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749963#comment-15749963 ] Sangjin Lee commented on YARN-5976: --- And this should probably go into trunk (also). > Update hbase

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750065#comment-15750065 ] Haibo Chen commented on YARN-5928: -- >From the console output, it seems like Jenkins had run into an issue.

[jira] [Commented] (YARN-5600) Allow setting yarn.nodemanager.delete.debug-delay-sec on a per-application basis

2016-12-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749754#comment-15749754 ] Karthik Kambatla commented on YARN-5600: This is quite handy. Thanks for working on this Miklos.

[jira] [Commented] (YARN-5999) AMRMClientAsync will stop if any exceptions thrown on allocate call

2016-12-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749795#comment-15749795 ] Xuan Gong commented on YARN-5999: - Committed to trunk/branch-2. Thanks, Jian. And thanks, [~billie.rinaldi]

[jira] [Commented] (YARN-6000) Set modifier of interface Listener in AllocationFileLoaderService to public

2016-12-14 Thread Tao Jie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6000?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749979#comment-15749979 ] Tao Jie commented on YARN-6000: --- [~templedf], [~kasha] would you mind taking a look at it? > Set modifier of

[jira] [Created] (YARN-6005) Protocol for configuration changes between client and RM

2016-12-14 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-6005: --- Summary: Protocol for configuration changes between client and RM Key: YARN-6005 URL: https://issues.apache.org/jira/browse/YARN-6005 Project: Hadoop YARN

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750126#comment-15750126 ] Sangjin Lee commented on YARN-5928: --- Note that there is now YARN-5976 in flight (upgrading hbase and

[jira] [Commented] (YARN-5999) AMRMClientAsync will stop if any exceptions thrown on allocate call

2016-12-14 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749714#comment-15749714 ] Xuan Gong commented on YARN-5999: - +1 LGTM. Checking this in > AMRMClientAsync will stop if any exceptions

[jira] [Commented] (YARN-5709) Cleanup leader election configs and pluggability

2016-12-14 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749766#comment-15749766 ] Karthik Kambatla commented on YARN-5709: Will take a look later today or tomorrow. > Cleanup

[jira] [Commented] (YARN-5999) AMRMClientAsync will stop if any exceptions thrown on allocate call

2016-12-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749783#comment-15749783 ] Hudson commented on YARN-5999: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #10999 (See

[jira] [Updated] (YARN-3866) AM-RM protocol changes to support container resizing

2016-12-14 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3866: - Attachment: YARN-3866-branch-2.8.addendum.3.patch Attached ver.3 patch which addressed comments from

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: YARN-5967-yarn-native-services.02.patch > Fix slider core module findbugs warnings >

[jira] [Commented] (YARN-5764) NUMA awareness support for launching containers

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749927#comment-15749927 ] Hadoop QA commented on YARN-5764: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5996) Native services AM kills app on AMRMClientAsync onError call

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750101#comment-15750101 ] Jian He commented on YARN-5996: --- I checked the possible exceptions, didn't find such error that must force

[jira] [Updated] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2016-12-14 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-5734: Attachment: OrgQueueAPI-BasedSchedulerConfigurationManagement_v2.pdf > OrgQueue for easy

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749959#comment-15749959 ] Sangjin Lee commented on YARN-5976: --- Linking an issue about auditing dependencies. > Update hbase

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750055#comment-15750055 ] Haibo Chen commented on YARN-5928: -- TestQueuingContainerManager.testKillMultipleOpportunisticContainers is

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Sangjin Lee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750093#comment-15750093 ] Sangjin Lee commented on YARN-5928: --- Started one... > Move ATSv2 HBase backend code into a new module

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750536#comment-15750536 ] Hadoop QA commented on YARN-5928: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750608#comment-15750608 ] Haibo Chen commented on YARN-5928: -- Thanks for your reminder. I'll keep an eye on that and rebase my patch

[jira] [Commented] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750610#comment-15750610 ] Haibo Chen commented on YARN-5928: -- Only the findbug issue is related. Will address it in a following new

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-14 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5216: Attachment: YARN-5216-YARN-5972.003.patch Resolving javac warning. > Expose configurable preemption

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-14 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750141#comment-15750141 ] Hitesh Sharma commented on YARN-5216: - Hi all, thank you for the feedback, I really appreciate it.

[jira] [Commented] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750160#comment-15750160 ] Hadoop QA commented on YARN-5967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5996) Native services AM kills app on AMRMClientAsync onError call

2016-12-14 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750250#comment-15750250 ] Gour Saha commented on YARN-5996: - Perfect, in that case, +1 for the 002 patch. > Native services AM kills

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2016-12-14 Thread liuxiangwei (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750463#comment-15750463 ] liuxiangwei commented on YARN-5939: --- It works well on our cluster with about 700 machines, thank you very

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: YARN-5967-yarn-native-services.04.patch > Fix slider core module findbugs warnings >

[jira] [Updated] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5928: - Attachment: YARN-5928-YARN-5355.04.patch > Move ATSv2 HBase backend code into a new module that is only

[jira] [Commented] (YARN-5995) Add RMStateStore metrics to monitor all RMStateStoreEventTypeTransition performance

2016-12-14 Thread zhangyubiao (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750176#comment-15750176 ] zhangyubiao commented on YARN-5995: --- OK ,I will give a separate class to take the metrics. I will update

[jira] [Updated] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5967: -- Attachment: YARN-5967-yarn-native-services.03.patch > Fix slider core module findbugs warnings >

[jira] [Commented] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750572#comment-15750572 ] Hadoop QA commented on YARN-5967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5967) Fix slider core module findbugs warnings

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750642#comment-15750642 ] Hadoop QA commented on YARN-5967: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15750263#comment-15750263 ] Hadoop QA commented on YARN-5216: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5216) Expose configurable preemption policy for OPPORTUNISTIC containers running on the NM

2016-12-14 Thread Hitesh Sharma (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hitesh Sharma updated YARN-5216: Attachment: YARN-5216-YARN-5972.004.patch Fix build warning > Expose configurable preemption policy

[jira] [Updated] (YARN-5928) Move ATSv2 HBase backend code into a new module that is only dependent at runtime by yarn servers

2016-12-14 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-5928: - Attachment: YARN-5928-YARN-5355.04.patch > Move ATSv2 HBase backend code into a new module that is only

[jira] [Commented] (YARN-5797) Add metrics to the node manager for cleaning the PUBLIC and PRIVATE caches

2016-12-14 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749056#comment-15749056 ] Chris Trezzo commented on YARN-5797: The checkstyle warning is because the

[jira] [Commented] (YARN-5976) Update hbase version to 1.2

2016-12-14 Thread Joep Rottinghuis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15749242#comment-15749242 ] Joep Rottinghuis commented on YARN-5976: I'm +1 on that approach. Certainly the most expedient. >

  1   2   >