[jira] [Commented] (YARN-6716) Native services support for specifying component start order

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055175#comment-16055175 ] Hadoop QA commented on YARN-6716: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-19 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055156#comment-16055156 ] Manikandan R commented on YARN-6467: [~Naganarasimha] Applied the changes on branch-2 and attached

[jira] [Updated] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-19 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6467: --- Attachment: YARN-6467-branch-2.007.patch > CSQueueMetrics needs to update the current metrics for

[jira] [Commented] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16055057#comment-16055057 ] Akira Ajisaka commented on YARN-6722: - Umm... Perhaps it is a bug of the build or the scripts provided

[jira] [Updated] (YARN-6721) container-executor should have stack checking

2017-06-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6721: --- Summary: container-executor should have stack checking (was: container-executor should have

[jira] [Commented] (YARN-6723) NM overallocation based on over-time rather than snapshot utilization

2017-06-19 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054885#comment-16054885 ] Miklos Szegedi commented on YARN-6723: -- The suggestion is to add a period counter for

[jira] [Commented] (YARN-6718) NodeManager logging has "Received" mispelled as "Recieved"

2017-06-19 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054801#comment-16054801 ] Grant Sohn commented on YARN-6718: -- These spelling mistakes were fixed by HDFS-11574. > NodeManager

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054791#comment-16054791 ] ASF GitHub Bot commented on YARN-6674: -- Github user szegedim commented on the issue:

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054790#comment-16054790 ] ASF GitHub Bot commented on YARN-6674: -- Github user szegedim closed the pull request at:

[jira] [Commented] (YARN-6668) Use cgroup to get container resource utilization

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054780#comment-16054780 ] ASF GitHub Bot commented on YARN-6668: -- GitHub user szegedim opened a pull request:

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054772#comment-16054772 ] ASF GitHub Bot commented on YARN-6674: -- GitHub user szegedim opened a pull request:

[jira] [Commented] (YARN-5892) Capacity Scheduler: Support user-specific minimum user limit percent

2017-06-19 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054770#comment-16054770 ] Sunil G commented on YARN-5892: --- Thanks [~leftnoteasy] and [~eepayne] Committing it shortly. > Capacity

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-06-19 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054768#comment-16054768 ] Vrushali C commented on YARN-6047: -- Thanks [~rohithsharma]. I also noticed that we don't have much

[jira] [Updated] (YARN-6716) Native services support for specifying component start order

2017-06-19 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6716: - Attachment: YARN-6716-yarn-native-services.002.patch Added a test and fixed some checkstyle

[jira] [Updated] (YARN-6585) RM fails to start when upgrading from 2.7 to 2.8 for clusters with node labels.

2017-06-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-6585: - Fix Version/s: 2.9.0 > RM fails to start when upgrading from 2.7 to 2.8 for clusters with node > labels.

[jira] [Commented] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054627#comment-16054627 ] Panagiotis Garefalakis commented on YARN-6722: -- [~ajisakaa] it seems that Jenkins did not

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054513#comment-16054513 ] Haibo Chen commented on YARN-6670: -- Yep, filed and linked YARN-6723 for further discussion of

[jira] [Updated] (YARN-6723) NM overallocation based on over-time rather than snapshot utilization

2017-06-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6723: - Description: To continue discussion on Miklos's idea in YARN-6670 of "Usually the CPU usage fluctuates

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054510#comment-16054510 ] Hadoop QA commented on YARN-6706: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6723) NM overallocation based on over-time rather than snapshot utilization

2017-06-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6723: - Issue Type: Sub-task (was: Bug) Parent: YARN-1011 > NM overallocation based on over-time rather

[jira] [Created] (YARN-6723) NM overallocation based on over-time rather than snapshot utilization

2017-06-19 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-6723: Summary: NM overallocation based on over-time rather than snapshot utilization Key: YARN-6723 URL: https://issues.apache.org/jira/browse/YARN-6723 Project: Hadoop YARN

[jira] [Commented] (YARN-6047) Documentation updates for TimelineService v2

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054499#comment-16054499 ] Hadoop QA commented on YARN-6047: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6670) Add separate NM overallocation thresholds for cpu and memory

2017-06-19 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054487#comment-16054487 ] Karthik Kambatla commented on YARN-6670: I like the idea of making a decision based on the usage

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-06-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054479#comment-16054479 ] Haibo Chen commented on YARN-6706: -- [~leftnoteasy] I have shared the latest design doc with you. >

[jira] [Commented] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054439#comment-16054439 ] Hadoop QA commented on YARN-6722: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6047) Documentation updates for TimelineService v2

2017-06-19 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-6047: Attachment: YARN-6047-YARN-5355.002.patch updated patch with minor modifications as per

[jira] [Commented] (YARN-6680) Avoid locking overhead for NO_LABEL lookups

2017-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054423#comment-16054423 ] Hudson commented on YARN-6680: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11886 (See

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-06-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054402#comment-16054402 ] Wangda Tan commented on YARN-6706: -- [~haibo.chen], [~asuresh], [~kkaranasos], is there any design doc to

[jira] [Updated] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-6722: - Attachment: YARN-6722-yarn-native-services.001.patch > Bumping up pom file hadoop

[jira] [Updated] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-6722: - Attachment: (was: YARN-6722.patch) > Bumping up pom file hadoop version >

[jira] [Updated] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-6722: - Attachment: YARN-6722.patch > Bumping up pom file hadoop version >

[jira] [Updated] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-06-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-6706: - Attachment: YARN-6706-YARN-1011.01.patch > Refactor ContainerScheduler to make oversubscription change

[jira] [Commented] (YARN-6706) Refactor ContainerScheduler to make oversubscription change easier

2017-06-19 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054388#comment-16054388 ] Haibo Chen commented on YARN-6706: -- Patch updated to address checkstyle and unit test issues. The findbugs

[jira] [Updated] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Panagiotis Garefalakis (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6722?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Panagiotis Garefalakis updated YARN-6722: - Flags: Patch > Bumping up pom file hadoop version >

[jira] [Created] (YARN-6722) Bumping up pom file hadoop version

2017-06-19 Thread Panagiotis Garefalakis (JIRA)
Panagiotis Garefalakis created YARN-6722: Summary: Bumping up pom file hadoop version Key: YARN-6722 URL: https://issues.apache.org/jira/browse/YARN-6722 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054375#comment-16054375 ] Hudson commented on YARN-6467: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11885 (See

[jira] [Updated] (YARN-6721) container-executor should have -fstack-check

2017-06-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6721: --- Component/s: security > container-executor should have -fstack-check >

[jira] [Created] (YARN-6721) container-executor should have -fstack-check

2017-06-19 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created YARN-6721: -- Summary: container-executor should have -fstack-check Key: YARN-6721 URL: https://issues.apache.org/jira/browse/YARN-6721 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6721) container-executor should have -fstack-check

2017-06-19 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer updated YARN-6721: --- Labels: security (was: ) > container-executor should have -fstack-check >

[jira] [Commented] (YARN-6467) CSQueueMetrics needs to update the current metrics for default partition only

2017-06-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054324#comment-16054324 ] Naganarasimha G R commented on YARN-6467: - Hi [~maniraj...@gmail.com], committed the patch to trunk

[jira] [Commented] (YARN-6674) Add memory cgroup settings for opportunistic containers

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054315#comment-16054315 ] ASF GitHub Bot commented on YARN-6674: -- GitHub user szegedim opened a pull request:

[jira] [Commented] (YARN-6716) Native services support for specifying component start order

2017-06-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054258#comment-16054258 ] Hadoop QA commented on YARN-6716: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6680) Avoid locking overhead for NO_LABEL lookups

2017-06-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054242#comment-16054242 ] Naganarasimha G R commented on YARN-6680: - Thanks [~jlowe], agree with you on the multi-thread

[jira] [Commented] (YARN-6716) Native services support for specifying component start order

2017-06-19 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054227#comment-16054227 ] Billie Rinaldi commented on YARN-6716: -- This patch implements HTTP and port probes as optional

[jira] [Updated] (YARN-6716) Native services support for specifying component start order

2017-06-19 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi updated YARN-6716: - Attachment: YARN-6716-yarn-native-services.001.patch > Native services support for specifying

[jira] [Commented] (YARN-6680) Avoid locking overhead for NO_LABEL lookups

2017-06-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054197#comment-16054197 ] Jason Lowe commented on YARN-6680: -- There definitely is a bug in the code with respect to locking in

[jira] [Commented] (YARN-6719) Fix findbugs warnings in SLSCapacityScheduler.java

2017-06-19 Thread Naganarasimha G R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054069#comment-16054069 ] Naganarasimha G R commented on YARN-6719: - Thanks for correcting the 2.7 commit [~ajisakaa]. > Fix

[jira] [Commented] (YARN-6280) Add a query parameter in ResourceManager Cluster Applications REST API to control whether or not returns ResourceRequest

2017-06-19 Thread Lantao Jin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16054030#comment-16054030 ] Lantao Jin commented on YARN-6280: -- Hi [~sunilg], LGTM. The test failure seems not relates to our patch.

[jira] [Commented] (YARN-6710) There is a heavy bug in FSLeafQueue#amResourceUsage which will let the fair scheduler not assign container to the queue

2017-06-19 Thread daemon (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053715#comment-16053715 ] daemon commented on YARN-6710: -- [~yufeigu] 使用中文表述可能更清楚些, 这个问题导致的原因对于YARN端主要是由于 1. Application

[jira] [Commented] (YARN-6715) NodeHealthScriptRunner does not handle non-zero exit codes properly

2017-06-19 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053705#comment-16053705 ] Peter Bacsko commented on YARN-6715: I've seen that there's already a case for this:

[jira] [Updated] (YARN-6720) Support updating FPGA related constraint node label after FPGA device re-configuration

2017-06-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6720: --- Attachment: Storing-and-Updating-extra-FPGA-resource-attributes-in-hdfs_v1.pdf The draft proposal is

[jira] [Commented] (YARN-5079) [Umbrella] Native YARN framework layer for services and beyond

2017-06-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053596#comment-16053596 ] ASF GitHub Bot commented on YARN-5079: -- Github user aajisaka commented on the issue:

[jira] [Updated] (YARN-6719) Fix findbugs warnings in SLSCapacityScheduler.java

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6719: Fix Version/s: (was: 2.9) 2.9.0 > Fix findbugs warnings in

[jira] [Commented] (YARN-6719) Fix findbugs warnings in SLSCapacityScheduler.java

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053573#comment-16053573 ] Akira Ajisaka commented on YARN-6719: - Updated CHANGES.txt in branch-2.7. > Fix findbugs warnings in

[jira] [Commented] (YARN-6719) Fix findbugs warnings in SLSCapacityScheduler.java

2017-06-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16053556#comment-16053556 ] Akira Ajisaka commented on YARN-6719: - Thanks! > Fix findbugs warnings in SLSCapacityScheduler.java >