[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151413#comment-16151413 ] Hadoop QA commented on YARN-7088: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7075) Better styling for donut charts in new YARN UI

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7075: -- Target Version/s: 3.0.0-beta1 > Better styling for donut charts in new YARN UI >

[jira] [Commented] (YARN-7075) Better styling for donut charts in new YARN UI

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151381#comment-16151381 ] Sunil G commented on YARN-7075: --- Thanks [~dingda6] for contribution. I would like to backport this to

[jira] [Updated] (YARN-7075) Better styling for donut charts in new YARN UI

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7075: -- Summary: Better styling for donut charts in new YARN UI (was: [YARN-3368] Improvement of Web UI ) > Better

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151346#comment-16151346 ] Wangda Tan commented on YARN-7136: -- [~jlowe] when you get chance, could you check the latest patch? I want

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151341#comment-16151341 ] Hadoop QA commented on YARN-7136: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-09-01 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.008.patch [~sunilg] This patch saves the launchTime during recovery.

[jira] [Resolved] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-01 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He resolved YARN-7126. --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: yarn-native-services Committed to

[jira] [Commented] (YARN-7145) Identify potential flaky unit tests

2017-09-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151263#comment-16151263 ] Miklos Szegedi commented on YARN-7145: -- These are the tests that are likely to be flaky in case of a

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151252#comment-16151252 ] Hadoop QA commented on YARN-7072: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5328) Plan/ResourceAllocation data structure enhancements required to support recurring reservations in ReservationSystem

2017-09-01 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5328: - Summary: Plan/ResourceAllocation data structure enhancements required to support recurring

[jira] [Commented] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151224#comment-16151224 ] Hadoop QA commented on YARN-5328: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7136: - Attachment: YARN-7136.YARN-3926.007.patch Fixed compiling issue. > Additional Performance Improvement

[jira] [Updated] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7126: Attachment: YARN-7126-yarn-native-services.004.patch > Create introductory site documentation for YARN

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151083#comment-16151083 ] Hudson commented on YARN-7023: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12303 (See

[jira] [Commented] (YARN-7072) Add a new log aggregation file format controller

2017-09-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151077#comment-16151077 ] Xuan Gong commented on YARN-7072: - Fix the findbugs and checkstyle issues, The testcase failures should be

[jira] [Commented] (YARN-7148) TestLogsCLI fails in trunk and branch-2

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151075#comment-16151075 ] Hadoop QA commented on YARN-7148: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7072) Add a new log aggregation file format controller

2017-09-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7072: Attachment: YARN-7072-trunk.005.patch > Add a new log aggregation file format controller >

[jira] [Commented] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-01 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7149?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151071#comment-16151071 ] Eric Payne commented on YARN-7149: -- I believe that this is related to the refactoring done to the way User

[jira] [Created] (YARN-7149) Cross-queue preemption sometimes starves an underserved queue

2017-09-01 Thread Eric Payne (JIRA)
Eric Payne created YARN-7149: Summary: Cross-queue preemption sometimes starves an underserved queue Key: YARN-7149 URL: https://issues.apache.org/jira/browse/YARN-7149 Project: Hadoop YARN

[jira] [Commented] (YARN-4759) Fix signal handling for docker containers

2017-09-01 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151070#comment-16151070 ] Eric Badger commented on YARN-4759: --- [~shaneku...@gmail.com], another question (hopefully you didn't

[jira] [Commented] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151064#comment-16151064 ] Hadoop QA commented on YARN-6916: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-09-01 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5328: - Attachment: YARN-5328-v9.patch Thanks [~curino] for the hard debugging on corner cases. Uploading

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-01 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151057#comment-16151057 ] ASF GitHub Bot commented on YARN-7023: -- Github user asfgit closed the pull request at:

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151056#comment-16151056 ] Hadoop QA commented on YARN-7136: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151048#comment-16151048 ] Akira Ajisaka commented on YARN-6877: - Thank you for the quick reply! bq. The branch-2 patch or the

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151035#comment-16151035 ] Junping Du commented on YARN-6877: -- Thanks [~ajisakaa] for noticing us. bq. In short, the following

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151032#comment-16151032 ] Xuan Gong commented on YARN-6877: - [~ajisakaa] The branch-2 patch or the trunk patch breaks the build ?

[jira] [Updated] (YARN-6916) Moving logging APIs over to slf4j in hadoop-yarn-server-common

2017-09-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6916: Attachment: YARN-6916.004.patch 004: rebased > Moving logging APIs over to slf4j in

[jira] [Commented] (YARN-7148) TestLogsCLI fails in trunk and branch-2

2017-09-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151010#comment-16151010 ] Xuan Gong commented on YARN-7148: - I have to change the line: {code} Configuration configuration = new

[jira] [Updated] (YARN-7148) TestLogsCLI fails in trunk and branch-2

2017-09-01 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7148: Attachment: YARN-7148.1.patch > TestLogsCLI fails in trunk and branch-2 >

[jira] [Created] (YARN-7148) TestLogsCLI fails in trunk and branch-2

2017-09-01 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7148: --- Summary: TestLogsCLI fails in trunk and branch-2 Key: YARN-7148 URL: https://issues.apache.org/jira/browse/YARN-7148 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-7145) Identify potential flaky unit tests

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151004#comment-16151004 ] Hadoop QA commented on YARN-7145: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150983#comment-16150983 ] Akira Ajisaka commented on YARN-6877: - Allen said in dev MLs: bq. Looks like YARN-6877 is crashing

[jira] [Updated] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7136: - Attachment: YARN-7136.YARN-3926.006.patch Thanks [~sunilg] for updating patch and comments from [~jlowe].

[jira] [Commented] (YARN-7104) Improvement of Heatmap

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150957#comment-16150957 ] Sunil G commented on YARN-7104: --- Patch needs rebase. [~dingda6] please help to rebase. > Improvement of

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150872#comment-16150872 ] Hadoop QA commented on YARN-7136: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-09-01 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-6911: --- Attachment: resource graph in web ui v2.png > Graph application-level resource utilization in

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-09-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150861#comment-16150861 ] Daniel Templeton commented on YARN-7146: Thanks for fixing those, [~rkanter]. Two things. First,

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-01 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150851#comment-16150851 ] Daniel Templeton commented on YARN-6953: Looks good to me, though I'm a bit biased. :) Should the

[jira] [Updated] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7126: Attachment: YARN-7126-yarn-native-services.003.patch > Create introductory site documentation for YARN

[jira] [Commented] (YARN-7022) Improve click interaction in queue nodes tree in Web UI v2

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150825#comment-16150825 ] Sunil G commented on YARN-7022: --- Thanks. Please help to raise a new issue. I ll commit this shortly. >

[jira] [Commented] (YARN-7022) Improve click interaction in queue nodes tree in Web UI v2

2017-09-01 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150816#comment-16150816 ] Abdullah Yousufi commented on YARN-7022: Yeah that sounds like a different issue to me. I think a

[jira] [Commented] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150806#comment-16150806 ] Hadoop QA commented on YARN-7126: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7120) CapacitySchedulerPage NPE in "Aggregate scheduler counts" section

2017-09-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150791#comment-16150791 ] Hudson commented on YARN-7120: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12300 (See

[jira] [Updated] (YARN-7145) Identify potential flaky unit tests

2017-09-01 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Miklos Szegedi updated YARN-7145: - Attachment: YARN-7145.001.patch [~bibinchundatt], good point, thank you. I attached a new patch.

[jira] [Updated] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7126: Attachment: YARN-7126-yarn-native-services.002.patch > Create introductory site documentation for YARN

[jira] [Commented] (YARN-7120) CapacitySchedulerPage NPE in "Aggregate scheduler counts" section

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150757#comment-16150757 ] Jason Lowe commented on YARN-7120: -- Ah sorry, I misread the patch. We're not setting the container ID to

[jira] [Updated] (YARN-7126) Create introductory site documentation for YARN native services

2017-09-01 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha updated YARN-7126: Attachment: YARN-7126-yarn-native-services.001.patch > Create introductory site documentation for YARN

[jira] [Commented] (YARN-7071) Add vcores and number of containers in new YARN UI node heat map

2017-09-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150739#comment-16150739 ] Hudson commented on YARN-7071: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12298 (See

[jira] [Commented] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-09-01 Thread Devaraj K (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150734#comment-16150734 ] Devaraj K commented on YARN-7033: - [~sunilg], Thanks again for looking into this. bq. In

[jira] [Commented] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150717#comment-16150717 ] Rohith Sharma K S commented on YARN-7147: - Thanks [~jlowe] for clarifying it. It make sense to me.

[jira] [Comment Edited] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150581#comment-16150581 ] Sunil G edited comment on YARN-7143 at 9/1/17 3:23 PM: --- Yes. Thats correct. In case

[jira] [Commented] (YARN-6911) Graph application-level resource utilization in Web UI v2

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150713#comment-16150713 ] Sunil G commented on YARN-6911: --- In {{yarn-app-timeline}}, we could use override queryForRecord instead of

[jira] [Resolved] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S resolved YARN-7147. - Resolution: Duplicate Closing as duplicate! > ATS1.5 crash due to OOM >

[jira] [Commented] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150709#comment-16150709 ] Jason Lowe commented on YARN-7147: -- Rolling leveldb doesn't make sense for an entity group caching. That

[jira] [Updated] (YARN-7071) Add vcores and number of containers in new YARN UI node heat map

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7071: -- Summary: Add vcores and number of containers in new YARN UI node heat map (was: Add vcores and number of

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150699#comment-16150699 ] Jason Lowe commented on YARN-7136: -- So patch 005 addresses the volatile-in-a-loop issue, although I'm

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150691#comment-16150691 ] Jason Lowe commented on YARN-7136: -- Sorry, comment race. My comments above were for patch 004, I'll have

[jira] [Commented] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150688#comment-16150688 ] Jason Lowe commented on YARN-7136: -- Thanks for updating the patch! The findbugs exclusion entry should

[jira] [Commented] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150673#comment-16150673 ] Rohith Sharma K S commented on YARN-7147: - Yes, this can be avoid by configuring

[jira] [Commented] (YARN-7022) Improve click interaction in queue nodes tree in Web UI v2

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150668#comment-16150668 ] Sunil G commented on YARN-7022: --- [~ayousufi], sorry for a last minute hiccup. When i click (single), below

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150655#comment-16150655 ] Hadoop QA commented on YARN-6953: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7033) Add support for NM Recovery of assigned resources(GPU's, NUMA, FPGA's) to container

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7033?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150642#comment-16150642 ] Sunil G commented on YARN-7033: --- Thanks [~devaraj.k] for the patch. One last comment, In

[jira] [Updated] (YARN-7136) Additional Performance Improvement for Resource Profile Feature

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7136: -- Attachment: YARN-7136.YARN-3926.005.patch Quickly sharing v5 patch. in DRC and Resources, we could avoid

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-01 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150595#comment-16150595 ] Manikandan R commented on YARN-6953: [~dan...@cloudera.com] Yes, we can go with your patch as it is

[jira] [Updated] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-09-01 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-6953: --- Attachment: YARN-6953-YARN-3926.005.patch > Clean up

[jira] [Commented] (YARN-7143) FileNotFound handling in ResourceUtils is inconsistent

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150581#comment-16150581 ] Sunil G commented on YARN-7143: --- Yes. Thats correct. In case of node-resources also we have to do. Sounds

[jira] [Commented] (YARN-7120) CapacitySchedulerPage NPE in "Aggregate scheduler counts" section

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150577#comment-16150577 ] Jason Lowe commented on YARN-7120: -- Thanks for the patch! If I understand the patch correctly, this won't

[jira] [Commented] (YARN-5892) Support user-specific minimum user limit percentage in Capacity Scheduler

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150574#comment-16150574 ] Sunil G commented on YARN-5892: --- Thanks [~djp] > Support user-specific minimum user limit percentage in

[jira] [Commented] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150563#comment-16150563 ] Jason Lowe commented on YARN-7147: -- Isn't this solved by changing

[jira] [Commented] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150553#comment-16150553 ] Rohith Sharma K S commented on YARN-7147: - Instead of in memory cache store, there are other cache

[jira] [Updated] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-7147: Attachment: Screen Shot - suspect-1.png Screen Shot - suspect-2.png Updates

[jira] [Created] (YARN-7147) ATS1.5 crash due to OOM

2017-09-01 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-7147: --- Summary: ATS1.5 crash due to OOM Key: YARN-7147 URL: https://issues.apache.org/jira/browse/YARN-7147 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6933) ResourceUtils.DISALLOWED_NAMES and ResourceUtils.checkMandatoryResources() are duplicating work

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150527#comment-16150527 ] Sunil G commented on YARN-6933: --- Yes +1 from me as well. I ll commit shortly >

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150522#comment-16150522 ] Hadoop QA commented on YARN-7088: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7075) [YARN-3368] Improvement of Web UI

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150506#comment-16150506 ] Sunil G commented on YARN-7075: --- Changes looks fine to me. Thanks [~dingda6] and thanks [~gtCarrera9] I ll

[jira] [Commented] (YARN-7104) Improvement of Heatmap

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150499#comment-16150499 ] Sunil G commented on YARN-7104: --- Thanks. changes look fine to me. Committing shortly. > Improvement of

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150466#comment-16150466 ] Sunil G commented on YARN-7088: --- Adding few more points # Its better not to rely on Attempts to update

[jira] [Commented] (YARN-7088) Fix application start time and add submit time to UIs

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150440#comment-16150440 ] Sunil G commented on YARN-7088: --- IIUC, there are few fields we are trying to define based on trunk as well as

[jira] [Commented] (YARN-7134) AppSchedulingInfo has a dependency on capacity scheduler

2017-09-01 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150408#comment-16150408 ] Sunil G commented on YARN-7134: --- Yes. We could move to scheduler package itself. > AppSchedulingInfo has a

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-01 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150398#comment-16150398 ] Akira Ajisaka commented on YARN-7023: - LGTM, +1. Thanks Oleg for the update. > Incorrect

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150340#comment-16150340 ] Hadoop QA commented on YARN-7023: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6877) Create an abstract log reader for extendability

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150319#comment-16150319 ] Junping Du commented on YARN-6877: -- Thanks [~xgong]. The test failures should be unrelated. commit the

[jira] [Commented] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-01 Thread Oleg Danilov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150308#comment-16150308 ] Oleg Danilov commented on YARN-7023: [~bibinchundatt] Updated. > Incorrect ReservationId.compareTo()

[jira] [Updated] (YARN-7023) Incorrect ReservationId.compareTo() implementation

2017-09-01 Thread Oleg Danilov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oleg Danilov updated YARN-7023: --- Attachment: YARN-7023.1.patch > Incorrect ReservationId.compareTo() implementation >

[jira] [Commented] (YARN-7138) Fix incompatible API change for YarnScheduler involved by YARN-5521

2017-09-01 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150300#comment-16150300 ] Junping Du commented on YARN-7138: -- Thanks [~leftnoteasy] for response. bq. Regarding to scheduler of K8S,

[jira] [Updated] (YARN-7088) Fix application start time and add submit time to UIs

2017-09-01 Thread Abdullah Yousufi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abdullah Yousufi updated YARN-7088: --- Attachment: YARN-7088.007.patch Main change in this patch is that the launch time is actually

[jira] [Commented] (YARN-7139) FairScheduler: finished applications are always restored to default queue

2017-09-01 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150151#comment-16150151 ] Hadoop QA commented on YARN-7139: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7134) AppSchedulingInfo has a dependency on capacity scheduler

2017-09-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148877#comment-16148877 ] Bibin A Chundatt edited comment on YARN-7134 at 9/1/17 6:33 AM: We could

[jira] [Commented] (YARN-7141) Move logging APIs to slf4j in timelineservice after ATSv2 merge

2017-09-01 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150102#comment-16150102 ] Hudson commented on YARN-7141: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #12293 (See

[jira] [Commented] (YARN-7141) Move logging APIs to slf4j in timelineservice after ATSv2 merge

2017-09-01 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16150087#comment-16150087 ] Bibin A Chundatt commented on YARN-7141: Committed to trunk > Move logging APIs to slf4j in

[jira] [Updated] (YARN-7139) FairScheduler: finished applications are always restored to default queue

2017-09-01 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7139?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-7139: Attachment: YARN-7139.02.patch Some of the tests were failing due to sequencing of