[jira] [Updated] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Fix Version/s: (was: YARN-3926) > Add support in NodeManager to isolate FPGA devices with CGroups

[jira] [Updated] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Attachment: YARN-6507-trunk.001.patch Draft patch for FPGA java side code > Add support in

[jira] [Commented] (YARN-7413) Support resource type in SLS

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226255#comment-16226255 ] Daniel Templeton commented on YARN-7413: Patch looks good. It would be nice to have the info in

[jira] [Commented] (YARN-7316) Cleaning up the usage of Resources and ResourceCalculator

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226244#comment-16226244 ] Daniel Templeton commented on YARN-7316: I had been planning to post a JIRA to remove the methods

[jira] [Commented] (YARN-6594) [API] Introduce SchedulingRequest object

2017-10-30 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226226#comment-16226226 ] Konstantinos Karanasos commented on YARN-6594: -- Thanks [~wangda]! And [~asuresh], [~jianhe],

[jira] [Commented] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226218#comment-16226218 ] Jian He commented on YARN-6413: --- bq. will the yarn-native-services branch add the option to configure which

[jira] [Commented] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226184#comment-16226184 ] Hadoop QA commented on YARN-6413: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226181#comment-16226181 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6508) Support FPGA plugin

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226162#comment-16226162 ] Zhankun Tang commented on YARN-6508: The default vendor specific plugin is implemented in YARN-6507. So

[jira] [Resolved] (YARN-6508) Support FPGA plugin

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang resolved YARN-6508. Resolution: Implemented > Support FPGA plugin > --- > > Key:

[jira] [Updated] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Description: Support local FPGA resource scheduler to assign/isolate N FPGA slots to a container. At

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226157#comment-16226157 ] Hadoop QA commented on YARN-4511: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226156#comment-16226156 ] Zhankun Tang commented on YARN-6507: Because we'll first support one kind of plugin for the time being.

[jira] [Updated] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-10-30 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Summary: Add support in NodeManager to isolate FPGA devices with CGroups (was: Support FPGA

[jira] [Commented] (YARN-7276) Federation Router Web Service fixes

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226132#comment-16226132 ] Hadoop QA commented on YARN-7276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226125#comment-16226125 ] Hadoop QA commented on YARN-6413: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7316) Cleaning up the usage of Resources and ResourceCalculator

2017-10-30 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226124#comment-16226124 ] Sunil G commented on YARN-7316: --- I think it was mainly because of a readability and to go with a common

[jira] [Updated] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ellen Hui updated YARN-6413: Attachment: YARN-6413.v7.patch Fix Checkstyle and whitespace > Yarn Registry FS implementation >

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226092#comment-16226092 ] Subru Krishnan commented on YARN-7400: -- Thanks [~djp] for the clarification and [~xgong] for the quick

[jira] [Commented] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226080#comment-16226080 ] Hadoop QA commented on YARN-6413: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ellen Hui updated YARN-6413: Attachment: YARN-6413.v6.patch Addressed [~jianhe]'s comments. Hi Jian, a quick question: will the

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226069#comment-16226069 ] Hadoop QA commented on YARN-7400: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7418) Improve performance of locking in fair scheduler

2017-10-30 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7418: -- Summary: Improve performance of locking in fair scheduler Key: YARN-7418 URL: https://issues.apache.org/jira/browse/YARN-7418 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-7336) Unsafe cast from long to int Resource.hashCode() method

2017-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226031#comment-16226031 ] Hudson commented on YARN-7336: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13161 (See

[jira] [Commented] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-30 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226030#comment-16226030 ] Hudson commented on YARN-6927: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13161 (See

[jira] [Updated] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-4511: - Attachment: YARN-4511-YARN-1011.10.patch > Common scheduler changes supporting scheduler-specific

[jira] [Reopened] (YARN-7202) Add UT for api-server

2017-10-30 Thread Gour Saha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gour Saha reopened YARN-7202: - Re-opening this, since the issues that were raised in this jira on "16/Oct/17 17:48" needs to be addressed.

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226021#comment-16226021 ] Haibo Chen commented on YARN-4511: -- Filed YARN-7337 for SchedulerNodeReport changes because I think there

[jira] [Commented] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16226017#comment-16226017 ] Jian He commented on YARN-6413: --- - RegistryOperationsStoreService - rename to FSRegistryOperationsService ? -

[jira] [Commented] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225986#comment-16225986 ] Wangda Tan commented on YARN-7394: -- [~suma.shivaprasad], Thanks for updating the patch, few comments: 1)

[jira] [Comment Edited] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225986#comment-16225986 ] Wangda Tan edited comment on YARN-7394 at 10/30/17 11:40 PM: -

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225984#comment-16225984 ] Haibo Chen commented on YARN-4511: -- Thanks [~asuresh] for your review! bq. Is there a case where the

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225982#comment-16225982 ] Junping Du commented on YARN-7400: -- Hey [~subru], all new format log related patches get landed on 2.9, so

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225981#comment-16225981 ] Xuan Gong commented on YARN-7400: - the re-factory work will be tracked by

[jira] [Created] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2017-10-30 Thread Xuan Gong (JIRA)
Xuan Gong created YARN-7417: --- Summary: re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes Key: YARN-7417 URL: https://issues.apache.org/jira/browse/YARN-7417

[jira] [Commented] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

2017-10-30 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225973#comment-16225973 ] Haibo Chen commented on YARN-4511: -- Thanks [~leftnoteasy] for the review! bq. assert in the main code

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225965#comment-16225965 ] Xuan Gong commented on YARN-7400: - trival patch for quick fix > incorrect log preview displayed in

[jira] [Updated] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7400: Attachment: YARN-7400.1.patch > incorrect log preview displayed in jobhistory server ui >

[jira] [Comment Edited] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225892#comment-16225892 ] Subru Krishnan edited comment on YARN-7400 at 10/30/17 10:57 PM: -

[jira] [Commented] (YARN-7342) Application page doesn't show correct metrics for reservation runs

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225896#comment-16225896 ] Subru Krishnan commented on YARN-7342: -- [~yufeigu], thanks for your response. I agree that it's not

[jira] [Commented] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225892#comment-16225892 ] Subru Krishnan commented on YARN-7400: -- Is this a blocker for 2.9.0 as IIUC we don't enable the new

[jira] [Updated] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-7400: - Target Version/s: 2.9.0, 3.0.0, 3.1.0 > incorrect log preview displayed in jobhistory server ui >

[jira] [Updated] (YARN-7330) Add support to show GPU on UI/metrics

2017-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7330: - Attachment: YARN-7330.2-wip.patch Attached ver.2 patch, added cluster resource usages for all resource

[jira] [Updated] (YARN-6413) Yarn Registry FS implementation

2017-10-30 Thread Ellen Hui (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ellen Hui updated YARN-6413: Attachment: YARN-6413.v5.patch Fix Checkstyle. The asflicense failures are caused by

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225841#comment-16225841 ] Subru Krishnan commented on YARN-7371: -- [~csingh]/[~billie.rinaldi], I am *not* in favor of replacing

[jira] [Updated] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-10-30 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-7371: Attachment: YARN-7371-yarn-native-services.004.patch > NPE in ServiceMaster after RM is restarted

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225812#comment-16225812 ] Jason Lowe commented on YARN-7197: -- Solution 3 is more secure since the paths are unavailable within the

[jira] [Commented] (YARN-7342) Application page doesn't show correct metrics for reservation runs

2017-10-30 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225809#comment-16225809 ] Yufei Gu commented on YARN-7342: Not familiar with WebUI part. I will have a look first. Do you think it is

[jira] [Commented] (YARN-7395) NM fails to successfully kill tasks that run over their memory limit

2017-10-30 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225790#comment-16225790 ] Eric Badger commented on YARN-7395: --- I have confirmed that I do *not* see this on trunk. On trunk the

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-10-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225783#comment-16225783 ] Robert Kanter commented on YARN-7146: - They don't appear to be related.

[jira] [Commented] (YARN-6940) FairScheduler: Enable Container update CodePaths and container resize testcase

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6940?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225779#comment-16225779 ] Daniel Templeton commented on YARN-6940: I'll took a look when I get a chance. > FairScheduler:

[jira] [Commented] (YARN-7316) Cleaning up the usage of Resources and ResourceCalculator

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225778#comment-16225778 ] Daniel Templeton commented on YARN-7316: I've actually been actively doing the opposite. It seems

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-30 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225721#comment-16225721 ] Jason Lowe commented on YARN-7244: -- The ASF warnings are unrelated. +1 for the branch-2.8 patch.

[jira] [Commented] (YARN-7371) NPE in ServiceMaster after RM is restarted and then the ServiceMaster is killed

2017-10-30 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225713#comment-16225713 ] Billie Rinaldi commented on YARN-7371: -- Thanks for the patch, [~csingh]! The patch looks good overall,

[jira] [Assigned] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong reassigned YARN-7400: --- Assignee: Xuan Gong > incorrect log preview displayed in jobhistory server ui >

[jira] [Updated] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7400: Affects Version/s: (was: 2.7.3) 3.1.0 3.0.0

[jira] [Updated] (YARN-7400) incorrect log preview displayed in jobhistory server ui

2017-10-30 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-7400: Description: In the job history server ui, If we enable the new log format, the container preview log is

[jira] [Commented] (YARN-7378) Documentation changes post branch-2 merge

2017-10-30 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225695#comment-16225695 ] Vrushali C commented on YARN-7378: -- Thanks [~rohithsharma] and [~varun_saxena] for the reviews and +1. I

[jira] [Commented] (YARN-6909) The performance advantages of YARN-6679 are lost when resource types are used

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225659#comment-16225659 ] Daniel Templeton commented on YARN-6909: This patch looks like it's largely a refactor. It doesn't

[jira] [Commented] (YARN-6930) Admins should be able to explicitly enable specific LinuxContainerRuntime in the NodeManager

2017-10-30 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225652#comment-16225652 ] Junping Du commented on YARN-6930: -- bq. It has to be explicitly turned on in 2.9. In 2.8 it was turned on

[jira] [Commented] (YARN-7378) Documentation changes post branch-2 merge

2017-10-30 Thread Varun Saxena (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7378?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225648#comment-16225648 ] Varun Saxena commented on YARN-7378: +1 LGTM > Documentation changes post branch-2 merge >

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-10-30 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-6128: --- Attachment: YARN-6128.v0.patch > Add support for AMRMProxy HA > > >

[jira] [Commented] (YARN-5734) OrgQueue for easy CapacityScheduler queue configuration management

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225631#comment-16225631 ] Subru Krishnan commented on YARN-5734: -- [~jhung] (cc: [~mshen], [~xgong], [~leftnoteasy], [~zhz]), can

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2915: - Release Note: A federation-based approach to transparently scale a single YARN cluster to tens of

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2915: - Release Note: A federation-based approach to transparently scale a single YARN cluster to tens of

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2915: - Release Note: A federation-based approach to transparently scale a single YARN cluster to tens of

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2915: - Release Note: A federation-based approach to transparently scale a single YARN cluster to tens of

[jira] [Updated] (YARN-5326) Support for recurring reservations in the YARN ReservationSystem

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5326: - Release Note: Add native support for recurring reservations (good till cancelled) to enable

[jira] [Commented] (YARN-7286) Add support for docker to have no capabilities

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225595#comment-16225595 ] Hadoop QA commented on YARN-7286: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7394) Merge code paths for Reservation/Plan queues and Auto Created queues

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225574#comment-16225574 ] Hadoop QA commented on YARN-7394: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225557#comment-16225557 ] Wangda Tan commented on YARN-7410: -- Thanks [~sunilg] for trying this patch. [~templedf], I just updated

[jira] [Resolved] (YARN-5326) Support for recurring reservations in the YARN ReservationSystem

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-5326. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0

[jira] [Updated] (YARN-6469) Extending Synthetic Load Generator and SLS for recurring reservation

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6469: - Parent Issue: YARN-2572 (was: YARN-5326) > Extending Synthetic Load Generator and SLS for

[jira] [Updated] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-30 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7410: - Description: After YARN-7307, Client/AM don't need to keep a up-to-dated resource-type.xml in the

[jira] [Commented] (YARN-7342) Application page doesn't show correct metrics for reservation runs

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225534#comment-16225534 ] Subru Krishnan commented on YARN-7342: -- [~yufeigu], can you get to it this week as 2.9.0 release date

[jira] [Commented] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

2017-10-30 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225533#comment-16225533 ] Robert Kanter commented on YARN-7262: - Oops, Sorry, I had misread your previous comment as "LGTM +1"

[jira] [Commented] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225529#comment-16225529 ] Subru Krishnan commented on YARN-7343: -- Moving it out of 2.9 as the patch needs rework and it's not a

[jira] [Updated] (YARN-7415) RM Rest API Submit application documentation not easy to understand

2017-10-30 Thread Atul Kulkarni (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Atul Kulkarni updated YARN-7415: Priority: Major (was: Minor) > RM Rest API Submit application documentation not easy to understand

[jira] [Updated] (YARN-7342) Application page doesn't show correct metrics for reservation runs

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7342: - Target Version/s: 3.0.0, 3.1.0 (was: 2.9.0, 3.1.0) > Application page doesn't show correct

[jira] [Updated] (YARN-7343) Add a junit test for ContainerScheduler recovery

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7343: - Target Version/s: 3.0.0 (was: 2.9.0, 3.0.0) > Add a junit test for ContainerScheduler recovery >

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-30 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: YARN-7276-branch-2.006.patch Fixed javac issue with explicit cast. > Federation Router Web

[jira] [Commented] (YARN-6953) Clean up ResourceUtils.setMinimumAllocationForMandatoryResources() and setMaximumAllocationForMandatoryResources()

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225522#comment-16225522 ] Daniel Templeton commented on YARN-6953: +1 from me as well, except that the patch doesn't appear

[jira] [Commented] (YARN-7146) Many RM unit tests failing with FairScheduler

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225518#comment-16225518 ] Daniel Templeton commented on YARN-7146: [~rkanter], wanna check those test failures? > Many RM

[jira] [Updated] (YARN-7276) Federation Router Web Service fixes

2017-10-30 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Íñigo Goiri updated YARN-7276: -- Attachment: (was: YARN-7276-branch-2.005.patch) > Federation Router Web Service fixes >

[jira] [Commented] (YARN-7262) Add a hierarchy into the ZKRMStateStore for delegation token znodes to prevent jute buffer overflow

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7262?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225516#comment-16225516 ] Daniel Templeton commented on YARN-7262: For the record, +1 > Add a hierarchy into the

[jira] [Commented] (YARN-7276) Federation Router Web Service fixes

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225485#comment-16225485 ] Hadoop QA commented on YARN-7276: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang edited comment on YARN-7197 at 10/30/17 6:19 PM: --- [~jlowe]

[jira] [Commented] (YARN-7244) ShuffleHandler is not aware of disks that are added

2017-10-30 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225477#comment-16225477 ] Kuhu Shukla commented on YARN-7244: --- [~jlowe], request for comments on the 2.8 version of the patch.

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang edited comment on YARN-7197 at 10/30/17 6:18 PM: --- [~jlowe]

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang edited comment on YARN-7197 at 10/30/17 6:17 PM: --- [~jlowe]

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang edited comment on YARN-7197 at 10/30/17 6:13 PM: --- [~jlowe]

[jira] [Commented] (YARN-6927) Add support for individual resource types requests in MapReduce

2017-10-30 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225468#comment-16225468 ] Hadoop QA commented on YARN-6927: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang edited comment on YARN-7197 at 10/30/17 6:09 PM: --- [~jlowe]

[jira] [Comment Edited] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang edited comment on YARN-7197 at 10/30/17 6:08 PM: --- [~jlowe]

[jira] [Commented] (YARN-7197) Add support for a volume blacklist for docker containers

2017-10-30 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225452#comment-16225452 ] Eric Yang commented on YARN-7197: - [~jlowe] {quote}Either /run isn't in the whitelist in the first place

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225447#comment-16225447 ] Daniel Templeton commented on YARN-7410: A couple issues: # {{getResourceInformation(int)}} needs

[jira] [Updated] (YARN-2497) Changes for fair scheduler to support allocate resource respect labels

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-2497: --- Attachment: YARN-2497.011.patch Rebased to latest trunk. > Changes for fair scheduler to

[jira] [Commented] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225433#comment-16225433 ] Daniel Templeton commented on YARN-7410: Since this JIRA doesn't actually do anything about the

[jira] [Issue Comment Deleted] (YARN-7410) Cleanup FixedValueResource to avoid dependency to ResourceUtils

2017-10-30 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7410: --- Comment: was deleted (was: Since this JIRA doesn't actually do anything about the

[jira] [Commented] (YARN-7159) Normalize unit of resource objects in RM and avoid to do unit conversion in critical path

2017-10-30 Thread Manikandan R (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16225426#comment-16225426 ] Manikandan R commented on YARN-7159: TestClientRMService failure is related to this patch, other unit

  1   2   >