[jira] [Commented] (YARN-2889) Limit in the number of opportunistic container requests per AM

2017-11-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270401#comment-16270401 ] Konstantinos Karanasos commented on YARN-2889: -- To add to what [~asuresh] described, an extra

[jira] [Comment Edited] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2017-11-29 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270367#comment-16270367 ] maobaolong edited comment on YARN-7560 at 11/29/17 8:11 AM: (y)Looks good to

[jira] [Commented] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2017-11-29 Thread maobaolong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270367#comment-16270367 ] maobaolong commented on YARN-7560: -- Looks good to me, thank you for fix this big bug, it can really can

[jira] [Updated] (YARN-5542) Scheduling of opportunistic containers

2017-11-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5542: - Summary: Scheduling of opportunistic containers (was: Enhancements to

[jira] [Updated] (YARN-7575) NPE in scheduler UI when max-capacity is not configured

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7575: -- Summary: NPE in scheduler UI when max-capacity is not configured (was: When using absolute capacity

[jira] [Updated] (YARN-7510) Merge work for YARN-5881

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7510: -- Attachment: YARN-7510.004.patch branch is rebased. running against latest trunk. > Merge work for YARN-5881 >

[jira] [Commented] (YARN-5542) Scheduling of opportunistic containers

2017-11-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270416#comment-16270416 ] Konstantinos Karanasos commented on YARN-5542: -- bq. If there is such document available,

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270464#comment-16270464 ] genericqa commented on YARN-6669: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.005.patch > Add HDFSSchedulerConfigurationStore for RM HA >

[jira] [Updated] (YARN-7580) ContainersMonitorImpl logged message lacks detail when exceeding memory limits

2017-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg updated YARN-7580: Attachment: YARN-7580.002.patch Typos in the log entry fixed >

[jira] [Commented] (YARN-7580) ContainersMonitorImpl logged message lacks detail when exceeding memory limits

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270642#comment-16270642 ] genericqa commented on YARN-7580: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-29 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7274: Attachment: YARN-7274.wip.1.patch > Ability to disable elasticity at leaf queue level >

[jira] [Comment Edited] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270531#comment-16270531 ] Sunil G edited comment on YARN-7487 at 11/29/17 10:07 AM: -- Thanks [~leftnoteasy],

[jira] [Commented] (YARN-5542) Scheduling of opportunistic containers

2017-11-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270595#comment-16270595 ] Weiwei Yang commented on YARN-5542: --- bq. Feel free to post more questions or any other findings here, so

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270525#comment-16270525 ] Jiandan Yang commented on YARN-7497: - [~gphillips] I have moved those two static constant into

[jira] [Commented] (YARN-2889) Limit in the number of opportunistic container requests per AM

2017-11-29 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270591#comment-16270591 ] Weiwei Yang commented on YARN-2889: --- Thanks [~asuresh], [~kkaranasos] for the quick response. I don't

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-29 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270439#comment-16270439 ] Zian Chen commented on YARN-7274: - [~leftnoteasy] Hi Wangda, I just uploaded the first patch for the

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270497#comment-16270497 ] Jiandan Yang commented on YARN-7497: - [~jhung] Please help me to review and give me some comment about

[jira] [Commented] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270531#comment-16270531 ] Sunil G commented on YARN-7487: --- Thanks [~leftnoteasy], Looks fine. Only point, from my above comment, #4 is

[jira] [Comment Edited] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270531#comment-16270531 ] Sunil G edited comment on YARN-7487 at 11/29/17 10:07 AM: -- Thanks [~leftnoteasy],

[jira] [Commented] (YARN-7092) [YARN-3368] Log viewer in application page in yarn-ui-v2

2017-11-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270552#comment-16270552 ] ASF GitHub Bot commented on YARN-7092: -- Github user skmvasu commented on the issue:

[jira] [Commented] (YARN-7092) [YARN-3368] Log viewer in application page in yarn-ui-v2

2017-11-29 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270551#comment-16270551 ] ASF GitHub Bot commented on YARN-7092: -- GitHub user skmvasu opened a pull request:

[jira] [Updated] (YARN-7562) queuePlacementPolicy should not match parent queue

2017-11-29 Thread chuanjie.duan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] chuanjie.duan updated YARN-7562: Attachment: YARN-7562.003.patch Add unit test for parent queue, Patch logic changed, only policy

[jira] [Created] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7581: Summary: ATSv2 does not construct HBase filters correctly in HBase 2.0 Key: YARN-7581 URL: https://issues.apache.org/jira/browse/YARN-7581 Project: Hadoop YARN

[jira] [Updated] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7581: - Issue Type: Sub-task (was: Bug) Parent: YARN-7213 > ATSv2 does not construct HBase filters

[jira] [Commented] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270687#comment-16270687 ] genericqa commented on YARN-7497: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7510) Merge work for YARN-5881

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270726#comment-16270726 ] genericqa commented on YARN-7510: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270818#comment-16270818 ] Sunil G commented on YARN-7473: --- Thanks [~suma.shivaprasad] and [~leftnoteasy] Few comments: # Once queue

[jira] [Commented] (YARN-7533) Documentation for absolute resource support in CS

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271139#comment-16271139 ] Sunil G commented on YARN-7533: --- Thanks [~eepayne]. Committing shortly. > Documentation for absolute

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.10.patch > Support security for YARN service framework >

[jira] [Commented] (YARN-7577) Unit Fail: TestAMRestart#testPreemptedAMRestartOnRMRestart

2017-11-29 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271256#comment-16271256 ] Miklos Szegedi commented on YARN-7577: -- The unit test issues are unrelated. > Unit Fail:

[jira] [Updated] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7581: - Description: TestTimelineReaderWebServicesHBaseStorage.testGetEntitiesConfigFilters() and

[jira] [Commented] (YARN-7558) "yarn logs" command fails to get logs for running containers if UI authentication is enabled.

2017-11-29 Thread Xuan Gong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271283#comment-16271283 ] Xuan Gong commented on YARN-7558: - Thanks,[~djp] for the review. bq. is it possible to add a UT to cover

[jira] [Commented] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271360#comment-16271360 ] Haibo Chen commented on YARN-7581: -- We have the relevant data (entity 5 that is supposed to be returned in

[jira] [Updated] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7581: - Attachment: YARN-7581.prelim.patch > ATSv2 does not construct HBase filters correctly in HBase 2.0 >

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-29 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7541: --- Attachment: YARN-7541.branch-3.0.001.patch branch-3.0 patch that fixes trivial

[jira] [Commented] (YARN-7562) queuePlacementPolicy should not match parent queue

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271064#comment-16271064 ] genericqa commented on YARN-7562: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7533) Documentation for absolute resource support in Capacity Scheduler

2017-11-29 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7533: -- Summary: Documentation for absolute resource support in Capacity Scheduler (was: Documentation for absolute

[jira] [Commented] (YARN-7495) Improve robustness of the AggregatedLogDeletionService

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271693#comment-16271693 ] genericqa commented on YARN-7495: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7438: - Attachment: YARN-7438.003.patch Attached ver.3 patch. Fixed ASF License warning. [~asuresh] / [~sunilg],

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271574#comment-16271574 ] genericqa commented on YARN-7541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7522) Add application tags manager implementation

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7522: - Attachment: YARN-7522.YARN-6592.002.patch Thanks [~asuresh] for your comments. For #1, We can do this in

[jira] [Assigned] (YARN-7572) Make the service status output more readable

2017-11-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-7572: --- Assignee: Chandni Singh > Make the service status output more readable >

[jira] [Commented] (YARN-7558) "yarn logs" command fails to get logs for running containers if UI authentication is enabled.

2017-11-29 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271586#comment-16271586 ] Junping Du commented on YARN-7558: -- Thanks for reply, Xuan! Agree that this is not easy to add a UT and

[jira] [Commented] (YARN-7565) Yarn service pre-maturely releases the container after AM restart

2017-11-29 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271625#comment-16271625 ] Jian He commented on YARN-7565: --- - onContainersFromPreviousAttempts ->

[jira] [Created] (YARN-7582) Yarn Services - restore descriptive exception types

2017-11-29 Thread Sergey Shelukhin (JIRA)
Sergey Shelukhin created YARN-7582: -- Summary: Yarn Services - restore descriptive exception types Key: YARN-7582 URL: https://issues.apache.org/jira/browse/YARN-7582 Project: Hadoop YARN

[jira] [Created] (YARN-7584) Support resource profiles in native services

2017-11-29 Thread Jonathan Hung (JIRA)
Jonathan Hung created YARN-7584: --- Summary: Support resource profiles in native services Key: YARN-7584 URL: https://issues.apache.org/jira/browse/YARN-7584 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7584) Support resource profiles in native services

2017-11-29 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7584: Issue Type: Sub-task (was: Improvement) Parent: YARN-7054 > Support resource profiles in

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271901#comment-16271901 ] genericqa commented on YARN-7540: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7497) Add HDFSSchedulerConfigurationStore for RM HA

2017-11-29 Thread Jiandan Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiandan Yang updated YARN-7497: Attachment: YARN-7497.006.patch fix TestYarnConfigurationFields fail > Add

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272114#comment-16272114 ] genericqa commented on YARN-7522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.prelim1.patch > Fix compilation errors against hbase2 alpha release >

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271852#comment-16271852 ] Haibo Chen commented on YARN-7346: -- update the patch to address issues identified in the jenkins reports

[jira] [Commented] (YARN-7562) queuePlacementPolicy should not match parent queue

2017-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272151#comment-16272151 ] Wilfred Spiegelenburg commented on YARN-7562: - I think you are going the wrong direction: this

[jira] [Commented] (YARN-7573) Gpu Information page could be empty for nodes without GPU

2017-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272031#comment-16272031 ] Hudson commented on YARN-7573: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13294 (See

[jira] [Updated] (YARN-7522) Add application tags manager implementation

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-7522: - Attachment: YARN-7522.YARN-6592.003.patch Attached ver.3 patch solved UT failures / javadocs / findbugs

[jira] [Commented] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2017-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272149#comment-16272149 ] Wilfred Spiegelenburg commented on YARN-7560: - [~c61...@163.com] I don't think a sweeping

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271824#comment-16271824 ] genericqa commented on YARN-7522: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7455) quote_and_append_arg can overflow buffer

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271904#comment-16271904 ] genericqa commented on YARN-7455: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7438) Additional changes to make SchedulingPlacementSet agnostic to ResourceRequest / placement algorithm

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271810#comment-16271810 ] genericqa commented on YARN-7438: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-5594) Handle old RMDelegationToken format when recovering RM

2017-11-29 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter reassigned YARN-5594: --- Assignee: Robert Kanter Affects Version/s: (was: 2.7.0)

[jira] [Updated] (YARN-7578) Extend TestDiskFailures.waitForDiskHealthCheck() sleeping time.

2017-11-29 Thread Guangming Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guangming Zhang updated YARN-7578: -- Attachment: YARN-7578.0.patch > Extend TestDiskFailures.waitForDiskHealthCheck() sleeping time.

[jira] [Updated] (YARN-5594) Handle old RMDelegationToken format when recovering RM

2017-11-29 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Kanter updated YARN-5594: Attachment: YARN-5594.002.patch The 002 patch: - It turns out that the {{readOldFormatFields}} code

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.002.patch - Fixed styling issues. > Convert yarn app cli to call yarn api services >

[jira] [Commented] (YARN-7573) Gpu Information page could be empty for nodes without GPU

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271995#comment-16271995 ] Wangda Tan commented on YARN-7573: -- Thanks [~sunilg], tested on GPU cluster. +1 to the patch, committing

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled

2017-11-29 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272056#comment-16272056 ] Ray Chiang commented on YARN-7381: -- [~leftnoteasy], I believe launch_container.sh contains all the

[jira] [Commented] (YARN-7381) Enable the configuration: yarn.nodemanager.log-container-debug-info.enabled

2017-11-29 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272084#comment-16272084 ] Ray Chiang commented on YARN-7381: -- Also, it's my understanding that there will be overhead of 2 files per

[jira] [Commented] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2017-11-29 Thread xiayang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272107#comment-16272107 ] xiayang commented on YARN-7560: --- Int type overflow is very common in the hadoop, because many variables that

[jira] [Commented] (YARN-7580) ContainersMonitorImpl logged message lacks detail when exceeding memory limits

2017-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272133#comment-16272133 ] Wilfred Spiegelenburg commented on YARN-7580: - Failure does not seem related to the change:

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272134#comment-16272134 ] genericqa commented on YARN-7346: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272196#comment-16272196 ] Vrushali C commented on YARN-7213: -- Thanks for the patch [~haibo.chen] on YARN-7346 for hbase 2.x

[jira] [Commented] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272200#comment-16272200 ] Vrushali C commented on YARN-7346: -- Thanks [~haibo.chen] , catching up on hbase atsv2 jiras. I believe the

[jira] [Created] (YARN-7585) NodeManager should go unhealthy when state store throws DBException

2017-11-29 Thread Wilfred Spiegelenburg (JIRA)
Wilfred Spiegelenburg created YARN-7585: --- Summary: NodeManager should go unhealthy when state store throws DBException Key: YARN-7585 URL: https://issues.apache.org/jira/browse/YARN-7585

[jira] [Commented] (YARN-7522) Add application tags manager implementation

2017-11-29 Thread Konstantinos Karanasos (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272227#comment-16272227 ] Konstantinos Karanasos commented on YARN-7522: -- Thanks for working on this, [~leftnoteasy] --

[jira] [Updated] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7346: - Attachment: YARN-7346.prelim2.patch > Fix compilation errors against hbase2 alpha release >

[jira] [Updated] (YARN-7537) [Atsv2] load hbase configuration from filesystem rather than URL

2017-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-7537: - Issue Type: Sub-task (was: Bug) Parent: YARN-7055 > [Atsv2] load hbase configuration from

[jira] [Updated] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-11-29 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei Yan updated YARN-6851: -- Fix Version/s: 2.9.1 2.10.0 3.1.0 > Capacity Scheduler: document configs

[jira] [Commented] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-11-29 Thread Wei Yan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271703#comment-16271703 ] Wei Yan commented on YARN-6851: --- Thanks for the review, [~wangda]. Committed to branch-2, branch-2.9 and

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: (was: YARN-7540.001.patch) > Convert yarn app cli to call yarn api services >

[jira] [Updated] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7540: Attachment: YARN-7540.001.patch > Convert yarn app cli to call yarn api services >

[jira] [Assigned] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-7540: --- Assignee: Eric Yang > Convert yarn app cli to call yarn api services >

[jira] [Commented] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271731#comment-16271731 ] Hudson commented on YARN-6851: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13293 (See

[jira] [Updated] (YARN-7455) quote_and_append_arg can overflow buffer

2017-11-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-7455: -- Attachment: YARN-7455.001.patch I am attaching a patch that addresses the buffer overflow issues

[jira] [Commented] (YARN-7537) [Atsv2] load hbase configuration from filesystem rather than URL

2017-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271751#comment-16271751 ] Vrushali C commented on YARN-7537: -- Okay, sounds good. thanks! > [Atsv2] load hbase configuration from

[jira] [Created] (YARN-7583) Reduce overhead of container reacquisition

2017-11-29 Thread Jason Lowe (JIRA)
Jason Lowe created YARN-7583: Summary: Reduce overhead of container reacquisition Key: YARN-7583 URL: https://issues.apache.org/jira/browse/YARN-7583 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-7274) Ability to disable elasticity at leaf queue level

2017-11-29 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7274?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271916#comment-16271916 ] Zian Chen commented on YARN-7274: - I want to show the Queue configuration for the UT I wrote for the

[jira] [Commented] (YARN-7540) Convert yarn app cli to call yarn api services

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16272098#comment-16272098 ] genericqa commented on YARN-7540: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Resolved] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-7509. -- Resolution: Fixed Fix Version/s: (was: 3.0.1) 3.0.0 > AsyncScheduleThread

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271858#comment-16271858 ] Wangda Tan commented on YARN-7509: -- Thanks [~andrew.wang], just backported to branch-3.0.0. [~subru],

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271879#comment-16271879 ] Eric Yang commented on YARN-6669: - ServiceScheduler tries to register the application in zookeeper, but it

[jira] [Commented] (YARN-7581) ATSv2 does not construct HBase filters correctly in HBase 2.0

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271415#comment-16271415 ] Haibo Chen commented on YARN-7581: -- The final HBase filter is constructed in entity readers as A

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271419#comment-16271419 ] Hudson commented on YARN-7541: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13291 (See

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271427#comment-16271427 ] Wangda Tan commented on YARN-6124: -- Thanks [~Zian Chen], +1 to the latest patch. [~eepayne], do you

[jira] [Commented] (YARN-2889) Limit in the number of opportunistic container requests per AM

2017-11-29 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271444#comment-16271444 ] Arun Suresh commented on YARN-2889: --- bq. I don't think you can expect user to respect this limit, at

[jira] [Commented] (YARN-6851) Capacity Scheduler: document configs for controlling # containers allowed to be allocated per node heartbeat

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271424#comment-16271424 ] genericqa commented on YARN-6851: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-29 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271422#comment-16271422 ] genericqa commented on YARN-6669: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7213) [Umbrella] Test and validate HBase-2.0.x with Atsv2

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271425#comment-16271425 ] Haibo Chen commented on YARN-7213: -- [~rohithsharma] Thanks for your comments! I have submitted a patch

[jira] [Commented] (YARN-7487) Make sure volume includes GPU base libraries exists after created by plugin

2017-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271278#comment-16271278 ] Wangda Tan commented on YARN-7487: -- [~sunilg], #4 is not a problem, since we only use create/ls, inspect

[jira] [Commented] (YARN-6124) Make SchedulingEditPolicy can be enabled / disabled / updated with RMAdmin -refreshQueues

2017-11-29 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271302#comment-16271302 ] Zian Chen commented on YARN-6124: - For the two unit test failures, TestNodeLabelContainerAllocation was not

[jira] [Comment Edited] (YARN-7346) Fix compilation errors against hbase2 alpha release

2017-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16271276#comment-16271276 ] Haibo Chen edited comment on YARN-7346 at 11/29/17 6:14 PM: Attached a patch

  1   2   >