[jira] [Commented] (YARN-7527) Over-allocate node resource in async-scheduling mode of CapacityScheduler

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262015#comment-16262015 ] Hadoop QA commented on YARN-7527: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262100#comment-16262100 ] Hadoop QA commented on YARN-6507: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16262039#comment-16262039 ] Hadoop QA commented on YARN-6483: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7546) In queue page node details are hidden on click

2017-11-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260422#comment-16260422 ] ASF GitHub Bot commented on YARN-7546: -- Github user skmvasu commented on the issue:

[jira] [Commented] (YARN-7546) In queue page node details are hidden on click

2017-11-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260420#comment-16260420 ] ASF GitHub Bot commented on YARN-7546: -- GitHub user skmvasu opened a pull request:

[jira] [Created] (YARN-7546) In queue page node details are hidden on click

2017-11-21 Thread Vasudevan Skm (JIRA)
Vasudevan Skm created YARN-7546: --- Summary: In queue page node details are hidden on click Key: YARN-7546 URL: https://issues.apache.org/jira/browse/YARN-7546 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7544: -- Attachment: YARN-7544-YARN-5881.001.patch v1 patch. > Configuration cleanup associated to support absolute

[jira] [Commented] (YARN-7290) canContainerBePreempted can return true when it shouldn't

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260535#comment-16260535 ] Yufei Gu commented on YARN-7290: Thanks for filing this issue and working on it, [~Steven Rand]. The issue

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260630#comment-16260630 ] Hadoop QA commented on YARN-7544: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260770#comment-16260770 ] Hadoop QA commented on YARN-5534: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7547) Throttle Localization for Opportunistic Containers in the NM

2017-11-21 Thread Arun Suresh (JIRA)
Arun Suresh created YARN-7547: - Summary: Throttle Localization for Opportunistic Containers in the NM Key: YARN-7547 URL: https://issues.apache.org/jira/browse/YARN-7547 Project: Hadoop YARN

[jira] [Commented] (YARN-7533) Documentation for absolute resource support in CS

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260884#comment-16260884 ] Hadoop QA commented on YARN-7533: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-21 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260882#comment-16260882 ] Jason Lowe commented on YARN-6647: -- Thanks for the patch! I agree with [~rohithsharma]'s comments. If

[jira] [Commented] (YARN-6921) Allow resource request to opt out of oversubscription in Fair Scheduler

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261046#comment-16261046 ] Haibo Chen commented on YARN-6921: -- TestIncreaseAllocationExpirer

[jira] [Updated] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5534: -- Attachment: YARN-5534.006.patch Thanks for the tip, [~eyang]. Attaching a new patch with those changes.

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-7541: --- Description: When I submit an MR job that asks for too much memory or CPU for the map or

[jira] [Updated] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-21 Thread Gergo Repas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gergo Repas updated YARN-4813: -- Attachment: YARN-4813.001.patch YARN-4813.001.patch: Disabling the replay cache for the duration of the

[jira] [Comment Edited] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261072#comment-16261072 ] Haibo Chen edited comment on YARN-7337 at 11/21/17 5:18 PM: The findbug issue

[jira] [Commented] (YARN-7548) TestCapacityOverTimePolicy.testAllocation is flaky

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261090#comment-16261090 ] Haibo Chen commented on YARN-7548: -- CC [~subru] > TestCapacityOverTimePolicy.testAllocation is flaky >

[jira] [Updated] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-7337: - Attachment: YARN-7337-YARN-1011.05.patch I have updated the patch to address your comments

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261038#comment-16261038 ] Eric Yang commented on YARN-5534: - [~shaneku...@gmail.com] This failure is caused by: {code} :: {code}

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261072#comment-16261072 ] Haibo Chen commented on YARN-7337: -- The findbug issue is unrelated. There were no unit test failure in the

[jira] [Created] (YARN-7548) TestCapacityOverTimePolicy.testAllocation is flaky

2017-11-21 Thread Haibo Chen (JIRA)
Haibo Chen created YARN-7548: Summary: TestCapacityOverTimePolicy.testAllocation is flaky Key: YARN-7548 URL: https://issues.apache.org/jira/browse/YARN-7548 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261100#comment-16261100 ] Hadoop QA commented on YARN-6647: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6750) Add a configuration to cap how much a NM can be overallocated

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261048#comment-16261048 ] Haibo Chen commented on YARN-6750: -- The findbug issue is unrelated and the checkstyle warning is bogus. >

[jira] [Commented] (YARN-7531) ResourceRequest.equal does not check ExecutionTypeRequest.enforceExecutionType()

2017-11-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261114#comment-16261114 ] Hudson commented on YARN-7531: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13265 (See

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16260762#comment-16260762 ] Sunil G commented on YARN-7544: --- YARN-7507 tracks test failures. Its unrelated to this patch. cc/

[jira] [Updated] (YARN-6647) RM can crash during transitionToStandby due to InterruptedException

2017-11-21 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-6647: --- Attachment: YARN-6647.003.patch Attaching updated patch > RM can crash during

[jira] [Updated] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shane Kumpf updated YARN-5534: -- Attachment: YARN-5534.005.patch Attaching patch to address the checkstyle warning. I'm not sure what is

[jira] [Assigned] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-7399: Assignee: Billie Rinaldi (was: Eric Yang) > Yarn services metadata storage improvement >

[jira] [Commented] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2017-11-21 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261256#comment-16261256 ] Grant Sohn commented on YARN-7451: -- Based on discussions with [~templedf], this should be part of the

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261258#comment-16261258 ] Hadoop QA commented on YARN-5534: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4813) TestRMWebServicesDelegationTokenAuthentication.testDoAs fails intermittently

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261264#comment-16261264 ] Hadoop QA commented on YARN-4813: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7513) Remove scheduler lock in FSAppAttempt.getWeight()

2017-11-21 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261283#comment-16261283 ] Hudson commented on YARN-7513: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13266 (See

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261291#comment-16261291 ] Haibo Chen commented on YARN-7390: -- Reopened to trigger the branch-2 jenkins job. > All reservation

[jira] [Assigned] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Billie Rinaldi reassigned YARN-7399: Assignee: Eric Yang (was: Billie Rinaldi) > Yarn services metadata storage improvement >

[jira] [Commented] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261167#comment-16261167 ] Billie Rinaldi commented on YARN-7399: -- [~eyang], thanks for providing the image, it makes the goals

[jira] [Updated] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7330: -- Attachment: YARN-7330.012.patch fixed js issues > Add support to show GPU on UI/metrics >

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261217#comment-16261217 ] Wangda Tan commented on YARN-7544: -- Thanks [~sunilg], patch looks good to me in general, only one comment:

[jira] [Updated] (YARN-6600) Introduce default and max lifetime of application at LeafQueue level

2017-11-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-6600: --- Description: Setting a timeout at the leaf queue level allows administrators to prevent badly

[jira] [Updated] (YARN-7513) Remove scheduler lock in FSAppAttempt.getWeight()

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7513: --- Summary: Remove scheduler lock in FSAppAttempt.getWeight() (was: FindBugs in FSAppAttempt.getWeight()) >

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261242#comment-16261242 ] Eric Payne commented on YARN-7496: -- Thanks for your review, [~leftnoteasy]. What's the next step? > CS

[jira] [Created] (YARN-7549) RM cluster scheduler API does not show resource types usage

2017-11-21 Thread Grant Sohn (JIRA)
Grant Sohn created YARN-7549: Summary: RM cluster scheduler API does not show resource types usage Key: YARN-7549 URL: https://issues.apache.org/jira/browse/YARN-7549 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-6964) Fair scheduler misuses Resources operations

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261310#comment-16261310 ] Yufei Gu commented on YARN-6964: Looks good to me generally. One question, why make demand double the usage

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261164#comment-16261164 ] Hadoop QA commented on YARN-7541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261337#comment-16261337 ] Eric Yang edited comment on YARN-7399 at 11/21/17 7:24 PM: --- Hi [~billie.rinaldi],

[jira] [Comment Edited] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261337#comment-16261337 ] Eric Yang edited comment on YARN-7399 at 11/21/17 7:25 PM: --- Hi [~billie.rinaldi],

[jira] [Commented] (YARN-7524) Remove unused FairSchedulerEventLog

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261340#comment-16261340 ] Yufei Gu commented on YARN-7524: Thanks for working on this, [~wilfreds]. The patch looks good to me. +1.

[jira] [Updated] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7399: Attachment: YARN-7399.002.patch [~billie.rinaldi], updated according to your suggestion. > Yarn services

[jira] [Commented] (YARN-7513) Remove scheduler lock in FSAppAttempt.getWeight()

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261249#comment-16261249 ] Yufei Gu commented on YARN-7513: Committed to trunk and branch-3.0. Thanks for the patch, [~wilfreds].

[jira] [Reopened] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen reopened YARN-7390: -- > All reservation related test cases failed when TestYarnClient runs against > Fair Scheduler. >

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261312#comment-16261312 ] Haibo Chen commented on YARN-7390: -- +1 on the branch-2 patch pending Jenkins. > All reservation related

[jira] [Commented] (YARN-7399) Yarn services metadata storage improvement

2017-11-21 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261337#comment-16261337 ] Eric Yang commented on YARN-7399: - Hi [~billie.rinaldi], YARN-7523 has a proposal for refining Service

[jira] [Commented] (YARN-7544) Configuration cleanup associated to support absolute resources in a queue

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261405#comment-16261405 ] Wangda Tan commented on YARN-7544: -- [~sunilg], I think we can use the following pattern: {code}

[jira] [Updated] (YARN-6669) Support security for YARN service framework

2017-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-6669: -- Attachment: YARN-6669.04.patch The new patch added some docs for the keytab related properties > Support

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261478#comment-16261478 ] Hadoop QA commented on YARN-7390: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7551) yarn.resourcemanager.reservation-system.max-periodicity is not in yarn-default.xml

2017-11-21 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7551: -- Summary: yarn.resourcemanager.reservation-system.max-periodicity is not in yarn-default.xml Key: YARN-7551 URL: https://issues.apache.org/jira/browse/YARN-7551

[jira] [Created] (YARN-7550) Allow YARN HA to be fault tolerant on missing DNS entries

2017-11-21 Thread Istvan Vajnorak (JIRA)
Istvan Vajnorak created YARN-7550: - Summary: Allow YARN HA to be fault tolerant on missing DNS entries Key: YARN-7550 URL: https://issues.apache.org/jira/browse/YARN-7550 Project: Hadoop YARN

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261422#comment-16261422 ] Wangda Tan commented on YARN-7330: -- I verified the last change works, thanks [~sunilg]. > Add support to

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261504#comment-16261504 ] Haibo Chen commented on YARN-7390: -- The unit test issue is bogus, no actual unit test failures caused by

[jira] [Commented] (YARN-7550) Allow YARN HA to be fault tolerant on missing DNS entries

2017-11-21 Thread Istvan Vajnorak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261412#comment-16261412 ] Istvan Vajnorak commented on YARN-7550: --- Please note that a similar DNS / IP resolution issue has

[jira] [Commented] (YARN-7473) Implement Framework and policy for capacity management of auto created queues

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261486#comment-16261486 ] Wangda Tan commented on YARN-7473: -- Thanks [~suma.shivaprasad], Comments: 1)

[jira] [Updated] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-6168: Attachment: YARN-6168.003.patch Fixed checkstyle. TestNodeLabelContainerAllocation failure is

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-21 Thread Jian He (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261552#comment-16261552 ] Jian He commented on YARN-6168: --- A minor optimization for pullPreviousAttemptContainers : we could add a

[jira] [Commented] (YARN-7330) Add support to show GPU on UI/metrics

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261530#comment-16261530 ] Hadoop QA commented on YARN-7330: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261429#comment-16261429 ] Wangda Tan commented on YARN-7496: -- [~eepayne], I just manually triggered Jenkins run, pending Jenkins. >

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261572#comment-16261572 ] Hadoop QA commented on YARN-7496: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6669) Support security for YARN service framework

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261579#comment-16261579 ] Hadoop QA commented on YARN-6669: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261629#comment-16261629 ] Wangda Tan commented on YARN-7509: -- Thanks [~Tao Yang], looks good, +1. [~asuresh], wanna take another

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261648#comment-16261648 ] Hadoop QA commented on YARN-7337: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261663#comment-16261663 ] Hadoop QA commented on YARN-7511: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-7554) TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9

2017-11-21 Thread Miklos Szegedi (JIRA)
Miklos Szegedi created YARN-7554: Summary: TestCryptoStreamsWithOpensslAesCtrCryptoCodec fails on Debian 9 Key: YARN-7554 URL: https://issues.apache.org/jira/browse/YARN-7554 Project: Hadoop YARN

[jira] [Commented] (YARN-5534) Allow user provided Docker volume mount list

2017-11-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261921#comment-16261921 ] Miklos Szegedi commented on YARN-5534: -- Thank you, [~shaneku...@gmail.com] for the patch. {code} 165

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261924#comment-16261924 ] Wangda Tan commented on YARN-6507: -- Thanks [~tangzhankun], in general the patch looks very clean and

[jira] [Comment Edited] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261924#comment-16261924 ] Wangda Tan edited comment on YARN-6507 at 11/22/17 3:31 AM: Thanks

[jira] [Updated] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Rodríguez Hortalá updated YARN-6483: - Attachment: YARN-6483.003.patch > Add nodes transitioning to DECOMMISSIONING state

[jira] [Commented] (YARN-6483) Add nodes transitioning to DECOMMISSIONING state to the list of updated nodes returned by the Resource Manager as a response to the Application Master heartbeat

2017-11-21 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261927#comment-16261927 ] Juan Rodríguez Hortalá commented on YARN-6483: -- Hi [~asuresh], I have added a new patch, and

[jira] [Commented] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-11-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261930#comment-16261930 ] Zhankun Tang commented on YARN-6507: [~wangda], Thanks for the reply. Yeah. Of course. I'll summarize

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261931#comment-16261931 ] Hadoop QA commented on YARN-7363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7533) Documentation for absolute resource support in CS

2017-11-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261565#comment-16261565 ] Eric Payne commented on YARN-7533: -- [~sunilg] this looks good to me. > Documentation for absolute

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261588#comment-16261588 ] Subru Krishnan commented on YARN-6704: -- Thanks [~botong] for updating the patch. I went through it and

[jira] [Commented] (YARN-7551) yarn.resourcemanager.reservation-system.max-periodicity is not in yarn-default.xml

2017-11-21 Thread Ray Chiang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261600#comment-16261600 ] Ray Chiang commented on YARN-7551: -- I see this in TestYarnConfigurationFields.java: {noformat}

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-21 Thread Miklos Szegedi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261650#comment-16261650 ] Miklos Szegedi commented on YARN-7363: -- Thank you, [~yufeigu] for the patch. {code} 488 //

[jira] [Commented] (YARN-7337) Expose per-node over-allocation info in Node Report

2017-11-21 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261668#comment-16261668 ] Haibo Chen commented on YARN-7337: -- NO unit test failures even though there is a -1 from unit test task.

[jira] [Created] (YARN-7552) RM REST containers endpoints are not documented

2017-11-21 Thread Daniel Templeton (JIRA)
Daniel Templeton created YARN-7552: -- Summary: RM REST containers endpoints are not documented Key: YARN-7552 URL: https://issues.apache.org/jira/browse/YARN-7552 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-21 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-6168: Attachment: YARN-6168.004.patch Addressed [~jianhe] in patch 4 > Restarted RM may not inform AM

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-21 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261617#comment-16261617 ] Eric Payne commented on YARN-7496: -- {code} hadoop.yarn.server.resourcemanager.TestClientRMTokens

[jira] [Commented] (YARN-7551) yarn.resourcemanager.reservation-system.max-periodicity is not in yarn-default.xml

2017-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261641#comment-16261641 ] Subru Krishnan commented on YARN-7551: -- Generally, we have been following the practice of exposing

[jira] [Commented] (YARN-7496) CS Intra-queue preemption user-limit calculations are not in line with LeafQueue user-limit calculations

2017-11-21 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261666#comment-16261666 ] Wangda Tan commented on YARN-7496: -- Thanks [~eepayne] for confirming this, I will commit this tomorrow if

[jira] [Commented] (YARN-7548) TestCapacityOverTimePolicy.testAllocation is flaky

2017-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261646#comment-16261646 ] Subru Krishnan commented on YARN-7548: -- Thanks [~haibo.chen] for reporting this. Adding [~curino] as

[jira] [Resolved] (YARN-7551) yarn.resourcemanager.reservation-system.max-periodicity is not in yarn-default.xml

2017-11-21 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton resolved YARN-7551. Resolution: Not A Problem OK. > yarn.resourcemanager.reservation-system.max-periodicity is

[jira] [Commented] (YARN-6168) Restarted RM may not inform AM about all existing containers

2017-11-21 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261678#comment-16261678 ] Hadoop QA commented on YARN-6168: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7533) Documentation for absolute resource support in CS

2017-11-21 Thread Sunil G (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-7533: -- Attachment: YARN-7533-YARN-5881.002.patch Thanks [~eepayne] Attaching patch correcting this. Also in another

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-21 Thread Arun Suresh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261846#comment-16261846 ] Arun Suresh commented on YARN-7509: --- Good catch [~Tao Yang]. +1 > AsyncScheduleThread and

[jira] [Commented] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261865#comment-16261865 ] Yufei Gu commented on YARN-7363: Thanks [~miklos.szeg...@cloudera.com] for the review. Uploaded patch v3

[jira] [Updated] (YARN-7363) ContainerLocalizer don't have a valid log4j config in case of Linux container executor

2017-11-21 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-7363: --- Attachment: YARN-7363.003.patch > ContainerLocalizer don't have a valid log4j config in case of Linux

[jira] [Updated] (YARN-7290) canContainerBePreempted can return true when it shouldn't

2017-11-21 Thread Steven Rand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steven Rand updated YARN-7290: -- Attachment: YARN-7290.004.patch Thanks for reviewing, [~yufeigu]! I've attached a new patch which

[jira] [Updated] (YARN-6507) Add support in NodeManager to isolate FPGA devices with CGroups

2017-11-21 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-6507: --- Attachment: YARN-6507-trunk.008.patch > Add support in NodeManager to isolate FPGA devices with

[jira] [Updated] (YARN-7549) RM cluster scheduler API does not show resource types usage

2017-11-21 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Sohn updated YARN-7549: - Component/s: fairscheduler > RM cluster scheduler API does not show resource types usage >

[jira] [Updated] (YARN-7549) RM cluster scheduler API does not show resource types usage for fair scheduler

2017-11-21 Thread Grant Sohn (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Grant Sohn updated YARN-7549: - Summary: RM cluster scheduler API does not show resource types usage for fair scheduler (was: RM cluster

  1   2   >