[jira] [Commented] (YARN-7901) Adding profile capability in resourceReq in LocalityMulticastAMRMProxyPolicy

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671144#comment-16671144 ] Hadoop QA commented on YARN-7901: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-4858: Target Version/s: 2.10.0 (was: 2.9.2) > start-yarn and stop-yarn scripts to support timeline and

[jira] [Updated] (YARN-7601) Incorrect container states recovered as LevelDB uses alphabetical order

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7601: Target Version/s: 2.9.3 (was: 2.9.2) > Incorrect container states recovered as LevelDB uses

[jira] [Updated] (YARN-6918) Remove acls after queue delete to avoid memory leak

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-6918: Target Version/s: 3.0.4, 2.9.3 (was: 3.0.2, 2.9.2) > Remove acls after queue delete to avoid

[jira] [Updated] (YARN-7450) ATS Client should retry on intermittent Kerberos issues.

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7450: Target Version/s: 2.9.3 (was: 2.9.2) > ATS Client should retry on intermittent Kerberos issues. >

[jira] [Updated] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7560: Fix Version/s: (was: 3.0.3) > Resourcemanager hangs when resourceUsedWithWeightToResourceRatio

[jira] [Updated] (YARN-7560) Resourcemanager hangs when resourceUsedWithWeightToResourceRatio return a overflow value

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7560: Target Version/s: 3.0.4 (was: 3.0.0) > Resourcemanager hangs when

[jira] [Updated] (YARN-7901) Adding profile capability in resourceReq in LocalityMulticastAMRMProxyPolicy

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7901: Fix Version/s: (was: 3.0.3) > Adding profile capability in resourceReq in

[jira] [Updated] (YARN-7649) RMContainer state transition exception after container update

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7649: Target Version/s: 3.0.4, 2.9.3 (was: 3.0.2, 2.9.2) > RMContainer state transition exception after

[jira] [Created] (YARN-8965) Revisit delay scheduling for cloud environment

2018-10-31 Thread Weiwei Yang (JIRA)
Weiwei Yang created YARN-8965: - Summary: Revisit delay scheduling for cloud environment Key: YARN-8965 URL: https://issues.apache.org/jira/browse/YARN-8965 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-10-31 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8948: --- Priority: Critical (was: Major) > PlacementRule interface should be for all YarnSchedulers >

[jira] [Updated] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-10-31 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8948: --- Description: *Issue 1:* YARN-3635 intention was to add PlacementRule interface common for

[jira] [Commented] (YARN-8394) Improve data locality documentation for Capacity Scheduler

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8394?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671119#comment-16671119 ] Weiwei Yang commented on YARN-8394: --- Hi [~yufeigu] Apologies I missed your last comment. Are you

[jira] [Updated] (YARN-8404) Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8404: Fix Version/s: 2.9.2 Thanks! Backported to branch-2.9. > Timeline event publish need to be async

[jira] [Updated] (YARN-7765) [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM

2018-10-31 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-7765: Target Version/s: 3.0.1, 3.1.0, 2.10.0 (was: 3.1.0, 2.10.0, 3.0.1) Fix Version/s: 2.9.2

[jira] [Updated] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-31 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-7277: --- Attachment: YARN-7277-trunk.004.patch > Container Launch expand environment needs to consider bracket

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671044#comment-16671044 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang], No worries. I saw it several times, it should not

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671030#comment-16671030 ] Tao Yang commented on YARN-8958: There is no UT failure but still got -1 for unit by Hadoop QA.

[jira] [Comment Edited] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671024#comment-16671024 ] Tao Yang edited comment on YARN-8958 at 11/1/18 2:09 AM: - Thanks [~cheersyang] for

[jira] [Updated] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8958: --- Description: We found a NPE in ClientRMService#getApplications when querying apps with specified queue. The

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671024#comment-16671024 ] Tao Yang commented on YARN-8958: Thanks [~cheersyang] for the review. {quote} In

[jira] [Commented] (YARN-8932) ResourceUtilization cpu is misused in oversubscription as a percentage

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671022#comment-16671022 ] Hadoop QA commented on YARN-8932: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8404) Timeline event publish need to be async to avoid Dispatcher thread leak in case ATS is down

2018-10-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671017#comment-16671017 ] Rohith Sharma K S commented on YARN-8404: - Yes, this need to be backported. > Timeline event

[jira] [Commented] (YARN-7765) [Atsv2] GSSException: No valid credentials provided - Failed to find any Kerberos tgt thrown by Timelinev2Client & HBaseClient in NM

2018-10-31 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671016#comment-16671016 ] Rohith Sharma K S commented on YARN-7765: - Yes, this need to be back ported to branch-2.9 because

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671007#comment-16671007 ] Hadoop QA commented on YARN-8914: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8778) Add Command Line interface to invoke interactive docker shell

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671005#comment-16671005 ] Hadoop QA commented on YARN-8778: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670962#comment-16670962 ] Jonathan Hung commented on YARN-7225: - BTW the trunk patch looks good to me, but I found neither this

[jira] [Comment Edited] (YARN-7225) Add queue and partition info to RM audit log

2018-10-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670926#comment-16670926 ] Jonathan Hung edited comment on YARN-7225 at 11/1/18 12:22 AM: --- Thanks

[jira] [Comment Edited] (YARN-7225) Add queue and partition info to RM audit log

2018-10-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670926#comment-16670926 ] Jonathan Hung edited comment on YARN-7225 at 11/1/18 12:21 AM: --- Thanks

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-31 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670926#comment-16670926 ] Jonathan Hung commented on YARN-7225: - Thanks [~eepayne], IMO #2 makes the most sense, at least for

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670851#comment-16670851 ] Hadoop QA commented on YARN-8958: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

2018-10-31 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670827#comment-16670827 ] Eric Payne commented on YARN-7225: -- Thanks [~jhung]. The behavior is slightly different depending on if

[jira] [Commented] (YARN-8854) Upgrade jquery datatable version references to v1.10.19

2018-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8854?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670743#comment-16670743 ] Hudson commented on YARN-8854: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15340 (See

[jira] [Commented] (YARN-6729) Clarify documentation on how to enable cgroup support

2018-10-31 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670744#comment-16670744 ] Hudson commented on YARN-6729: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15340 (See

[jira] [Commented] (YARN-8776) Container Executor change to create stdin/stdout pipeline

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670740#comment-16670740 ] Hadoop QA commented on YARN-8776: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8932) ResourceUtilization cpu is misused in oversubscription as a percentage

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670737#comment-16670737 ] Hadoop QA commented on YARN-8932: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8902) Add volume manager that manages CSI volume lifecycle

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670720#comment-16670720 ] Hadoop QA commented on YARN-8902: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8761) Service AM support for decommissioning component instances

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670722#comment-16670722 ] Hadoop QA commented on YARN-8761: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8932) ResourceUtilization cpu is misused in oversubscription as a percentage

2018-10-31 Thread Robert Kanter (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670670#comment-16670670 ] Robert Kanter commented on YARN-8932: - +1 pending Jenkins > ResourceUtilization cpu is misused in

[jira] [Updated] (YARN-8916) Define a constant "docker" string in "ContainerRuntimeConstants.java" for better maintainability

2018-10-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8916: -- Labels: Docker (was: ) > Define a constant "docker" string in "ContainerRuntimeConstants.java" for >

[jira] [Updated] (YARN-8927) Better handling of "docker.trusted.registries" in container-executor's "trusted_image_check" function

2018-10-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8927: -- Labels: Docker (was: ) > Better handling of "docker.trusted.registries" in container-executor's >

[jira] [Updated] (YARN-8949) Document usage of "library" in "docker.trusted.repositories" to trust local image

2018-10-31 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8949?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8949: -- Labels: Docker (was: ) > Document usage of "library" in "docker.trusted.repositories" to trust local

[jira] [Commented] (YARN-8867) Retrieve the status of resource localization

2018-10-31 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670503#comment-16670503 ] Chandni Singh commented on YARN-8867: - {quote} Is this status going to show up in Yarn Service JSON or

[jira] [Commented] (YARN-8960) Can't get submarine service status using the command of "yarn app -status" under security environment

2018-10-31 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670418#comment-16670418 ] Hadoop QA commented on YARN-8960: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8838) Add security check for container user is same as websocket user

2018-10-31 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8838: Attachment: YARN-8838.003.patch > Add security check for container user is same as websocket user >

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670258#comment-16670258 ] Weiwei Yang commented on YARN-8958: --- Hi [~Tao Yang] Thanks for creating the issue and the fix. I am

[jira] [Updated] (YARN-8960) Can't get submarine service status using the command of "yarn app -status" under security environment

2018-10-31 Thread Zac Zhou (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8960: --- Attachment: YARN-8960.003.patch > Can't get submarine service status using the command of "yarn app -status"

[jira] [Commented] (YARN-8954) Reservations list field in ReservationListInfo is not accessible

2018-10-31 Thread Oleksandr Shevchenko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669832#comment-16669832 ] Oleksandr Shevchenko commented on YARN-8954: The failed tests not related to the changes. All

[jira] [Commented] (YARN-7277) Container Launch expand environment needs to consider bracket matching

2018-10-31 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669692#comment-16669692 ] Weiwei Yang commented on YARN-7277: --- Hi [~tangzhankun] Thanks for creating this issue [~balloons] and

[jira] [Commented] (YARN-8961) [UI2] Flow Run End Time shows 'Invalid date'

2018-10-31 Thread Charan Hebri (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669690#comment-16669690 ] Charan Hebri commented on YARN-8961: [~akhilpb] below is the response for flow runs, {noformat} [ {

[jira] [Created] (YARN-8964) UI2 should use clusters/{cluster name} for all ATSv2 REST APIs

2018-10-31 Thread Rohith Sharma K S (JIRA)
Rohith Sharma K S created YARN-8964: --- Summary: UI2 should use clusters/{cluster name} for all ATSv2 REST APIs Key: YARN-8964 URL: https://issues.apache.org/jira/browse/YARN-8964 Project: Hadoop

[jira] [Commented] (YARN-8961) [UI2] Flow Run End Time shows 'Invalid date'

2018-10-31 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8961?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669677#comment-16669677 ] Akhil PB commented on YARN-8961: Hi [~charanh], Could you pls attach the flow runs response. The invalid