[jira] [Assigned] (YARN-8647) Add a flag to disable move app between queues

2018-08-10 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Modi reassigned YARN-8647: --- Assignee: Abhishek Modi > Add a flag to disable move app between queues >

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576838#comment-16576838 ] Eric Yang commented on YARN-8520: - Thank you [~shaneku...@gmail.com]. > Document best practice for user

[jira] [Updated] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.2.patch > Need to add "SUCCEED" state to YARN service >

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576877#comment-16576877 ] Suma Shivaprasad commented on YARN-8488: Attached patch which adds states SUCCEEDED to

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576900#comment-16576900 ] Zian Chen commented on YARN-8509: - Hi [~eepayne], sure, let address these two questions, 1) the summation

[jira] [Updated] (YARN-8160) Yarn Service Upgrade: Support upgrade of service that use docker containers

2018-08-10 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8160: Attachment: YARN-8160.002.patch > Yarn Service Upgrade: Support upgrade of service that use docker

[jira] [Updated] (YARN-8640) Restore previous state in container-executor if write_exit_code_file_as_nm fails

2018-08-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-8640: -- Attachment: YARN-8640.001.patch > Restore previous state in container-executor if

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2018-08-10 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576384#comment-16576384 ] Sean Busbey commented on YARN-7190: --- fix version now updated and filed YARN-8646 for myself to track

[jira] [Created] (YARN-8646) republish 3.0.3 release notes so they include YARN-7190

2018-08-10 Thread Sean Busbey (JIRA)
Sean Busbey created YARN-8646: - Summary: republish 3.0.3 release notes so they include YARN-7190 Key: YARN-8646 URL: https://issues.apache.org/jira/browse/YARN-8646 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8561) [Submarine] Add initial implementation: training job submission and job history retrieve.

2018-08-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576613#comment-16576613 ] Sunil Govindan commented on YARN-8561: -- Thanks [~leftnoteasy], Overall looks good to me Will create

[jira] [Updated] (YARN-8647) Add a flag to disable move queue

2018-08-10 Thread sarun singla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sarun singla updated YARN-8647: --- Description: For large clusters where we have a number of users submitting application, we can

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: This Jira is focus on refactor code for IndexedFileAggregatedLogsBlock We have duplicate code

[jira] [Comment Edited] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576875#comment-16576875 ] Yufei Gu edited comment on YARN-8632 at 8/10/18 9:28 PM: - Your patch doesn't apply

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576875#comment-16576875 ] Yufei Gu commented on YARN-8632: Your patch doesn't apply to trunk? You said the bug is in trunk as well,

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-08-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576916#comment-16576916 ] Jim Brennan commented on YARN-8648: --- One proposal to fix the leaking cgroups is to have docker put its

[jira] [Commented] (YARN-8569) Create an interface to provide cluster information to application

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576681#comment-16576681 ] Shane Kumpf commented on YARN-8569: --- Thanks for filing this [~eyang]. I have a use case that could

[jira] [Created] (YARN-8647) Add a flag to disable move queue

2018-08-10 Thread sarun (JIRA)
sarun created YARN-8647: --- Summary: Add a flag to disable move queue Key: YARN-8647 URL: https://issues.apache.org/jira/browse/YARN-8647 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576732#comment-16576732 ] Eric Yang commented on YARN-7417: - [~Zian Chen] Thank you for the patch. Is it possible to reuse

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576795#comment-16576795 ] genericqa commented on YARN-8559: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.1.patch > Need to add "SUCCEED" state to YARN service >

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576832#comment-16576832 ] Shane Kumpf commented on YARN-8520: --- Thanks for the contribution, [~eyang]! I committed this to trunk

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576840#comment-16576840 ] Hudson commented on YARN-8520: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14749 (See

[jira] [Updated] (YARN-8648) Container cgroups are leaked when using docker

2018-08-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jim Brennan updated YARN-8648: -- Labels: Docker (was: ) > Container cgroups are leaked when using docker >

[jira] [Commented] (YARN-8648) Container cgroups are leaked when using docker

2018-08-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576855#comment-16576855 ] Jim Brennan commented on YARN-8648: --- Another problem we have seen is that container-executor still has

[jira] [Updated] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.2.patch > Need to add "SUCCEED" state to YARN service >

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576888#comment-16576888 ] genericqa commented on YARN-8488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6495) check docker container's exit code when writing to cgroup task files

2018-08-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576925#comment-16576925 ] Jim Brennan commented on YARN-6495: --- As part of YARN-8648, I am proposing that we can just remove the

[jira] [Commented] (YARN-8160) Yarn Service Upgrade: Support upgrade of service that use docker containers

2018-08-10 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576924#comment-16576924 ] Chandni Singh commented on YARN-8160: - Patch 2 contains the two fixes: 1. Exit code 255 during

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Attachment: YARN-7417.003.patch > re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to

[jira] [Commented] (YARN-8523) Interactive docker shell

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576697#comment-16576697 ] Zian Chen commented on YARN-8523: - Good point, I think we can make this Jira focus on building this

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: This Jira is focus on refactor code for IndexedFileAggregatedLogsBlock and 

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576825#comment-16576825 ] genericqa commented on YARN-8488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8648) Container cgroups are leaked when using docker

2018-08-10 Thread Jim Brennan (JIRA)
Jim Brennan created YARN-8648: - Summary: Container cgroups are leaked when using docker Key: YARN-8648 URL: https://issues.apache.org/jira/browse/YARN-8648 Project: Hadoop YARN Issue Type: Bug

[jira] [Comment Edited] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16573997#comment-16573997 ] Zian Chen edited comment on YARN-8509 at 8/10/18 9:21 PM: -- Hi Eric, thanks for

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576878#comment-16576878 ] genericqa commented on YARN-8488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: (was: YARN-8488.2.patch) > Need to add "SUCCEED" state to YARN service >

[jira] [Updated] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.3.patch > Need to add "SUCCEED" state to YARN service >

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576934#comment-16576934 ] genericqa commented on YARN-8488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576935#comment-16576935 ] Jonathan Hung commented on YARN-8559: - Thx [~cheersyang]! Unit test failures in branch-3.0 also fail

[jira] [Updated] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8559: Fix Version/s: 3.0.4 2.10.0 > Expose mutable-conf scheduler's configuration in

[jira] [Updated] (YARN-8647) Add a flag to disable move queue

2018-08-10 Thread sarun singla (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sarun singla updated YARN-8647: --- Description: For large clusters where we have a number of users submitting application, we can

[jira] [Updated] (YARN-8647) Add a flag to disable move app between queues

2018-08-10 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8647: - Summary: Add a flag to disable move app between queues (was: Add a flag to disable move queue) > Add a

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576769#comment-16576769 ] genericqa commented on YARN-7494: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-7417: Description: We have duplicate code in current implementation of  IndexedFileAggregatedLogsBlock and  >

[jira] [Comment Edited] (YARN-8523) Interactive docker shell

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576801#comment-16576801 ] Eric Yang edited comment on YARN-8523 at 8/10/18 8:21 PM: -- [~Zian Chen] #

[jira] [Commented] (YARN-8523) Interactive docker shell

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576801#comment-16576801 ] Eric Yang commented on YARN-8523: - [~Zian Chen] # Without step 2 session management, the terminal session

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576917#comment-16576917 ] Zian Chen commented on YARN-7417: - But looks like we can make AggregatedLogFormat.ContainerLogsReader to

[jira] [Assigned] (YARN-8523) Interactive docker shell

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8523: --- Assignee: Zian Chen > Interactive docker shell > > > Key:

[jira] [Commented] (YARN-7129) Application Catalog for YARN applications

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576947#comment-16576947 ] Eric Yang commented on YARN-7129: - The failed hdfs unit tests are not related to this patch. >

[jira] [Commented] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576342#comment-16576342 ] Eric Payne commented on YARN-8509: -- [~Zian Chen], can I please get a couple of clarifications?

[jira] [Assigned] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu reassigned YARN-8632: -- Assignee: Xianghao Lu > No data in file realtimetrack.json after running SchedulerLoadSimulator >

[jira] [Comment Edited] (YARN-8509) Total pending resource calculation in preemption should use user-limit factor instead of minimum-user-limit-percent

2018-08-10 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576342#comment-16576342 ] Eric Payne edited comment on YARN-8509 at 8/10/18 6:12 PM: --- [~Zian Chen], can I

[jira] [Commented] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2018-08-10 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576370#comment-16576370 ] Sean Busbey commented on YARN-7190: --- Today I dug through the git history and branch-3.0. I can confirm

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576597#comment-16576597 ] Shane Kumpf commented on YARN-8520: --- Thanks for the updated patch, [~eyang]! +1 on the latest patch.

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576565#comment-16576565 ] genericqa commented on YARN-8520: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2018-08-10 Thread Sean Busbey (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Busbey updated YARN-7190: -- Fix Version/s: 3.0.3 > Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user >

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-08-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576395#comment-16576395 ] Sunil Govindan commented on YARN-7957: -- Thanks [~akhilpb] Makes sense to me. Pls help to implement

[jira] [Updated] (YARN-7935) Expose container's hostname to applications running within the docker container

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7935: Parent Issue: YARN-8472 (was: YARN-3611) > Expose container's hostname to applications running within the

[jira] [Updated] (YARN-7994) Add support for network-alias in docker run for user defined networks

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-7994: Parent Issue: YARN-8472 (was: YARN-3611) > Add support for network-alias in docker run for user defined

[jira] [Commented] (YARN-8623) Update Docker examples to use image which exists

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576655#comment-16576655 ] Shane Kumpf commented on YARN-8623: --- [~ccondit-target] - thanks for looking into this. I see what you

[jira] [Updated] (YARN-8520) Document best practice for user management

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8520: Attachment: YARN-8520.005.patch > Document best practice for user management >

[jira] [Updated] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8559: Attachment: YARN-8559-branch-2.001.patch > Expose mutable-conf scheduler's configuration in RM

[jira] [Updated] (YARN-8559) Expose mutable-conf scheduler's configuration in RM /scheduler-conf endpoint

2018-08-10 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8559: Attachment: (was: YARN-8559-branch-2.001.patch) > Expose mutable-conf scheduler's configuration

[jira] [Comment Edited] (YARN-8623) Update Docker examples to use image which exists

2018-08-10 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576655#comment-16576655 ] Shane Kumpf edited comment on YARN-8623 at 8/10/18 6:07 PM: [~ccondit-target]

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-08-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7494: - Attachment: YARN-7494.14.patch > Add muti node lookup support for better placement >

[jira] [Commented] (YARN-8632) No data in file realtimetrack.json after running SchedulerLoadSimulator

2018-08-10 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1657#comment-1657 ] Yufei Gu commented on YARN-8632: Added you to the contributor list and assign this to you. Will review

[jira] [Commented] (YARN-8520) Document best practice for user management

2018-08-10 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576501#comment-16576501 ] Eric Yang commented on YARN-8520: - [~shaneku...@gmail.com] Thanks for the feedback offline. Patch 005

[jira] [Commented] (YARN-7494) Add muti node lookup support for better placement

2018-08-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576604#comment-16576604 ] Sunil Govindan commented on YARN-7494: -- As discussed, removed updating multiNodePolicyName in Queue

[jira] [Updated] (YARN-8635) Container Resource localization fails if umask is 077

2018-08-10 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8635: --- Summary: Container Resource localization fails if umask is 077 (was: Container fails to

[jira] [Updated] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-8488: --- Attachment: YARN-8488.4.patch > Need to add "SUCCEED" state to YARN service >

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576964#comment-16576964 ] Suma Shivaprasad commented on YARN-8488: Rebased with trunk > Need to add "SUCCEED" state to YARN

[jira] [Comment Edited] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577000#comment-16577000 ] lujie edited comment on YARN-8649 at 8/11/18 1:27 AM: -- Stacktrace(I also upload the

[jira] [Updated] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8649: Description: I have noticed that a nodemanager was getting NPEs while tearing down. The reason maybe  similar to 

[jira] [Updated] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8649: Attachment: hadoop-hires-nodemanager-hadoop11.log > Same as YARN-4355:NPE while processing localizer heartbeat >

[jira] [Created] (YARN-8650) Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid event: CONTAINER_LAUNCHED at DONE

2018-08-10 Thread lujie (JIRA)
lujie created YARN-8650: --- Summary: Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid event: CONTAINER_LAUNCHED at DONE Key: YARN-8650 URL: https://issues.apache.org/jira/browse/YARN-8650 Project:

[jira] [Commented] (YARN-6972) Adding RM ClusterId in AppInfo

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577021#comment-16577021 ] genericqa commented on YARN-6972: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8488) Need to add "SUCCEED" state to YARN service

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576995#comment-16576995 ] genericqa commented on YARN-8488: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577000#comment-16577000 ] lujie edited comment on YARN-8649 at 8/11/18 1:24 AM: -- Stacktrace:   {code:java}

[jira] [Commented] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577000#comment-16577000 ] lujie commented on YARN-8649: - Stacktrace: java.io.IOException: java.lang.NullPointerException:

[jira] [Comment Edited] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577000#comment-16577000 ] lujie edited comment on YARN-8649 at 8/11/18 1:50 AM: -- Stacktrace(I also upload the

[jira] [Comment Edited] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577000#comment-16577000 ] lujie edited comment on YARN-8649 at 8/11/18 1:48 AM: -- Stacktrace(I also upload the

[jira] [Created] (YARN-8651) We must increase min Resource in FairScheduler after increase number of NM

2018-08-10 Thread stefanlee (JIRA)
stefanlee created YARN-8651: --- Summary: We must increase min Resource in FairScheduler after increase number of NM Key: YARN-8651 URL: https://issues.apache.org/jira/browse/YARN-8651 Project: Hadoop YARN

[jira] [Commented] (YARN-8160) Yarn Service Upgrade: Support upgrade of service that use docker containers

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576981#comment-16576981 ] genericqa commented on YARN-8160: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8649: Description: I have noticed that a nodemanager was getting NPEs while tearing down. The reason maybe  similar to 

[jira] [Comment Edited] (YARN-8650) Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid event: CONTAINER_LAUNCHED at DONE

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577015#comment-16577015 ] lujie edited comment on YARN-8650 at 8/11/18 2:20 AM: -- I have uploaded the log files

[jira] [Commented] (YARN-8650) Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid event: CONTAINER_LAUNCHED at DONE

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577015#comment-16577015 ] lujie commented on YARN-8650: - I have uploaded the log that contains the exception. Please check! We also

[jira] [Commented] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16577017#comment-16577017 ] lujie commented on YARN-8649: - I also find another two InvalidStateTransitionException while nodemanger is

[jira] [Created] (YARN-8649) Same as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
lujie created YARN-8649: --- Summary: Same as YARN-4355:NPE while processing localizer heartbeat Key: YARN-8649 URL: https://issues.apache.org/jira/browse/YARN-8649 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-6972) Adding RM ClusterId in AppInfo

2018-08-10 Thread Tanuj Nayak (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tanuj Nayak updated YARN-6972: -- Attachment: YARN-6972.015.patch > Adding RM ClusterId in AppInfo > -- > >

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576978#comment-16576978 ] genericqa commented on YARN-7417: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8649) Similar as YARN-4355:NPE while processing localizer heartbeat

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8649: Summary: Similar as YARN-4355:NPE while processing localizer heartbeat (was: Same as YARN-4355:NPE while

[jira] [Updated] (YARN-8650) Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid event: CONTAINER_LAUNCHED at DONE

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8650: Attachment: hadoop-hires-nodemanager-hadoop11.log > Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid

[jira] [Updated] (YARN-8650) Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid event: CONTAINER_LAUNCHED at DONE

2018-08-10 Thread lujie (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] lujie updated YARN-8650: Attachment: hadoop-hires-nodemanager-hadoop15.log > Invalid event: CONTAINER_KILLED_ON_REQUEST at DONE and Invalid

[jira] [Commented] (YARN-7417) re-factory IndexedFileAggregatedLogsBlock and TFileAggregatedLogsBlock to remove duplicate codes

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576815#comment-16576815 ] Zian Chen commented on YARN-7417: - Thanks for the review [~eyang], that was my original plan to make it

[jira] [Comment Edited] (YARN-8648) Container cgroups are leaked when using docker

2018-08-10 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576855#comment-16576855 ] Jim Brennan edited comment on YARN-8648 at 8/10/18 9:37 PM: Another problem we

[jira] [Commented] (YARN-8523) Interactive docker shell

2018-08-10 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576945#comment-16576945 ] Zian Chen commented on YARN-8523: - Make sense. I'll work on provide an initial patch for this idea. Thanks

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575900#comment-16575900 ] genericqa commented on YARN-5683: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2018-08-10 Thread Yechao Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16575899#comment-16575899 ] Yechao Chen commented on YARN-5683: --- any updating? > Support specifying storage type for

[jira] [Commented] (YARN-8590) Fair scheduler promotion does not update container execution type and token

2018-08-10 Thread genericqa (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16576008#comment-16576008 ] genericqa commented on YARN-8590: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-7494) Add muti node lookup support for better placement

2018-08-10 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-7494: - Attachment: YARN-7494.13.patch > Add muti node lookup support for better placement >

  1   2   >