[jira] [Created] (YARN-8803) [UI2] Show flow runs in the order of recently created time in the table and graph widgets

2018-09-19 Thread Akhil PB (JIRA)
Akhil PB created YARN-8803: -- Summary: [UI2] Show flow runs in the order of recently created time in the table and graph widgets Key: YARN-8803 URL: https://issues.apache.org/jira/browse/YARN-8803 Project:

[jira] [Updated] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2018-09-19 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabha Manepalli updated YARN-8549: --- Attachment: (was: YARN-8549.v3.patch) > Adding a NoOp timeline writer and reader plugin

[jira] [Updated] (YARN-8549) Adding a NoOp timeline writer and reader plugin classes for ATSv2

2018-09-19 Thread Prabha Manepalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabha Manepalli updated YARN-8549: --- Attachment: YARN-8549.v3.patch > Adding a NoOp timeline writer and reader plugin classes for

[jira] [Commented] (YARN-8802) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env

2018-09-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621533#comment-16621533 ] Akira Ajisaka commented on YARN-8802: - Filed MAPREDUCE-7142 to add the options automatically. >

[jira] [Commented] (YARN-8802) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621528#comment-16621528 ] Hadoop QA commented on YARN-8802: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8802) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env

2018-09-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621520#comment-16621520 ] Akira Ajisaka commented on YARN-8802: - Tried the following settings and ran MapReduce job

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621509#comment-16621509 ] Hadoop QA commented on YARN-8769: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621499#comment-16621499 ] Hadoop QA commented on YARN-8793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8795) QueuePlacementRule move to separate files

2018-09-19 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8795: -- Attachment: YARN-8795.004.patch > QueuePlacementRule move to separate files >

[jira] [Updated] (YARN-7481) Gpu locality support for Better AI scheduling

2018-09-19 Thread Chen Qingcha (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chen Qingcha updated YARN-7481: --- Attachment: hadoop-2.9.0.gpu-port.20180920.patch > Gpu locality support for Better AI scheduling >

[jira] [Commented] (YARN-8802) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env

2018-09-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621477#comment-16621477 ] Akira Ajisaka commented on YARN-8802: - Move this to YARN project and raised the priority. This issue

[jira] [Moved] (YARN-8802) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env

2018-09-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka moved HADOOP-14984 to YARN-8802: -- Key: YARN-8802 (was: HADOOP-14984) Project: Hadoop YARN (was:

[jira] [Updated] (YARN-8802) [JDK9] Fail to run yarn application after building hadoop pkg with jdk9 in jdk9 env

2018-09-19 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8802: Priority: Critical (was: Major) > [JDK9] Fail to run yarn application after building hadoop pkg

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.004.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621460#comment-16621460 ] Weiwei Yang commented on YARN-8468: --- [~leftnoteasy], YARN-8720 already addressed the changes needed in

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621442#comment-16621442 ] Zhankun Tang commented on YARN-8725: [~leftnoteasy] Thanks for the explanation. It should have a

[jira] [Updated] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-19 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8793: -- Attachment: YARN-8793.005.patch > QueuePlacementPolicy bind more information to assgining result >

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Tao Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621414#comment-16621414 ] Tao Yang commented on YARN-8771: Thanks [~cheersyang] and [~leftnoteasy] ! > CapacityScheduler fails to

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621407#comment-16621407 ] Hadoop QA commented on YARN-8801: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621368#comment-16621368 ] Hadoop QA commented on YARN-8769: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621359#comment-16621359 ] Hadoop QA commented on YARN-8696: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

2018-09-19 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621350#comment-16621350 ] Zian Chen commented on YARN-8801: - Provide patch for the fix. Don't need to add UTs here. > java doc

[jira] [Updated] (YARN-8801) java doc comments in docker-util.h is confusing

2018-09-19 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8801: Labels: Docker (was: ) > java doc comments in docker-util.h is confusing >

[jira] [Created] (YARN-8801) java doc comments in docker-util.h is confusing

2018-09-19 Thread Zian Chen (JIRA)
Zian Chen created YARN-8801: --- Summary: java doc comments in docker-util.h is confusing Key: YARN-8801 URL: https://issues.apache.org/jira/browse/YARN-8801 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Resolved] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan resolved YARN-8799. -- Resolution: Duplicate This should be duplicated by YARN-8757.  > [Submarine] Correct the default

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621339#comment-16621339 ] Wangda Tan commented on YARN-8725: -- Thanks [~tangzhankun],  {quote}But the job failed due to invalid path

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621328#comment-16621328 ] Wangda Tan commented on YARN-8769: -- Attached ver.3 patch fixed checkstyle and findbugs issues.  >

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.003.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621322#comment-16621322 ] Hadoop QA commented on YARN-8777: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621301#comment-16621301 ] Hadoop QA commented on YARN-7599: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621291#comment-16621291 ] Eric Yang commented on YARN-6456: - [~jlowe] The proposed path is good way to unblock this feature. >

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621278#comment-16621278 ] Eric Yang commented on YARN-8777: - [~Zian Chen] [~ebadger] Patch 3 will change the .cmd file format to

[jira] [Commented] (YARN-8784) DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk

2018-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621276#comment-16621276 ] Hudson commented on YARN-8784: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15025 (See

[jira] [Updated] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8777: Attachment: YARN-8777.003.patch > Container Executor C binary change to execute interactive docker command

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621259#comment-16621259 ] Eric Yang commented on YARN-8777: - Base on today's meeting, there is possibility that bash doesn't exist

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

2018-09-19 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621254#comment-16621254 ] Eric Payne commented on YARN-8774: -- Thanks [~Tao Yang] for reporting this issue and providing a patch.

[jira] [Commented] (YARN-8783) Improve the documentation for the docker.trusted.registries configuration

2018-09-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621225#comment-16621225 ] Jason Lowe commented on YARN-8783: -- [~simonprewo] I added you to the YARN contributor list. Feel free to

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-8696: --- Attachment: YARN-8696.v6.patch > [AMRMProxy] FederationInterceptor upgrade: home sub-cluster

[jira] [Commented] (YARN-6456) Allow administrators to set a single ContainerRuntime for all containers

2018-09-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621224#comment-16621224 ] Jason Lowe commented on YARN-6456: -- My apologies for the delay -- I missed the last comment being posted.

[jira] [Updated] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Attachment: YARN-7599-YARN-7402.v6.patch > [GPG] ApplicationCleaner in Global Policy Generator >

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621216#comment-16621216 ] Botong Huang commented on YARN-7599: Thanks [~bibinchundatt] for the comment! v6 patch uploaded. bq. 

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621114#comment-16621114 ] Hadoop QA commented on YARN-8769: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

2018-09-19 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621108#comment-16621108 ] Chandni Singh commented on YARN-8665: - [~eyang] Thanks for the review {quote} Instances at

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621059#comment-16621059 ] Eric Yang commented on YARN-8777: - [~ebadger] {quote}Where do the shell expansion cases come from? We

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-19 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621060#comment-16621060 ] Botong Huang commented on YARN-8696: Unit test failure in TestCapacityOverTimePolicy is irrelevant. 

[jira] [Commented] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621049#comment-16621049 ] Eric Yang commented on YARN-8665: - [~csingh] Thank you for the patch. When cancel upgrade is triggered,

[jira] [Created] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-19 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8800: Summary: Updated documentation of Submarine with latest examples. Key: YARN-8800 URL: https://issues.apache.org/jira/browse/YARN-8800 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621042#comment-16621042 ] Wangda Tan commented on YARN-8769: -- Thanks [~sunilg], attached ver.2 > [Submarine] Allow user to specify

[jira] [Updated] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8769: - Attachment: YARN-8769.002.patch > [Submarine] Allow user to specify customized quicklink(s) when submit

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621002#comment-16621002 ] Wangda Tan commented on YARN-8468: -- [~cheersyang],  I saw YARN-8720 just committed, what is the

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620989#comment-16620989 ] Eric Badger commented on YARN-8777: --- bq. Shell expansion corner cases will not handle gracefully and

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620969#comment-16620969 ] Hadoop QA commented on YARN-8777: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620958#comment-16620958 ] Hudson commented on YARN-8791: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15018 (See

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

2018-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620923#comment-16620923 ] Hudson commented on YARN-8757: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15017 (See

[jira] [Commented] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620865#comment-16620865 ] Eric Yang commented on YARN-8791: - +1 > When STOPSIGNAL is not present then docker inspect returns an

[jira] [Comment Edited] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620834#comment-16620834 ] Zhankun Tang edited comment on YARN-8725 at 9/19/18 4:52 PM: - [~leftnoteasy]

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

2018-09-19 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620839#comment-16620839 ] Sunil Govindan commented on YARN-8769: -- This patch doesnt apply posy YARN-8757. [~leftnoteasy] could

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620834#comment-16620834 ] Zhankun Tang commented on YARN-8725: [~leftnoteasy] {quote}cleanup whole staging dir seems overkill

[jira] [Commented] (YARN-8757) [Submarine] Add Tensorboard component when --tensorboard is specified

2018-09-19 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620833#comment-16620833 ] Sunil Govindan commented on YARN-8757: -- +1. Looks good to me. Committing shortly if no objections.

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620831#comment-16620831 ] Eric Yang commented on YARN-8777: - [~Zian Chen] Patch 002 fixed comment in the header file. > Container

[jira] [Updated] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-8777: Attachment: YARN-8777.002.patch > Container Executor C binary change to execute interactive docker command

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620815#comment-16620815 ] Eric Yang commented on YARN-8777: - [~ebadger] {quote}Opening up a bash session allows the user to then

[jira] [Updated] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8799: --- Description:   {code:java} yarn jar

[jira] [Updated] (YARN-8799) [Submarine] Correct the default directory path in HDFS for "checkout_path"

2018-09-19 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8799: --- Summary: [Submarine] Correct the default directory path in HDFS for "checkout_path" (was:

[jira] [Commented] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620784#comment-16620784 ] Hadoop QA commented on YARN-8791: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8799) [Submarine] A default directory path in HDFS for "checkout_path"?

2018-09-19 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8799: -- Summary: [Submarine] A default directory path in HDFS for "checkout_path"? Key: YARN-8799 URL: https://issues.apache.org/jira/browse/YARN-8799 Project: Hadoop YARN

[jira] [Commented] (YARN-8783) Improve the documentation for the docker.trusted.registries configuration

2018-09-19 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620778#comment-16620778 ] Eric Yang commented on YARN-8783: - [~simonprewo] The suggested changes looks good to me. Would you like

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

2018-09-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620751#comment-16620751 ] Eric Badger commented on YARN-8777: --- bq. The enum approach can be used for fixed number of parameters or

[jira] [Comment Edited] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620437#comment-16620437 ] Bibin A Chundatt edited comment on YARN-7599 at 9/19/18 3:26 PM: - Thanks

[jira] [Commented] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Shane Kumpf (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620748#comment-16620748 ] Shane Kumpf commented on YARN-8791: --- Thanks for the patch, [~csingh]! I have confirmed this fixes the

[jira] [Commented] (YARN-8784) DockerLinuxContainerRuntime prevents access to distributed cache entries on a full disk

2018-09-19 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620747#comment-16620747 ] Jason Lowe commented on YARN-8784: -- Thanks for the patch! We should be fine bind-mounting the full and

[jira] [Commented] (YARN-8655) FairScheduler: FSStarvedApps is not thread safe

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620735#comment-16620735 ] Antal Bálint Steinbach commented on YARN-8655: -- Hi [~uranus], Thanks for uploading the

[jira] [Created] (YARN-8798) [Submarine] Job should not be submitted if "--input_path" option is missing

2018-09-19 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-8798: -- Summary: [Submarine] Job should not be submitted if "--input_path" option is missing Key: YARN-8798 URL: https://issues.apache.org/jira/browse/YARN-8798 Project: Hadoop

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620713#comment-16620713 ] Hadoop QA commented on YARN-8468: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8791: -- Issue Type: Sub-task (was: Bug) Parent: YARN-8472 > When STOPSIGNAL is not present then docker

[jira] [Updated] (YARN-8791) When STOPSIGNAL is not present then docker inspect returns an extra line feed

2018-09-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8791: -- Labels: Docker (was: ) > When STOPSIGNAL is not present then docker inspect returns an extra line feed

[jira] [Updated] (YARN-8744) In some cases docker kill is used to stop non-privileged containers instead of sending the signal directly

2018-09-19 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-8744: -- Issue Type: Sub-task (was: Improvement) Parent: YARN-8472 > In some cases docker kill is used

[jira] [Commented] (YARN-6307) Refactor FairShareComparator#compare

2018-09-19 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620523#comment-16620523 ] stefanlee commented on YARN-6307: - Hi, [~yufeigu] ,after merge this patch, we met the problem YARN-4743.

[jira] [Commented] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620521#comment-16620521 ] Hadoop QA commented on YARN-8793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.014.patch > Limit container sizes per queue in

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: (was: YARN-8468.014.patch) > Limit container sizes per queue in

***UNCHECKED*** [jira] [Commented] (YARN-8436) FSParentQueue: Comparison method violates its general contract

2018-09-19 Thread stefanlee (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620509#comment-16620509 ] stefanlee commented on YARN-8436: - [~wilfreds]  thanks for this jira, As you mentioned above: {quote}If

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.014.patch > Limit container sizes per queue in

[jira] [Commented] (YARN-8797) [UI2] Fix YARN UI2 error pages

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620502#comment-16620502 ] Hadoop QA commented on YARN-8797: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620498#comment-16620498 ] Hudson commented on YARN-8771: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15011 (See

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: (was: YARN-8468.014.patch) > Limit container sizes per queue in

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620492#comment-16620492 ] Weiwei Yang commented on YARN-8771: --- Oops, it should not be cherry-picked to branch-3.0 as YARN-8292 was

***UNCHECKED*** [jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-8771: -- Fix Version/s: (was: 3.0.4) > CapacityScheduler fails to unreserve when cluster resource contains

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620490#comment-16620490 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~cheersyang] , Thanks for the detailed

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.014.patch > Limit container sizes per queue in

[jira] [Commented] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620487#comment-16620487 ] Hadoop QA commented on YARN-8793: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620474#comment-16620474 ] Weiwei Yang commented on YARN-8771: --- LGTM, +1. Committing soon. > CapacityScheduler fails to unreserve

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620469#comment-16620469 ] Hadoop QA commented on YARN-8771: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-09-19 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620464#comment-16620464 ] Tarun Parimi commented on YARN-8627: Thanks for the review [~rohithsharma].  I tested for folder path

[jira] [Created] (YARN-8797) [UI2] Fix YARN UI2 error pages

2018-09-19 Thread Akhil PB (JIRA)
Akhil PB created YARN-8797: -- Summary: [UI2] Fix YARN UI2 error pages Key: YARN-8797 URL: https://issues.apache.org/jira/browse/YARN-8797 Project: Hadoop YARN Issue Type: Bug Components:

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

2018-09-19 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620437#comment-16620437 ] Bibin A Chundatt commented on YARN-7599: Thanks [~botong] for updated patch {quote} Application

[jira] [Updated] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-19 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8793: -- Attachment: YARN-8793.004.patch > QueuePlacementPolicy bind more information to assgining result >

[jira] [Commented] (YARN-8767) TestStreamingStatus fails

2018-09-19 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16620425#comment-16620425 ] Hadoop QA commented on YARN-8767: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8793) QueuePlacementPolicy bind more information to assgining result

2018-09-19 Thread Shuai Zhang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8793?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8793: -- Attachment: YARN-8793.003.patch > QueuePlacementPolicy bind more information to assgining result >

[jira] [Updated] (YARN-8767) TestStreamingStatus fails

2018-09-19 Thread Andras Bokor (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andras Bokor updated YARN-8767: --- Attachment: YARN-8767.004.patch > TestStreamingStatus fails > - > >

  1   2   >