[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704368#comment-16704368 ] Hadoop QA commented on YARN-8627: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Assigned] (YARN-7904) Privileged, trusted containers need all of their bind-mounted directories to be read-only

2018-11-29 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin reassigned YARN-7904: - Assignee: Zhaohui Xin > Privileged, trusted containers need all of their bind-mounted

[jira] [Assigned] (YARN-7848) Force removal of docker containers that do not get removed on first try

2018-11-29 Thread Zhaohui Xin (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhaohui Xin reassigned YARN-7848: - Assignee: Zhaohui Xin > Force removal of docker containers that do not get removed on first try

[jira] [Commented] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704353#comment-16704353 ] Haibo Chen commented on YARN-9066: -- Go for it. > Deprecate Fair Scheduler min share >

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-29 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704342#comment-16704342 ] Xun Liu commented on YARN-8714: --- hi [~leftnoteasy],[~tangzhankun] Need to support the functionality of the

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704331#comment-16704331 ] Hadoop QA commented on YARN-8870: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-11-29 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704328#comment-16704328 ] Tarun Parimi commented on YARN-8627: [~rohithsharma] , I was unable to reproduce locally. Still cant 

[jira] [Comment Edited] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704227#comment-16704227 ] Zhankun Tang edited comment on YARN-8714 at 11/30/18 6:47 AM: -- {quote}1) Why

[jira] [Updated] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-11-29 Thread Tarun Parimi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tarun Parimi updated YARN-8627: --- Attachment: YARN-8627.003.patch > EntityGroupFSTimelineStore hdfs done directory keeps on

[jira] [Commented] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2018-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704308#comment-16704308 ] Vrushali C commented on YARN-5336: -- We can consider limiting the flow name size as a start. Consider

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704309#comment-16704309 ] Sunil Govindan commented on YARN-8870: -- Hi [~liuxun323] is patch number 10 fixing all shell checks

[jira] [Updated] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2018-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5336: - Description: As recommended by [~jrottinghuis] , need to add in some limit (default and configurable)

[jira] [Updated] (YARN-5336) Limit the flow name size & consider cleanup for hex chars

2018-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5336: - Summary: Limit the flow name size & consider cleanup for hex chars (was: Limit the flow name size &

[jira] [Updated] (YARN-5336) Limit the flow name size & consider cleanup for hex chars etc

2018-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C updated YARN-5336: - Summary: Limit the flow name size & consider cleanup for hex chars etc (was: Put in some limit for

[jira] [Assigned] (YARN-5336) Put in some limit for accepting key-values in hbase writer

2018-11-29 Thread Vrushali C (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vrushali C reassigned YARN-5336: Assignee: Sushil Ks (was: Vrushali C) > Put in some limit for accepting key-values in hbase

[jira] [Updated] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated YARN-8870: -- Attachment: YARN-8870.010.patch > [Submarine] Add submarine installation scripts >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704300#comment-16704300 ] Wanqiang Ji commented on YARN-9041: --- Hi [~yufeigu], the v6 patch fixed all the issues you mentioned. Pls

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704295#comment-16704295 ] Hadoop QA commented on YARN-9041: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704280#comment-16704280 ] Hadoop QA commented on YARN-8870: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9049) Add application submit data to state store

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704260#comment-16704260 ] Bibin A Chundatt commented on YARN-9049: Will update in next patch. Also for mysql will write

[jira] [Updated] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated YARN-8870: -- Attachment: YARN-8870.009.patch > [Submarine] Add submarine installation scripts >

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704256#comment-16704256 ] Hadoop QA commented on YARN-8870: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8714) [Submarine] Support files/tarballs to be localized for a training job.

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704227#comment-16704227 ] Zhankun Tang commented on YARN-8714: {quote}1) Why hardcoded to handle {{hdfs://}}, it could be s3,

[jira] [Assigned] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wilfred Spiegelenburg reassigned YARN-9066: --- Assignee: Wilfred Spiegelenburg > Deprecate Fair Scheduler min share >

[jira] [Commented] (YARN-9066) Deprecate Fair Scheduler min share

2018-11-29 Thread Wilfred Spiegelenburg (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704225#comment-16704225 ] Wilfred Spiegelenburg commented on YARN-9066: - [~haibochen] do you mind if I take this one up?

[jira] [Commented] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

2018-11-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704213#comment-16704213 ] Sunil Govindan commented on YARN-9012: -- Hi [~jutia] Thanks for testing this feature. YARN-5881 is

[jira] [Commented] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

2018-11-29 Thread tianjuan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704204#comment-16704204 ] tianjuan commented on YARN-9012: Thanks for reminding > NPE in scheduler UI when min-capacity is not

[jira] [Updated] (YARN-9073) GPU/FPGA whitelist configuration in container-executor.cfg won't work when yarn-site.xml's allowed devices doesn't align with it

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9073: --- Description: The current GPU/FPGA behavior may has an issue when c-g.cfg doesn't align with

[jira] [Updated] (YARN-9073) GPU/FPGA whitelist configuration in container-executor.cfg won't work when yarn-site.xml's allowed devices doesn't align with it

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9073: --- Description: The current GPU/FPGA behavior may has an issue when c-g.cfg doesn't align with

[jira] [Updated] (YARN-9073) GPU/FPGA whitelist configuration in container-executor.cfg won't work when yarn-site.xml's allowed devices doesn't align with it

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9073: --- Description: The current GPU/FPGA behavior may has an issue when c-g.cfg doesn't align with

[jira] [Created] (YARN-9073) GPU/FPGA whitelist configuration in container-executor.cfg won't work when yarn-site.xml's allowed devices doesn't align with it

2018-11-29 Thread Zhankun Tang (JIRA)
Zhankun Tang created YARN-9073: -- Summary: GPU/FPGA whitelist configuration in container-executor.cfg won't work when yarn-site.xml's allowed devices doesn't align with it Key: YARN-9073 URL:

[jira] [Commented] (YARN-8770) [Submarine] Support using Submarine to submit Pytorch job

2018-11-29 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704193#comment-16704193 ] Sunil Govindan commented on YARN-8770: -- Sure [~liuxun323] pls take over.  > [Submarine] Support

[jira] [Comment Edited] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704189#comment-16704189 ] Zhankun Tang edited comment on YARN-9060 at 11/30/18 2:59 AM: --

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704189#comment-16704189 ] Zhankun Tang commented on YARN-9060: [~leftnoteasy], thanks. And for this issue. I'll fix the issue

[jira] [Commented] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704182#comment-16704182 ] Hadoop QA commented on YARN-9071: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Wanqiang Ji (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wanqiang Ji updated YARN-9041: -- Attachment: YARN-9041.006.patch > Optimize FSPreemptionThread#identifyContainersToPreempt method >

[jira] [Updated] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xun Liu updated YARN-8870: -- Attachment: YARN-8870-addendum.008.patch > [Submarine] Add submarine installation scripts >

[jira] [Commented] (YARN-8770) [Submarine] Support using Submarine to submit Pytorch job

2018-11-29 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704136#comment-16704136 ] Xun Liu commented on YARN-8770: --- Hi [~sunilg],[~leftnoteasy],Can you let me implement this feature? >

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Xun Liu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704121#comment-16704121 ] Xun Liu commented on YARN-8870: --- [~leftnoteasy],[~vinodkv],Ok, let me finish the work. > [Submarine] Add

[jira] [Updated] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-11-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-9071: Attachment: YARN-9071.001.patch > NM and service AM don't have updated status for reinitialized

[jira] [Commented] (YARN-9072) Web browser close without proper exit can leak shell process

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704046#comment-16704046 ] Eric Yang commented on YARN-9072: - When a terminal is launched, the process trees are disjoint between

[jira] [Assigned] (YARN-9072) Web browser close without proper exit can leak shell process

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reassigned YARN-9072: --- Assignee: Eric Yang > Web browser close without proper exit can leak shell process >

[jira] [Updated] (YARN-9072) Web browser close without proper exit can leak shell process

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9072: Attachment: YARN-9072.001.patch > Web browser close without proper exit can leak shell process >

[jira] [Commented] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704014#comment-16704014 ] Yufei Gu commented on YARN-9041: Hi [~jiwq], the patch v5 looks good in terms of logic. Some nits: # Can

[jira] [Comment Edited] (YARN-9041) Optimize FSPreemptionThread#identifyContainersToPreempt method

2018-11-29 Thread Yufei Gu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704014#comment-16704014 ] Yufei Gu edited comment on YARN-9041 at 11/29/18 11:21 PM: --- Hi [~jiwq], the

[jira] [Commented] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16704016#comment-16704016 ] Hudson commented on YARN-9010: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15533 (See

[jira] [Commented] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703996#comment-16703996 ] Wangda Tan commented on YARN-9010: -- Committed to trunk, thanks [~tangzhankun]. > Fix the incorrect

[jira] [Updated] (YARN-9010) Fix the incorrect trailing slash deletion in constructor method of CGroupsHandlerImpl

2018-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-9010: - Priority: Major (was: Minor) > Fix the incorrect trailing slash deletion in constructor method of >

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703903#comment-16703903 ] Hadoop QA commented on YARN-8193: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703895#comment-16703895 ] Wangda Tan commented on YARN-8870: -- That's my bad, [~liuxun323], could u work on an addendum patch to get

[jira] [Created] (YARN-9072) Web browser close without proper exit can leak shell process

2018-11-29 Thread Eric Yang (JIRA)
Eric Yang created YARN-9072: --- Summary: Web browser close without proper exit can leak shell process Key: YARN-9072 URL: https://issues.apache.org/jira/browse/YARN-9072 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-8914) Add xtermjs to YARN UI2

2018-11-29 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703884#comment-16703884 ] Billie Rinaldi commented on YARN-8914: -- +1 for patch 7. I tested out this patch and it worked for me.

[jira] [Updated] (YARN-9072) Web browser close without proper exit can leak shell process

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9072: Target Version/s: 3.3.0 > Web browser close without proper exit can leak shell process >

[jira] [Assigned] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned YARN-8870: Assignee: Bharat Viswanadham (was: Xun Liu) > [Submarine] Add submarine

[jira] [Assigned] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Bharat Viswanadham (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bharat Viswanadham reassigned YARN-8870: Assignee: Xun Liu (was: Bharat Viswanadham) > [Submarine] Add submarine

[jira] [Reopened] (YARN-8870) [Submarine] Add submarine installation scripts

2018-11-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli reopened YARN-8870: --- bq. -1 shellcheck 0m 3s The patch generated 274 new + 0 unchanged - 0

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2018-11-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703780#comment-16703780 ] Vinod Kumar Vavilapalli commented on YARN-8193: --- This patch is in trunk, branch-3.2,

[jira] [Commented] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703718#comment-16703718 ] Eric Yang commented on YARN-9053: - [~Charo Zhang] It requires more effort to fix shell expansion to ensure

[jira] [Updated] (YARN-8702) TestContainerSchedulerQueuing.testKillOnlyRequiredOpportunisticContainers() failing randomly

2018-11-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-8702: -- Target Version/s: 3.1.1 Fix Version/s: (was: 3.1.1) Removing

[jira] [Updated] (YARN-9012) NPE in scheduler UI when min-capacity is not configured

2018-11-29 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-9012: -- Fix Version/s: (was: 3.1.1) Removing fix-version on an already published

[jira] [Assigned] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-11-29 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh reassigned YARN-9071: --- Assignee: Chandni Singh > NM and service AM don't have updated status for reinitialized

[jira] [Created] (YARN-9071) NM and service AM don't have updated status for reinitialized containers

2018-11-29 Thread Billie Rinaldi (JIRA)
Billie Rinaldi created YARN-9071: Summary: NM and service AM don't have updated status for reinitialized containers Key: YARN-9071 URL: https://issues.apache.org/jira/browse/YARN-9071 Project: Hadoop

[jira] [Commented] (YARN-9036) Escape newlines in health report in YARN UI

2018-11-29 Thread Keqiu Hu (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703579#comment-16703579 ] Keqiu Hu commented on YARN-9036: [~jhung] latest patch 04 does import from commons-text {code:java}

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703568#comment-16703568 ] Hadoop QA commented on YARN-9067: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

2018-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703553#comment-16703553 ] Wangda Tan commented on YARN-9050: -- [~Tao Yang], thanks for filing the JIRA. The all issues you

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2018-11-29 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703546#comment-16703546 ] Wangda Tan commented on YARN-9060: -- [~tangzhankun], explanation makes sense, and the issue about GPU

[jira] [Commented] (YARN-9070) RM UI broken in IE 11

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703528#comment-16703528 ] Hadoop QA commented on YARN-9070: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9069) Fix SchedulerInfo#getSchedulerType for custom schedulers

2018-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703489#comment-16703489 ] Hudson commented on YARN-9069: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15527 (See

[jira] [Commented] (YARN-6523) Newly retrieved security Tokens are sent as part of each heartbeat to each node from RM which is not desirable in large cluster

2018-11-29 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703485#comment-16703485 ] Jason Lowe commented on YARN-6523: -- Thanks for updating the patch! NodeHeartbeatResponse should not take

[jira] [Updated] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang updated YARN-9067: Attachment: YARN-9067-branch-3.2.001.patch > YARN Resource Manager is running OOM because of leak of

[jira] [Comment Edited] (YARN-9049) Add application submit data to state store

2018-11-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703500#comment-16703500 ] Botong Huang edited comment on YARN-9049 at 11/29/18 4:57 PM: -- Understood.

[jira] [Commented] (YARN-9049) Add application submit data to state store

2018-11-29 Thread Botong Huang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703500#comment-16703500 ] Botong Huang commented on YARN-9049: Understood. Let me ask this way: forget about implementation

[jira] [Updated] (YARN-9069) Fix SchedulerInfo#getSchedulerType for custom schedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9069: --- Priority: Minor (was: Trivial) > Fix SchedulerInfo#getSchedulerType for custom schedulers >

[jira] [Commented] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703479#comment-16703479 ] Eric Yang commented on YARN-9067: - Thank you [~cheersyang] for the commit to trunk.

[jira] [Reopened] (YARN-9067) YARN Resource Manager is running OOM because of leak of Configuration Object

2018-11-29 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened YARN-9067: - Reopen for branch-3.2 and branch-3.1 precommit build test. > YARN Resource Manager is running OOM because of

[jira] [Updated] (YARN-9069) Fix SchedulerInfo#getSchedulerType for custom schedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9069: --- Summary: Fix SchedulerInfo#getSchedulerType for custom schedulers (was: Handle

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-29 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703450#comment-16703450 ] Hudson commented on YARN-8948: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15526 (See

[jira] [Comment Edited] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703437#comment-16703437 ] Bibin A Chundatt edited comment on YARN-8948 at 11/29/18 4:15 PM: --

[jira] [Commented] (YARN-9053) Support set environment variables for Docker Containers In nonEntryPoint mode

2018-11-29 Thread Jim Brennan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703337#comment-16703337 ] Jim Brennan commented on YARN-9053: --- [~Charo Zhang] can you explain more about what your users are doing

[jira] [Commented] (YARN-9015) Phase 1 - Add an interface for device plugin to provide customized scheduler

2018-11-29 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703299#comment-16703299 ] Hadoop QA commented on YARN-9015: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9015) Phase 1 - Add an interface for device plugin to provide customized scheduler

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9015: --- Attachment: YARN-9015-trunk.003.patch > Phase 1 - Add an interface for device plugin to provide

[jira] [Comment Edited] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703216#comment-16703216 ] Bibin A Chundatt edited comment on YARN-9039 at 11/29/18 2:05 PM: --

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703216#comment-16703216 ] Bibin A Chundatt commented on YARN-9039: [~suma.shivaprasad] {code} protected boolean

[jira] [Commented] (YARN-9069) Handle SchedulerInfo#getSchedulerType for customized schedulers

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703208#comment-16703208 ] Zhankun Tang commented on YARN-9069: +1 LGTM > Handle SchedulerInfo#getSchedulerType for customized

[jira] [Comment Edited] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703101#comment-16703101 ] Suma Shivaprasad edited comment on YARN-9039 at 11/29/18 12:36 PM: ---

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703101#comment-16703101 ] Suma Shivaprasad commented on YARN-9039: Did not get why would the checks always pass with new

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703082#comment-16703082 ] Suma Shivaprasad commented on YARN-9039: Attached patch which addresses the review comments to

[jira] [Updated] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Suma Shivaprasad (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suma Shivaprasad updated YARN-9039: --- Attachment: YARN-9039.3.patch > App ACLs are not validated when serving logs from

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703071#comment-16703071 ] Bibin A Chundatt commented on YARN-9039: {quote} Did not get what is the fix needed for

[jira] [Comment Edited] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703013#comment-16703013 ] Bibin A Chundatt edited comment on YARN-9039 at 11/29/18 11:16 AM: ---

[jira] [Issue Comment Deleted] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9039: --- Comment: was deleted (was: Did not get what is the fix needed for

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703019#comment-16703019 ] Bibin A Chundatt commented on YARN-9039: Did not get what is the fix needed for

[jira] [Commented] (YARN-9039) App ACLs are not validated when serving logs from LogWebService

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703013#comment-16703013 ] Bibin A Chundatt commented on YARN-9039: {quote} But gets cumbersome when implementing application

[jira] [Updated] (YARN-9070) RM UI broken in IE 11

2018-11-29 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9070: Attachment: YARN-9070-001.patch > RM UI broken in IE 11 > - > > Key:

[jira] [Commented] (YARN-9070) RM UI broken in IE 11

2018-11-29 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703014#comment-16703014 ] Bilwa S T commented on YARN-9070: - cc [~bibinchundatt] [~botong] > RM UI broken in IE 11 >

[jira] [Commented] (YARN-9060) [YARN-8851] Phase 1 - Support device isolation in native container-executor

2018-11-29 Thread Zhankun Tang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703023#comment-16703023 ] Zhankun Tang commented on YARN-9060: Thanks for the review, [~leftnoteasy]! {quote}1) Could u add some

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703010#comment-16703010 ] Bibin A Chundatt commented on YARN-8948: Based on +1 from [~suma.shivaprasad].If no one complains

[jira] [Commented] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703009#comment-16703009 ] Bibin A Chundatt commented on YARN-8948: Based on +1 from [~suma.shivaprasad].If no one complains

[jira] [Issue Comment Deleted] (YARN-8948) PlacementRule interface should be for all YarnSchedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8948: --- Comment: was deleted (was: Based on +1 from [~suma.shivaprasad].If no one complains i will

[jira] [Commented] (YARN-9069) Handle SchedulerInfo#getSchedulerType for customized schedulers

2018-11-29 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16703006#comment-16703006 ] Bibin A Chundatt commented on YARN-9069: +1 lgtm  If no one complains i will commit it by EOD. >

  1   2   >