[jira] [Commented] (YARN-8742) [UI2] Container logs on Application / Service pages on UI2 are not available many case, improve error messages in such cases.

2018-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625455#comment-16625455 ] Hudson commented on YARN-8742: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15038 (See

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-09-24 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625539#comment-16625539 ] Akhil PB commented on YARN-7957: Thanks [~sunilg] for your comments. Attached v2 patch with the above

[jira] [Updated] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-09-24 Thread Akhil PB (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhil PB updated YARN-7957: --- Attachment: YARN-7957.002.patch > [UI2] Yarn service delete option disappears after stopping application >

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625577#comment-16625577 ] Hadoop QA commented on YARN-7957: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8742) [UI2] Container logs on Application / Service pages on UI2 are not available many case, improve error messages in such cases.

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8742: - Summary: [UI2] Container logs on Application / Service pages on UI2 are not available many case,

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625439#comment-16625439 ] Sunil Govindan commented on YARN-8468: -- Given the complexity and the ongoing review, I am deferring

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8468: - Target Version/s: 3.3.0 (was: 3.2.0) > Enable the use of queue based maximum container

[jira] [Commented] (YARN-8759) Copy of "resource-types.xml" is not deleted if test fails, causes other test failures

2018-09-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625467#comment-16625467 ] Antal Bálint Steinbach commented on YARN-8759: -- Thanks, [~maniraj...@gmail.com] . [~sunilg]

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.017.patch > Enable the use of queue based maximum container

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625443#comment-16625443 ] Sunil Govindan commented on YARN-8657: -- Thanks [~cheersyang]. I will help to rebase this patch. >

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625441#comment-16625441 ] Sunil Govindan commented on YARN-8804: -- As this is one of the last Critical one for 3.2, [~jlowe] and

[jira] [Commented] (YARN-7957) [UI2] Yarn service delete option disappears after stopping application

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625431#comment-16625431 ] Sunil Govindan commented on YARN-7957: -- I think we can rephrase this like below. 1. Show both Stop

[jira] [Updated] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8657: - Attachment: YARN-8657.002.patch > User limit calculation should be read-lock-protected within

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625559#comment-16625559 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~cheersyang] , Thanks for your

[jira] [Created] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Rakesh Shah (JIRA)
Rakesh Shah created YARN-8815: - Summary: Both RM in standby after restart(restart failure) Key: YARN-8815 URL: https://issues.apache.org/jira/browse/YARN-8815 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625710#comment-16625710 ] Hadoop QA commented on YARN-8468: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625793#comment-16625793 ] Sunil Govindan commented on YARN-8815: -- Thanks [~Rakesh_Shah] and [~bibinchundatt] I just saw this

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625672#comment-16625672 ] Bibin A Chundatt commented on YARN-8815: Thank you [~Rakesh_Shah] for raising the issue Seems

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625623#comment-16625623 ] Sunil Govindan commented on YARN-8657: -- [~cheersyang] cud u pls check latest patch > User limit

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625725#comment-16625725 ] Antal Bálint Steinbach commented on YARN-8657: -- Hi [~leftnoteasy] ,  Thanks for the patch.

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625616#comment-16625616 ] Hadoop QA commented on YARN-8657: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Description:   *while running a un managed am jar and restarting the RM - RM goes into

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Priority: Critical (was: Major) > Both RM in standby after restart(restart failure) >

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Target Version/s: 3.2.0 > Both RM in standby after restart(restart failure) >

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625814#comment-16625814 ] Sunil Govindan commented on YARN-8657: -- {code:java} } finally {    readLock.unlock();   }{code} We

[jira] [Created] (YARN-8816) YARN Unit Tests Fail with Ubuntu VM

2018-09-24 Thread BELUGA BEHR (JIRA)
BELUGA BEHR created YARN-8816: - Summary: YARN Unit Tests Fail with Ubuntu VM Key: YARN-8816 URL: https://issues.apache.org/jira/browse/YARN-8816 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-8816) YARN Unit Tests Fail with Ubuntu VM

2018-09-24 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8816: -- Description: {code} Linux apache-dev 4.15.0-34-generic #37~16.04.1-Ubuntu SMP Tue Aug 28 10:44:06 UTC

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625938#comment-16625938 ] Hadoop QA commented on YARN-5939: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625853#comment-16625853 ] Antal Bálint Steinbach commented on YARN-5939: -- Hi [~cheersyang] , I saw this ticket is open

[jira] [Comment Edited] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-09-24 Thread Rahul Anand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625870#comment-16625870 ] Rahul Anand edited comment on YARN-7592 at 9/24/18 3:46 PM: Thanks

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626081#comment-16626081 ] Haibo Chen commented on YARN-8468: -- [~cheersyang] The reason why normalization is done in scheduler is

[jira] [Updated] (YARN-8809) Refactor AbstractYarnScheduler and CapacityScheduler OPPORTUNISTIC container completion codepaths

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8809: - Description: When OPPORTUNISTIC containers  are released, fair scheduler does not update the queue

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626084#comment-16626084 ] Haibo Chen commented on YARN-1011: -- Sure. I am testing my local rebased branch. Will push it once the

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626124#comment-16626124 ] Bibin A Chundatt commented on YARN-8815: [~rohithsharma]/[~sunilg] During recovery,

[jira] [Commented] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626131#comment-16626131 ] Haibo Chen commented on YARN-8808: -- Hi [~asuresh]. Not sure if I follow you correctly. Sounds like you

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Attachment: YARN-8815.001.patch > Both RM in standby after restart(restart failure) >

[jira] [Comment Edited] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626124#comment-16626124 ] Bibin A Chundatt edited comment on YARN-8815 at 9/24/18 5:04 PM: -

[jira] [Comment Edited] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626124#comment-16626124 ] Bibin A Chundatt edited comment on YARN-8815 at 9/24/18 5:04 PM: -

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626139#comment-16626139 ] Bibin A Chundatt commented on YARN-8815: {quote} finished unmanaged app? {quote} Will happen for

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626062#comment-16626062 ] Rohith Sharma K S commented on YARN-8815: - [~Rakesh_Shah] Could you give bit more details does

[jira] [Commented] (YARN-8811) Support Container Storage Interface (CSI) in YARN

2018-09-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626064#comment-16626064 ] Eric Yang commented on YARN-8811: - [~cheersyang] {quote}For the comment about object store user API key

[jira] [Updated] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

2018-09-24 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8665: Attachment: YARN-8665.005.patch > Yarn Service Upgrade: Support cancelling upgrade >

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8696: --- Component/s: nodemanager > [AMRMProxy] FederationInterceptor upgrade: home

[jira] [Updated] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-24 Thread JIRA
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-5939: - Attachment: YARN-5939.004.patch > FSDownload leaks FileSystem resources >

[jira] [Commented] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-09-24 Thread Rahul Anand (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625870#comment-16625870 ] Rahul Anand commented on YARN-7592: --- Thanks [~bibinchundatt] and [~subru]. Removing

[jira] [Comment Edited] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626139#comment-16626139 ] Bibin A Chundatt edited comment on YARN-8815 at 9/24/18 6:31 PM: - {quote}

[jira] [Commented] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626266#comment-16626266 ] Hadoop QA commented on YARN-8810: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

2018-09-24 Thread Chandni Singh (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8810: Attachment: YARN-8810.001.patch > Yarn Service: discrepancy between hashcode and equals of

[jira] [Updated] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola updated YARN-8696: --- Fix Version/s: 3.2.0 > [AMRMProxy] FederationInterceptor upgrade: home

[jira] [Commented] (YARN-8696) [AMRMProxy] FederationInterceptor upgrade: home sub-cluster heartbeat async

2018-09-24 Thread Giovanni Matteo Fumarola (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626251#comment-16626251 ] Giovanni Matteo Fumarola commented on YARN-8696: Thanks [~botong] for the patch.

[jira] [Commented] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626399#comment-16626399 ] Hadoop QA commented on YARN-8665: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-24 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.7.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626418#comment-16626418 ] Wangda Tan commented on YARN-8627: -- [~rohithsharma], could u help to review the latest comment? >

[jira] [Updated] (YARN-8616) systemClock should be used in RMAppImpl instead of System.currentTimeMills() to be consistent

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8616: - Summary: systemClock should be used in RMAppImpl instead of System.currentTimeMills() to be consistent

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626660#comment-16626660 ] Hadoop QA commented on YARN-8758: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

2018-09-24 Thread Jason Lowe (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626564#comment-16626564 ] Jason Lowe commented on YARN-8804: -- Thanks for updating the patch! +1 lgtm. I'll commit this by

[jira] [Commented] (YARN-8734) Readiness check for remote service belongs to the same user

2018-09-24 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626565#comment-16626565 ] Eric Yang commented on YARN-8734: - [~billie.rinaldi] Good catch on the relationship between liveness

[jira] [Assigned] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan reassigned YARN-8817: Assignee: Wangda Tan > [Submarine] In some cases HDFS is not asked by user when submit job but >

[jira] [Commented] (YARN-8616) systemClock should be used in RMAppImpl instead of System.currentTimeMills() to be consistent

2018-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626572#comment-16626572 ] Hudson commented on YARN-8616: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15047 (See

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626770#comment-16626770 ] Weiwei Yang commented on YARN-5939: --- Hi [~bsteinbach] Appreciate your help to rebase it. The wrapper

[jira] [Updated] (YARN-8817) [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework requires user to set HDFS related environments

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil Govindan updated YARN-8817: - Summary: [Submarine] In cases when user doesn't ask HDFS path while submitting job but framework

[jira] [Created] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Wangda Tan (JIRA)
Wangda Tan created YARN-8817: Summary: [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments Key: YARN-8817 URL:

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626672#comment-16626672 ] Hadoop QA commented on YARN-8800: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8627) EntityGroupFSTimelineStore hdfs done directory keeps on accumulating

2018-09-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626792#comment-16626792 ] Rohith Sharma K S commented on YARN-8627: - bq. One thing I noticed is that only the "domainlog"

[jira] [Updated] (YARN-8734) Readiness check for remote service belongs to the same user

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8734: - Summary: Readiness check for remote service belongs to the same user (was: Readiness check for remote

[jira] [Updated] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8817: - Attachment: YARN-8817.001.patch > [Submarine] In some cases HDFS is not asked by user when submit job but

[jira] [Updated] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8800: - Attachment: YARN-8800.002.patch > Updated documentation of Submarine with latest examples. >

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626617#comment-16626617 ] Hadoop QA commented on YARN-8817: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626619#comment-16626619 ] Wangda Tan commented on YARN-8817: -- Verified this in a cluster. > [Submarine] In some cases HDFS is not

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626618#comment-16626618 ] Wangda Tan commented on YARN-8800: -- Attached ver.2 patch includes notebooks examples as well. > Updated

[jira] [Assigned] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt reassigned YARN-8815: -- Assignee: Bibin A Chundatt > Both RM in standby after restart(restart failure) >

[jira] [Assigned] (YARN-8816) YARN Unit Tests Fail with Ubuntu VM

2018-09-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka reassigned YARN-8816: --- Assignee: Akira Ajisaka > YARN Unit Tests Fail with Ubuntu VM >

[jira] [Updated] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiwei Yang updated YARN-5939: -- Attachment: YARN-5939.005.patch > FSDownload leaks FileSystem resources >

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626680#comment-16626680 ] Hadoop QA commented on YARN-8789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-24 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.7.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

2018-09-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626714#comment-16626714 ] Weiwei Yang commented on YARN-8468: --- Hi [~haibochen]/[~bsteinbach] {quote}{{ApplicationMasterProtocol}} 

[jira] [Commented] (YARN-8816) YARN Unit Tests Fail with Ubuntu VM

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626765#comment-16626765 ] Bibin A Chundatt commented on YARN-8816: [~ajisakaa] I think its better to add as addendum patch

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626569#comment-16626569 ] Wangda Tan commented on YARN-8817: -- cc: [~sunilg] > [Submarine] In some cases HDFS is not asked by user

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626568#comment-16626568 ] Wangda Tan commented on YARN-8817: -- The root cause is:  In any case we will generate checkpoint_path,

[jira] [Commented] (YARN-8734) Readiness check for remote service belongs to the same user

2018-09-24 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626598#comment-16626598 ] Billie Rinaldi commented on YARN-8734: -- Makes sense to me. Thanks, [~eyang]! > Readiness check for

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Target Version/s: 3.2.0, 3.1.2 (was: 3.2.0) > Both RM in standby after restart(restart

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Rakesh Shah (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh Shah updated YARN-8815: -- Priority: Major (was: Critical) > Both RM in standby after restart(restart failure) >

[jira] [Commented] (YARN-8816) YARN Unit Tests Fail with Ubuntu VM

2018-09-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626785#comment-16626785 ] Akira Ajisaka commented on YARN-8816: - Okay. I'll reopen HADOOP-15764 and close this issue. > YARN

[jira] [Commented] (YARN-6338) Typos in Docker docs: contains => containers

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626536#comment-16626536 ] Haibo Chen commented on YARN-6338: -- +1 on the patch. Committing it shortly. > Typos in Docker docs:

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

2018-09-24 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626601#comment-16626601 ] Zian Chen commented on YARN-8758: - Hi [~sunilg] [~weiweiyagn666], could you help review the patch? Thanks

[jira] [Commented] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Rohith Sharma K S (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626802#comment-16626802 ] Rohith Sharma K S commented on YARN-8815: - +1 lgtm.. > Both RM in standby after restart(restart

[jira] [Commented] (YARN-5939) FSDownload leaks FileSystem resources

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5939?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626804#comment-16626804 ] Hadoop QA commented on YARN-5939: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8758) PreemptionMessage when using AMRMClientAsync

2018-09-24 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626513#comment-16626513 ] Zian Chen commented on YARN-8758: - I'll work on this Jira and provide an initial patch. >

[jira] [Assigned] (YARN-8758) PreemptionMessage when using AMRMClientAsync

2018-09-24 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8758: --- Assignee: Zian Chen > PreemptionMessage when using AMRMClientAsync >

[jira] [Commented] (YARN-8817) [Submarine] In some cases HDFS is not asked by user when submit job but framework requires user to set HDFS related environments

2018-09-24 Thread Sunil Govindan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626694#comment-16626694 ] Sunil Govindan commented on YARN-8817: -- Thanks [~leftnoteasy]. Fix looks straight forward.

[jira] [Updated] (YARN-8816) YARN Unit Tests Fail with Ubuntu VM

2018-09-24 Thread Akira Ajisaka (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated YARN-8816: Attachment: YARN-8816.01.patch > YARN Unit Tests Fail with Ubuntu VM >

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Attachment: YARN-8815.002.patch > Both RM in standby after restart(restart failure) >

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

2018-09-24 Thread Wangda Tan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-8758: - Target Version/s: 3.1.2 (was: 3.1.1) > PreemptionMessage when using AMRMClientAsync >

[jira] [Updated] (YARN-8759) Copy of "resource-types.xml" is not deleted if test fails, causes other test failures

2018-09-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8759: - Labels: unit-test (was: ) > Copy of "resource-types.xml" is not deleted if test fails, causes

[jira] [Commented] (YARN-8616) System.currentTimeMillis() used in RMAppImpl, instead of getting value from systemClock

2018-09-24 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626544#comment-16626544 ] Haibo Chen commented on YARN-8616: -- +1 on the patch. Thanks [~snemeth] for the fix, commiting shortly. >

[jira] [Commented] (YARN-6338) Typos in Docker docs: contains => containers

2018-09-24 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626550#comment-16626550 ] Hudson commented on YARN-6338: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15046 (See

[jira] [Updated] (YARN-8758) PreemptionMessage when using AMRMClientAsync

2018-09-24 Thread Zian Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen updated YARN-8758: Attachment: YARN-8758.001.patch > PreemptionMessage when using AMRMClientAsync >

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

2018-09-24 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626675#comment-16626675 ] Hadoop QA commented on YARN-8789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8815) Both RM in standby after restart(restart failure)

2018-09-24 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-8815: --- Priority: Critical (was: Major) > Both RM in standby after restart(restart failure) >

[jira] [Commented] (YARN-8657) User limit calculation should be read-lock-protected within LeafQueue

2018-09-24 Thread Weiwei Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16626764#comment-16626764 ] Weiwei Yang commented on YARN-8657: --- Hi [~sunilg], It seems the UT failure was related, I tried that

  1   2   >