[jira] [Commented] (YARN-9755) RM fails to start with FileSystemBasedConfigurationProvider

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916333#comment-16916333 ] Prabhu Joseph commented on YARN-9755: - Thanks [~eyang] for the review. Can you commit this when you

[jira] [Commented] (YARN-9780) SchedulerConf Mutation Api does not Allow Stop and Remove Queue in a single call

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916330#comment-16916330 ] Prabhu Joseph commented on YARN-9780: - [~jhung] Can you review this Jira when you get time. This

[jira] [Commented] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations for ZKConfigurationStore

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916328#comment-16916328 ] Prabhu Joseph commented on YARN-9775: - Thanks [~jhung]. > RMWebServices /scheduler-conf GET returns

[jira] [Commented] (YARN-9640) Slow event processing could cause too many attempt unregister events

2019-08-26 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916312#comment-16916312 ] Hudson commented on YARN-9640: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17189 (See

[jira] [Commented] (YARN-9640) Slow event processing could cause too many attempt unregister events

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916300#comment-16916300 ] Rohith Sharma K S commented on YARN-9640: - committed to trunk. branch-3.2 patch doesn't apply.

[jira] [Updated] (YARN-9640) Slow event processing could cause too many attempt unregister events

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-9640: Fix Version/s: 3.3.0 > Slow event processing could cause too many attempt unregister events

[jira] [Commented] (YARN-9640) Slow event processing could cause too many attempt unregister events

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916296#comment-16916296 ] Rohith Sharma K S commented on YARN-9640: - +1 committing shortly > Slow event processing could

[jira] [Updated] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.004.patch > ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916291#comment-16916291 ] Tao Yang commented on YARN-8917: Thanks [~rohithsharma], [~leftnoteasy], [~sunilg] for the review and

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916290#comment-16916290 ] Tao Yang commented on YARN-9714: TestZKRMStateStore#testZKRootPathAcls UT failure is caused by itself,

[jira] [Commented] (YARN-9785) Application gets activated even when AM memory has reached

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916269#comment-16916269 ] Zhankun Tang commented on YARN-9785: [~BilwaST], Thanks for reporting this. We're going to have branch

[jira] [Commented] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations for ZKConfigurationStore

2019-08-26 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916246#comment-16916246 ] Hudson commented on YARN-9775: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17188 (See

[jira] [Updated] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations for ZKConfigurationStore

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9775: Fix Version/s: 3.1.3 3.2.1 3.3.0 3.0.4

[jira] [Updated] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations for ZKConfigurationStore

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9775: Summary: RMWebServices /scheduler-conf GET returns all hadoop configurations for

[jira] [Commented] (YARN-9615) Add dispatcher metrics to RM

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916128#comment-16916128 ] Jonathan Hung commented on YARN-9615: - [~bibinchundatt] that approach looks better. Feel free to take

[jira] [Commented] (YARN-9768) RM Renew Delegation token thread should timeout and retry

2019-08-26 Thread CR Hota (Jira)
[ https://issues.apache.org/jira/browse/YARN-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916104#comment-16916104 ] CR Hota commented on YARN-9768: --- [~maniraj...@gmail.com] Thanks for pointing this out. Sure feel free to

[jira] [Comment Edited] (YARN-9768) RM Renew Delegation token thread should timeout and retry

2019-08-26 Thread CR Hota (Jira)
[ https://issues.apache.org/jira/browse/YARN-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916104#comment-16916104 ] CR Hota edited comment on YARN-9768 at 8/26/19 7:45 PM: [~maniraj...@gmail.com] 

[jira] [Commented] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916090#comment-16916090 ] Hadoop QA commented on YARN-9775: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9781) SchedConfCli to get current stored scheduler configuration

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916078#comment-16916078 ] Hadoop QA commented on YARN-9781: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916040#comment-16916040 ] Eric Payne commented on YARN-9756: -- Also in 3.2 and earlier, {{QueueMetrics#updatePreemptedResources}}

[jira] [Commented] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-08-26 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916038#comment-16916038 ] Bibin A Chundatt commented on YARN-9738: [~BilwaST]  As discussed offline need to handle get to

[jira] [Comment Edited] (YARN-9642) Fix Memory Leak in AbstractYarnScheduler caused by timer

2019-08-26 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916014#comment-16916014 ] Bibin A Chundatt edited comment on YARN-9642 at 8/26/19 5:58 PM: -

[jira] [Commented] (YARN-9642) Fix Memory Leak in AbstractYarnScheduler caused by timer

2019-08-26 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916010#comment-16916010 ] Hudson commented on YARN-9642: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17186 (See

[jira] [Updated] (YARN-9642) Fix Memory Leak in AbstractYarnScheduler caused by timer

2019-08-26 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9642: --- Summary: Fix Memory Leak in AbstractYarnScheduler caused by timer (was:

[jira] [Commented] (YARN-9640) Slow event processing could cause too many attempt unregister events

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916001#comment-16916001 ] Hadoop QA commented on YARN-9640: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16916002#comment-16916002 ] Hadoop QA commented on YARN-8193: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9642) AbstractYarnScheduler#clearPendingContainerCache cause memory leak

2019-08-26 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9642: --- Summary: AbstractYarnScheduler#clearPendingContainerCache cause memory leak (was:

[jira] [Updated] (YARN-9785) Application gets activated even when AM memory has reached

2019-08-26 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-9785: --- Target Version/s: 3.2.1, 3.1.3 > Application gets activated even when AM memory has reached >

[jira] [Commented] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915970#comment-16915970 ] Jonathan Hung commented on YARN-9775: - Thanks, +1! I'll commit it by EOD if no objections. >

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915969#comment-16915969 ] Hadoop QA commented on YARN-8453: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8200) Backport resource types/GPU features to branch-3.0/branch-2

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8200: Target Version/s: 2.10.0 Labels: release-blocker (was: ) > Backport resource

[jira] [Commented] (YARN-9642) AbstractYarnScheduler#clearPendingContainerCache could run even after transitiontostandby

2019-08-26 Thread Bibin A Chundatt (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915955#comment-16915955 ] Bibin A Chundatt commented on YARN-9642: [~tangzhankun] and [~rohithsharma] Tried running it

[jira] [Commented] (YARN-9756) Create metric that sums total memory/vcores preempted per round

2019-08-26 Thread Eric Payne (Jira)
[ https://issues.apache.org/jira/browse/YARN-9756?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915951#comment-16915951 ] Eric Payne commented on YARN-9756: -- Hi [~maniraj...@gmail.com], thanks for the updated patch! We will

[jira] [Commented] (YARN-9754) Add support for arbitrary DAG AM Simulator.

2019-08-26 Thread Jira
[ https://issues.apache.org/jira/browse/YARN-9754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915952#comment-16915952 ] Íñigo Goiri commented on YARN-9754: --- To make it easier to read, it would be nice to do: {{super.amtype =

[jira] [Commented] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915950#comment-16915950 ] Prabhu Joseph commented on YARN-9775: - Thanks [~jhung] for reviewing. Have fixed the above changes in

[jira] [Commented] (YARN-9642) AbstractYarnScheduler#clearPendingContainerCache could run even after transitiontostandby

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915949#comment-16915949 ] Hadoop QA commented on YARN-9642: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9775: Attachment: YARN-9775-002.patch > RMWebServices /scheduler-conf GET returns all hadoop

[jira] [Updated] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9775: Attachment: (was: YARN-9775-002.patch) > RMWebServices /scheduler-conf GET returns all hadoop

[jira] [Updated] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9775: Attachment: YARN-9775-002.patch > RMWebServices /scheduler-conf GET returns all hadoop

[jira] [Comment Edited] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915931#comment-16915931 ] Jonathan Hung edited comment on YARN-9775 at 8/26/19 4:44 PM: -- Thanks for the

[jira] [Commented] (YARN-9775) RMWebServices /scheduler-conf GET returns all hadoop configurations

2019-08-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915931#comment-16915931 ] Jonathan Hung commented on YARN-9775: - Thanks for the fix [~Prabhu Joseph], +1 LGTM > RMWebServices

[jira] [Commented] (YARN-9771) Add GPU in the container-executor.cfg example

2019-08-26 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915928#comment-16915928 ] Hudson commented on YARN-9771: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17185 (See

[jira] [Updated] (YARN-9771) Add GPU in the container-executor.cfg example

2019-08-26 Thread Eric Badger (Jira)
[ https://issues.apache.org/jira/browse/YARN-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-9771: -- Fix Version/s: 3.3.0 +1 lgtm. I committed this to trunk. Thanks [~kmarton] for the patch and

[jira] [Commented] (YARN-9786) testCancelledDelegationToken fails intermittently

2019-08-26 Thread Peter Bacsko (Jira)
[ https://issues.apache.org/jira/browse/YARN-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915916#comment-16915916 ] Peter Bacsko commented on YARN-9786: [~adam.antal] this is a duplicate of YARN-9461. It's been solved

[jira] [Commented] (YARN-9771) Add GPU in the container-executor.cfg example

2019-08-26 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915901#comment-16915901 ] Adam Antal commented on YARN-9771: -- +1 (non-binding) from me. > Add GPU in the container-executor.cfg

[jira] [Updated] (YARN-9786) testCancelledDelegationToken fails intermittently

2019-08-26 Thread Adam Antal (Jira)
[ https://issues.apache.org/jira/browse/YARN-9786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal updated YARN-9786: - Attachment: testCancelledDelegationToken.txt > testCancelledDelegationToken fails intermittently >

[jira] [Updated] (YARN-9781) SchedConfCli to get current stored scheduler configuration

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9781: Attachment: YARN-9781-002.patch > SchedConfCli to get current stored scheduler configuration >

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915896#comment-16915896 ] Hudson commented on YARN-8917: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17184 (See

[jira] [Created] (YARN-9786) testCancelledDelegationToken fails intermittently

2019-08-26 Thread Adam Antal (Jira)
Adam Antal created YARN-9786: Summary: testCancelledDelegationToken fails intermittently Key: YARN-9786 URL: https://issues.apache.org/jira/browse/YARN-9786 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915890#comment-16915890 ] Rohith Sharma K S commented on YARN-8917: - Committing shortly.. > Absolute (maximum) capacity of

[jira] [Commented] (YARN-9766) YARN CapacityScheduler QueueMetrics has missing metrics for parent queues having same name

2019-08-26 Thread Tarun Parimi (Jira)
[ https://issues.apache.org/jira/browse/YARN-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915884#comment-16915884 ] Tarun Parimi commented on YARN-9766: The test case failures dont seem to be related. > YARN

[jira] [Updated] (YARN-9785) Application gets activated even when AM memory has reached

2019-08-26 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9785: Description: Configure below property in resource-types.xml {quote} yarn.resource-types yarn.io/gpu

[jira] [Created] (YARN-9785) Application gets activated even when AM memory has reached

2019-08-26 Thread Bilwa S T (Jira)
Bilwa S T created YARN-9785: --- Summary: Application gets activated even when AM memory has reached Key: YARN-9785 URL: https://issues.apache.org/jira/browse/YARN-9785 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Szalay-Beko Mate (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szalay-Beko Mate reassigned YARN-9783: -- Assignee: Szalay-Beko Mate > Remove low-level zookeeper test to be able to build

[jira] [Commented] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915831#comment-16915831 ] Zhankun Tang commented on YARN-9607: Bulk update: Preparing for 3.1.3 release. moved all 3.1.3

[jira] [Commented] (YARN-9718) Yarn REST API, services endpoint remote command ejection

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915826#comment-16915826 ] Zhankun Tang commented on YARN-9718: Bulk update: Preparing for 3.1.3 release. moved all 3.1.3

[jira] [Updated] (YARN-9718) Yarn REST API, services endpoint remote command ejection

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9718: --- Target Version/s: 3.3.0, 3.2.1, 3.1.4 (was: 3.3.0, 3.2.1, 3.1.3) > Yarn REST API, services endpoint

[jira] [Updated] (YARN-9607) Auto-configuring rollover-size of IFile format for non-appendable filesystems

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9607: --- Target Version/s: 3.3.0, 3.2.1, 3.1.4 (was: 3.3.0, 3.2.1, 3.1.3) > Auto-configuring rollover-size of

[jira] [Updated] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8453: --- Target Version/s: 3.0.4, 3.1.4 (was: 3.0.4, 3.1.3) > Additional Unit tests to verify queue limit

[jira] [Commented] (YARN-8453) Additional Unit tests to verify queue limit and max-limit with multiple resource types

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915818#comment-16915818 ] Zhankun Tang commented on YARN-8453: Bulk update: Preparing for 3.1.3 release. moved all 3.1.3

[jira] [Commented] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915812#comment-16915812 ] Steve Loughran commented on YARN-9783: -- cut it > Remove low-level zookeeper test to be able to build

[jira] [Commented] (YARN-9642) AbstractYarnScheduler#clearPendingContainerCache could run even after transitiontostandby

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915799#comment-16915799 ] Zhankun Tang commented on YARN-9642: Triggered a rebuild just now. Let's see the result if it finishes

[jira] [Created] (YARN-9784) TestLeafQueue is flaky

2019-08-26 Thread Julia Kinga Marton (Jira)
Julia Kinga Marton created YARN-9784: Summary: TestLeafQueue is flaky Key: YARN-9784 URL: https://issues.apache.org/jira/browse/YARN-9784 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915788#comment-16915788 ] Hadoop QA commented on YARN-9714: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915758#comment-16915758 ] Hadoop QA commented on YARN-8917: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9771) Add GPU in the container-executor.cfg example

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915712#comment-16915712 ] Hadoop QA commented on YARN-9771: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Szalay-Beko Mate (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915704#comment-16915704 ] Szalay-Beko Mate commented on YARN-9783: [~ste...@apache.org], what do you think? > Remove

[jira] [Updated] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Szalay-Beko Mate (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szalay-Beko Mate updated YARN-9783: --- Description: ZooKeeper 3.5.5 release is the latest stable one. It contains many new features

[jira] [Updated] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Szalay-Beko Mate (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szalay-Beko Mate updated YARN-9783: --- Description: ZooKeeper 3.5.5 release is the latest stable one. It contains many new features

[jira] [Updated] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Szalay-Beko Mate (Jira)
[ https://issues.apache.org/jira/browse/YARN-9783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szalay-Beko Mate updated YARN-9783: --- Description: ZooKeeper 3.5.5 release is the latest stable one. It contains many new features

[jira] [Commented] (YARN-9766) YARN CapacityScheduler QueueMetrics has missing metrics for parent queues having same name

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915693#comment-16915693 ] Hadoop QA commented on YARN-9766: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-9783) Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5

2019-08-26 Thread Szalay-Beko Mate (Jira)
Szalay-Beko Mate created YARN-9783: -- Summary: Remove low-level zookeeper test to be able to build Hadoop against zookeeper 3.5.5 Key: YARN-9783 URL: https://issues.apache.org/jira/browse/YARN-9783

[jira] [Commented] (YARN-9780) SchedulerConf Mutation Api does not Allow Stop and Remove Queue in a single call

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915686#comment-16915686 ] Hadoop QA commented on YARN-9780: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915685#comment-16915685 ] Tao Yang commented on YARN-8193: Hi, [~sunilg], [~leftnoteasy]. Any updates or plans about this fix on

[jira] [Commented] (YARN-9779) NPE while allocating a container

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915684#comment-16915684 ] Tao Yang commented on YARN-9779: Sorry for the late reply. I think this issue is duplicate with YARN-8193.

[jira] [Issue Comment Deleted] (YARN-9779) NPE while allocating a container

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9779: --- Comment: was deleted (was: Sorry for the late reply. I think this issue is duplicate with YARN-8193.) > NPE

[jira] [Commented] (YARN-8678) Queue Management API - rephrase error messages

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915656#comment-16915656 ] Hadoop QA commented on YARN-8678: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2019-08-26 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915651#comment-16915651 ] Hadoop QA commented on YARN-8234: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9771) Add GPU in the container-executor.cfg example

2019-08-26 Thread Julia Kinga Marton (Jira)
[ https://issues.apache.org/jira/browse/YARN-9771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Julia Kinga Marton updated YARN-9771: - Attachment: YARN-9771.001.patch > Add GPU in the container-executor.cfg example >

[jira] [Updated] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9714: --- Attachment: YARN-9714.003.patch > ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915632#comment-16915632 ] Rohith Sharma K S commented on YARN-8917: - Thanks [~Tao Yang].. I will retriger jenkins again to

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915630#comment-16915630 ] Rohith Sharma K S commented on YARN-9714: - OK, sure. go ahead > ZooKeeper connection in

[jira] [Commented] (YARN-8917) Absolute (maximum) capacity of level3+ queues is wrongly calculated for absolute resource

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915628#comment-16915628 ] Tao Yang commented on YARN-8917: Hi, [~rohithsharma], I can't reproduce this failure on trunk branch in my

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915625#comment-16915625 ] Tao Yang commented on YARN-9714: We can close the connection after checking {{zkManager !=

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915613#comment-16915613 ] Rohith Sharma K S edited comment on YARN-9714 at 8/26/19 8:59 AM: -- I see.

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915613#comment-16915613 ] Rohith Sharma K S commented on YARN-9714: - I see. Thanks. May be fix could be check for curator

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915598#comment-16915598 ] Tao Yang edited comment on YARN-9714 at 8/26/19 8:45 AM: - Hi, [~rohithsharma]. I

[jira] [Comment Edited] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915598#comment-16915598 ] Tao Yang edited comment on YARN-9714 at 8/26/19 8:43 AM: - Hi, [~rohithsharma]. I

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Tao Yang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915598#comment-16915598 ] Tao Yang commented on YARN-9714: Hi, [~rohithsharma]. I have commented (over

[jira] [Commented] (YARN-9714) ZooKeeper connection in ZKRMStateStore leaks after RM transitioned to standby

2019-08-26 Thread Rohith Sharma K S (Jira)
[ https://issues.apache.org/jira/browse/YARN-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915586#comment-16915586 ] Rohith Sharma K S commented on YARN-9714: - In HA mode, we should NOT close the connection because

[jira] [Commented] (YARN-9779) NPE while allocating a container

2019-08-26 Thread Bilwa S T (Jira)
[ https://issues.apache.org/jira/browse/YARN-9779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915579#comment-16915579 ] Bilwa S T commented on YARN-9779: - Hi [~Amithsha] i think YARN-8193 takes care of this issue. Please check

[jira] [Updated] (YARN-8257) Native service should automatically adding escapes for environment/launch cmd before sending to YARN

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8257: --- Target Version/s: 3.1.4 (was: 3.1.3) Bulk update: Preparing for 3.1.3 release. Moved all 3.1.3

[jira] [Updated] (YARN-8417) Should skip passing HDFS_HOME, HADOOP_CONF_DIR, JAVA_HOME, etc. to Docker container.

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8417: --- Target Version/s: 3.1.4 (was: 3.1.3) Bulk update: Preparing for 3.1.3 release. Moved all 3.1.3

[jira] [Updated] (YARN-8052) Move overwriting of service definition during flex to service master

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8052: --- Target Version/s: 3.1.4 (was: 3.1.3) Bulk update: Preparing for 3.1.3 release. Moved all 3.1.3

[jira] [Updated] (YARN-8552) [DS] Container report fails for distributed containers

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8552: --- Target Version/s: 3.1.4 (was: 3.1.3) Bulk update: Preparing for 3.1.3 release. Moved all 3.1.3

[jira] [Updated] (YARN-8234) Improve RM system metrics publisher's performance by pushing events to timeline server in batch

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-8234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-8234: --- Target Version/s: 3.1.4 (was: 3.1.3) Bulk update: Preparing for 3.1.3 release. Moved all 3.1.3

[jira] [Commented] (YARN-9776) yarn logs throws an error "Not a valid BCFile"

2019-08-26 Thread Prabhu Joseph (Jira)
[ https://issues.apache.org/jira/browse/YARN-9776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16915556#comment-16915556 ] Prabhu Joseph commented on YARN-9776: - [~jordanagoodboy] Thanks for the update. Are we good to close

[jira] [Updated] (YARN-9376) too many ContainerIdComparator instances are not necessary

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9376: --- Bulk update: Preparing for 3.1.3 release. Moved the incorrect "3.1.2" non-blocker issues to 3.1.4,

[jira] [Updated] (YARN-9330) Add support to query scheduler endpoint filtered via queue (/scheduler/queue=abc)

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9330: --- Bulk update: Preparing for 3.1.3 release. Moved the incorrect "3.1.2" non-blocker issues to 3.1.4,

[jira] [Updated] (YARN-9674) Max AM Resource calculation is wrong

2019-08-26 Thread Zhankun Tang (Jira)
[ https://issues.apache.org/jira/browse/YARN-9674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhankun Tang updated YARN-9674: --- Bulk update: Preparing for 3.1.3 release. Moved the incorrect "3.1.2" non-blocker issues to 3.1.4,

  1   2   >