[jira] [Updated] (YARN-8794) QueuePlacementPolicy add more rules

[ https://issues.apache.org/jira/browse/YARN-8794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuai Zhang updated YARN-8794: -- Attachment: YARN-8794.002.patch > QueuePlacementPolicy add more rules >

[jira] [Created] (YARN-8811) Support Container Storage Interface (CSI) in YARN

Weiwei Yang created YARN-8811: - Summary: Support Container Storage Interface (CSI) in YARN Key: YARN-8811 URL: https://issues.apache.org/jira/browse/YARN-8811 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-7086) Release all containers aynchronously

[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623100#comment-16623100 ] Manikandan R commented on YARN-7086: [~jlowe] I did simple performance test to understand the

[jira] [Updated] (YARN-7086) Release all containers aynchronously

[ https://issues.apache.org/jira/browse/YARN-7086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikandan R updated YARN-7086: --- Attachment: YARN-7086.Perf-test-case.patch > Release all containers aynchronously >

[jira] [Comment Edited] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623035#comment-16623035 ] Tao Yang edited comment on YARN-8804 at 9/21/18 4:17 AM: - Thanks

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623040#comment-16623040 ] Tao Yang commented on YARN-8513: Hi, [~cyfdecyf] Dose your cluster have empty resource type? This problem

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623037#comment-16623037 ] Tao Yang commented on YARN-8804: Attached v2 patch to remove violate keyword and improve the calculation.

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.002.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in >

[jira] [Comment Edited] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623035#comment-16623035 ] Tao Yang edited comment on YARN-8804 at 9/21/18 4:05 AM: - Thanks

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623035#comment-16623035 ] Tao Yang commented on YARN-8804: Thanks [~jlowe],[~leftnoteasy] for your review and reply.  For the 

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622940#comment-16622940 ] Hadoop QA commented on YARN-8809: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

[ https://issues.apache.org/jira/browse/YARN-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622924#comment-16622924 ] Hadoop QA commented on YARN-8808: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

[ https://issues.apache.org/jira/browse/YARN-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622900#comment-16622900 ] Hadoop QA commented on YARN-8807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622887#comment-16622887 ] Hadoop QA commented on YARN-8658: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622862#comment-16622862 ] Hadoop QA commented on YARN-7599: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8809: - Attachment: YARN-8809-YARN-1011.01.patch > Fair Scheduler does not decrement queue metrics when

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622850#comment-16622850 ] Eric Yang commented on YARN-8777: - [~ebadger] I am confused by your statement. We have been using comma

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622845#comment-16622845 ] Haibo Chen commented on YARN-8809: -- I see. Will make the change and upload a new patch shortly. > Fair

[jira] [Updated] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

[ https://issues.apache.org/jira/browse/YARN-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8810: Priority: Minor (was: Major) > Yarn Service: discrepancy between hashcode and equals of ConfigFile

[jira] [Created] (YARN-8810) Yarn Service: discrepancy between hashcode and equals of ConfigFile

Chandni Singh created YARN-8810: --- Summary: Yarn Service: discrepancy between hashcode and equals of ConfigFile Key: YARN-8810 URL: https://issues.apache.org/jira/browse/YARN-8810 Project: Hadoop YARN

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622822#comment-16622822 ] Arun Suresh commented on YARN-8809: --- I believe {{TestOpportunisticContainerAllocatorAMService}} does

[jira] [Comment Edited] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622822#comment-16622822 ] Arun Suresh edited comment on YARN-8809 at 9/20/18 10:42 PM: - I believe

[jira] [Commented] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622813#comment-16622813 ] Hadoop QA commented on YARN-8658: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

[ https://issues.apache.org/jira/browse/YARN-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8808: - Attachment: YARN-8808-YARN-1011.00.patch > Use aggregate container utilization instead of node

[jira] [Commented] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622811#comment-16622811 ] Hadoop QA commented on YARN-8658: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622803#comment-16622803 ] Chandni Singh commented on YARN-8665: - [~eyang] thanks for review. About 2 {quote} The upgrades

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622797#comment-16622797 ] Haibo Chen commented on YARN-8809: -- Totally agreed. This goes back to my intention to keep the behavior

[jira] [Commented] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622788#comment-16622788 ] Young Chen commented on YARN-8658: -- Fixed unit test failure due to bug introduced by bad merge. >

[jira] [Updated] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-8658: - Attachment: YARN-8658-branch-2.11.patch > [AMRMProxy] Metrics for AMRMClientRelayer inside

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622784#comment-16622784 ] Arun Suresh commented on YARN-8809: --- Got it... So, in essence, FS has a unified code path for completing

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622771#comment-16622771 ] Jason Lowe commented on YARN-8804: -- >From the looks of YARN-8513 this appears to be a separate issue.

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622767#comment-16622767 ] Haibo Chen commented on YARN-1011: -- I'm +1 on moving this. > [Umbrella] Schedule containers based on

[jira] [Commented] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622765#comment-16622765 ] Eric Yang commented on YARN-8665: - [~csingh] Thank you for the patch. Patch 3 works correctly in my

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622762#comment-16622762 ] Haibo Chen commented on YARN-8809: -- The failed unit tests are all unrelated, see YARN-7387, YARN-8433 >

[jira] [Comment Edited] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622752#comment-16622752 ] Young Chen edited comment on YARN-8658 at 9/20/18 9:50 PM: --- Fixed indentation

[jira] [Commented] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622756#comment-16622756 ] Hadoop QA commented on YARN-8665: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622754#comment-16622754 ] Haibo Chen commented on YARN-8809: -- [~asuresh] The core change is the overriding of

[jira] [Commented] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622752#comment-16622752 ] Young Chen commented on YARN-8658: -- Fixed indentation issues from merging conflicts. yarn-common unit

[jira] [Updated] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-8658: - Attachment: YARN-8658-branch-2.10.patch > [AMRMProxy] Metrics for AMRMClientRelayer inside

[jira] [Updated] (YARN-7599) [GPG] ApplicationCleaner in Global Policy Generator

[ https://issues.apache.org/jira/browse/YARN-7599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Botong Huang updated YARN-7599: --- Attachment: YARN-7599-YARN-7402.v7.patch > [GPG] ApplicationCleaner in Global Policy Generator >

[jira] [Updated] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

[ https://issues.apache.org/jira/browse/YARN-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8807: - Attachment: YARN-8807-YARN-1011.00.patch > FairScheduler crashes RM with oversubscription turned on if an

[jira] [Updated] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

[ https://issues.apache.org/jira/browse/YARN-8807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8807: - Description: When an application, that has got opportunistic containers allocated, is killed, its

[jira] [Assigned] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simon Prewo reassigned YARN-8785: - Assignee: Simon Prewo > Error Message "Invalid docker rw mount" not helpful >

[jira] [Commented] (YARN-8789) Add BoundedQueue to AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622719#comment-16622719 ] Hadoop QA commented on YARN-8789: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8777) Container Executor C binary change to execute interactive docker command

[ https://issues.apache.org/jira/browse/YARN-8777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622690#comment-16622690 ] Eric Badger commented on YARN-8777: --- Thanks for the updated patch, [~eyang]! {noformat} +

[jira] [Commented] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622653#comment-16622653 ] Hadoop QA commented on YARN-8658: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622648#comment-16622648 ] Hadoop QA commented on YARN-8809: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622605#comment-16622605 ] Hadoop QA commented on YARN-8468: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622555#comment-16622555 ] Zian Chen commented on YARN-8805: - Thanks [~shaneku...@gmail.com], I'll work on the patch > Automatically

[jira] [Assigned] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zian Chen reassigned YARN-8805: --- Assignee: Zian Chen > Automatically convert the launch command to the exec form when using >

[jira] [Updated] (YARN-8665) Yarn Service Upgrade: Support cancelling upgrade

[ https://issues.apache.org/jira/browse/YARN-8665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chandni Singh updated YARN-8665: Attachment: YARN-8665.003.patch > Yarn Service Upgrade: Support cancelling upgrade >

[jira] [Reopened] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giovanni Matteo Fumarola reopened YARN-8658: Re-opening the Jira for Branch-2 patch. > [AMRMProxy] Metrics for

[jira] [Updated] (YARN-8658) [AMRMProxy] Metrics for AMRMClientRelayer inside FederationInterceptor

[ https://issues.apache.org/jira/browse/YARN-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Young Chen updated YARN-8658: - Attachment: YARN-8658-branch-2.09.patch > [AMRMProxy] Metrics for AMRMClientRelayer inside

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622518#comment-16622518 ] Hadoop QA commented on YARN-5215: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622503#comment-16622503 ] Shane Kumpf commented on YARN-8805: --- Thanks, [~Zian Chen]. Please feel free to take this. >

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622499#comment-16622499 ] Zian Chen commented on YARN-8805: - Yes, just checked the latest released doc,

[jira] [Commented] (YARN-8785) Error Message "Invalid docker rw mount" not helpful

[ https://issues.apache.org/jira/browse/YARN-8785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622495#comment-16622495 ] Zian Chen commented on YARN-8785: - Hi [~simonprewo], would you like to work on this Jira and provide a

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622460#comment-16622460 ] Wangda Tan commented on YARN-8804: -- Thanks [~Tao Yang] for the nice analysis, I'm not sure if YARN-8513

[jira] [Commented] (YARN-7225) Add queue and partition info to RM audit log

[ https://issues.apache.org/jira/browse/YARN-7225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622458#comment-16622458 ] Eric Payne commented on YARN-7225: -- Thanks [~jhung] for raising this issue. This came up for us recently

[jira] [Comment Edited] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622450#comment-16622450 ] Arun Suresh edited comment on YARN-1011 at 9/20/18 6:11 PM: Planning on

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622450#comment-16622450 ] Arun Suresh commented on YARN-1011: --- Planning on spending more cycles on this now. Looking at the

[jira] [Commented] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622445#comment-16622445 ] Arun Suresh commented on YARN-8809: --- Thanks for the patch [~haibochen].. >From the patch, it is not

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622438#comment-16622438 ] Zian Chen commented on YARN-8801: - Thank you [~eyang] > java doc comments in docker-util.h is confusing >

[jira] [Commented] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622433#comment-16622433 ] Antal Bálint Steinbach commented on YARN-8468: -- Hi [~leftnoteasy] Sure, I updated the title

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Description: When using any scheduler, you can use

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Summary: Enable the use of queue based maximum allocation limit and implement it

[jira] [Updated] (YARN-8468) Enable the use of queue based maximum container allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Summary: Enable the use of queue based maximum container allocation limit and

[jira] [Updated] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

[ https://issues.apache.org/jira/browse/YARN-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8808: - Attachment: (was: YARN-8808-YARN-1011.00.patch) > Use aggregate container utilization instead of node

[jira] [Updated] (YARN-8468) Enable queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Description: When using any scheduler, you can use

[jira] [Updated] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

[ https://issues.apache.org/jira/browse/YARN-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8808: - Attachment: YARN-8808-YARN-1011.00.patch > Use aggregate container utilization instead of node

[jira] [Updated] (YARN-8468) Enable queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Description: When using any scheduler, you can use

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622383#comment-16622383 ] Hudson commented on YARN-8801: -- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #15031 (See

[jira] [Updated] (YARN-8468) Enable queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Description: When using any scheduler, you can use

[jira] [Updated] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

[ https://issues.apache.org/jira/browse/YARN-8809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8809: - Attachment: YARN-8809-YARN-1011.00.patch > Fair Scheduler does not decrement queue metrics when

[jira] [Updated] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

[ https://issues.apache.org/jira/browse/YARN-8808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-8808: - Description: Resource oversubscription should be bound to the amount of the resources that can be

[jira] [Updated] (YARN-8468) Enable queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Description: When using any scheduler, you can use

[jira] [Updated] (YARN-8468) Enable queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Description: When using any scheduler, you can use

[jira] [Updated] (YARN-8468) Enable queue based maximum allocation limit and implement it in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Summary: Enable queue based maximum allocation limit and implement it in

[jira] [Updated] (YARN-8468) Limit container sizes per queue in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antal Bálint Steinbach updated YARN-8468: - Attachment: YARN-8468.016.patch > Limit container sizes per queue in

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Description: I recently came across a scenario where an MR ApplicationMaster was failing with an OOM

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622355#comment-16622355 ] Wangda Tan commented on YARN-8468: -- Thanks [~bsteinbach], I think YARN-8720 only covers the enforcement

[jira] [Created] (YARN-8809) Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released.

Haibo Chen created YARN-8809: Summary: Fair Scheduler does not decrement queue metrics when OPPORTUNISTIC containers are released. Key: YARN-8809 URL: https://issues.apache.org/jira/browse/YARN-8809

[jira] [Created] (YARN-8808) Use aggregate container utilization instead of node utilization to determine resources available for oversubscription

Haibo Chen created YARN-8808: Summary: Use aggregate container utilization instead of node utilization to determine resources available for oversubscription Key: YARN-8808 URL:

[jira] [Created] (YARN-8807) FairScheduler crashes RM with oversubscription turned on if an application is killed.

Haibo Chen created YARN-8807: Summary: FairScheduler crashes RM with oversubscription turned on if an application is killed. Key: YARN-8807 URL: https://issues.apache.org/jira/browse/YARN-8807 Project:

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622323#comment-16622323 ] Eric Payne commented on YARN-8774: -- [~Tao Yang], The patch and UT look good to me. However, I have one

[jira] [Updated] (YARN-8789) Add BoundedQueue to AsyncDispatcher

[ https://issues.apache.org/jira/browse/YARN-8789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated YARN-8789: -- Attachment: YARN-8789.3.patch > Add BoundedQueue to AsyncDispatcher >

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622281#comment-16622281 ] Jason Lowe commented on YARN-8804: -- Thanks for the report and patch! Nice analysis. A naked volatile

[jira] [Commented] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

[ https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622280#comment-16622280 ] Hadoop QA commented on YARN-8806: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

[ https://issues.apache.org/jira/browse/YARN-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622208#comment-16622208 ] Eric Yang commented on YARN-8805: - This has been documented in

[jira] [Updated] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

[ https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zac Zhou updated YARN-8806: --- Attachment: YARN-8806.002.patch > Enable local staging directory and clean it up when submarine job is

[jira] [Commented] (YARN-8801) java doc comments in docker-util.h is confusing

[ https://issues.apache.org/jira/browse/YARN-8801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622193#comment-16622193 ] Eric Yang commented on YARN-8801: - +1 > java doc comments in docker-util.h is confusing >

[jira] [Comment Edited] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622159#comment-16622159 ] Zac Zhou edited comment on YARN-8725 at 9/20/18 2:51 PM: - [~leftnoteasy],

[jira] [Commented] (YARN-8725) Submarine job staging directory has a lot of useless PRIMARY_WORKER-launch-script-***.sh scripts when submitting a job multiple times

[ https://issues.apache.org/jira/browse/YARN-8725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622159#comment-16622159 ] Zac Zhou commented on YARN-8725: [~leftnoteasy], [~tangzhankun]. Thanks a lot for your efforts to make

[jira] [Commented] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

[ https://issues.apache.org/jira/browse/YARN-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622156#comment-16622156 ] Hadoop QA commented on YARN-8806: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8806) Enable local staging directory and clean it up when submarine job is submitted

Zac Zhou created YARN-8806: -- Summary: Enable local staging directory and clean it up when submarine job is submitted Key: YARN-8806 URL: https://issues.apache.org/jira/browse/YARN-8806 Project: Hadoop YARN

[jira] [Commented] (YARN-8800) Updated documentation of Submarine with latest examples.

[ https://issues.apache.org/jira/browse/YARN-8800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622110#comment-16622110 ] Sunil Govindan commented on YARN-8800: -- Hi [~leftnoteasy] Cud u pls help in this ticket as its

[jira] [Commented] (YARN-8769) [Submarine] Allow user to specify customized quicklink(s) when submit Submarine job

[ https://issues.apache.org/jira/browse/YARN-8769?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622108#comment-16622108 ] Sunil Govindan commented on YARN-8769: -- +1. Committing shortly. > [Submarine] Allow user to specify

[jira] [Commented] (YARN-4858) start-yarn and stop-yarn scripts to support timeline and sharedcachemanager

[ https://issues.apache.org/jira/browse/YARN-4858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621948#comment-16621948 ] Hadoop QA commented on YARN-4858: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Created] (YARN-8805) Automatically convert the launch command to the exec form when using entrypoint support

Shane Kumpf created YARN-8805: - Summary: Automatically convert the launch command to the exec form when using entrypoint support Key: YARN-8805 URL: https://issues.apache.org/jira/browse/YARN-8805

[jira] [Commented] (YARN-7834) [GQ] Rebalance queue configuration for load-balancing and locality affinities

[ https://issues.apache.org/jira/browse/YARN-7834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621935#comment-16621935 ] Hadoop QA commented on YARN-7834: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

  1   2   >