[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081723#comment-15081723 ] Varun Saxena commented on YARN-2902: [~djp], uploaded a patch backporting changes to branch-2.6 Changes

[jira] [Commented] (YARN-3446) FairScheduler HeadRoom calculation should exclude nodes in the blacklist.

[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081685#comment-15081685 ] Karthik Kambatla commented on YARN-3446: Sorry for not looking at this since the last update. Looks

[jira] [Updated] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-2902: --- Attachment: YARN-2902-branch-2.6.01.patch > Killing a container that is localizing can orphan

[jira] [Commented] (YARN-3446) FairScheduler HeadRoom calculation should exclude nodes in the blacklist.

[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081704#comment-15081704 ] Hadoop QA commented on YARN-3446: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-2575) Consider creating separate ACLs for Reservation create/update/delete/list ops

[ https://issues.apache.org/jira/browse/YARN-2575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081807#comment-15081807 ] Subru Krishnan commented on YARN-2575: -- I am wondering whether we have covered the behavior for the

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081550#comment-15081550 ] MENG DING commented on YARN-4528: - Hi, [~sandflee] With current logic, I think RM won't know if a

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081644#comment-15081644 ] Jason Lowe commented on YARN-3692: -- We cannot change the signature of the existing killApplication method

[jira] [Created] (YARN-4536) DelayedProcessKiller may not work under heavy workload

gu-chi created YARN-4536: Summary: DelayedProcessKiller may not work under heavy workload Key: YARN-4536 URL: https://issues.apache.org/jira/browse/YARN-4536 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4537: Summary: Pull out priority comparison from fifocomparator and use compound comparator for

[jira] [Created] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FIFOOrdering policy

Rohith Sharma K S created YARN-4537: --- Summary: Pull out priority comparison from fifocomparator and use compound comparator for FIFOOrdering policy Key: YARN-4537 URL:

[jira] [Updated] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4352: -- Issue Type: Bug (was: Sub-task) Parent: (was: YARN-4478) > Timeout for tests in TestYarnClient,

[jira] [Created] (YARN-4538) QueueMetrics pending cores and memory metrics wrong

Bibin A Chundatt created YARN-4538: -- Summary: QueueMetrics pending cores and memory metrics wrong Key: YARN-4538 URL: https://issues.apache.org/jira/browse/YARN-4538 Project: Hadoop YARN

[jira] [Commented] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081062#comment-15081062 ] Sunil G commented on YARN-4537: --- Thanks [~rohithsharma] for sharing the patch. Generally patch looks good.

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081043#comment-15081043 ] Hadoop QA commented on YARN-4528: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FIFOOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4537: Attachment: 0001-YARN-4537.patch > Pull out priority comparison from fifocomparator and use

[jira] [Commented] (YARN-4538) QueueMetrics pending cores and memory metrics wrong

[ https://issues.apache.org/jira/browse/YARN-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081051#comment-15081051 ] Rohith Sharma K S commented on YARN-4538: - Is this same as YARN-4481? > QueueMetrics pending

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081068#comment-15081068 ] Sunil G commented on YARN-4304: --- Test case failures are not-related. > AM max resource configuration per

[jira] [Commented] (YARN-4535) Fix checkstyle error in CapacityScheduler.java

[ https://issues.apache.org/jira/browse/YARN-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081065#comment-15081065 ] Hadoop QA commented on YARN-4535: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4538) QueueMetrics pending cores and memory metrics wrong

[ https://issues.apache.org/jira/browse/YARN-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081053#comment-15081053 ] Sunil G commented on YARN-4538: --- Hi [~bibinchundatt] Cud u pls upload and RM and NM logs. We are tracing

[jira] [Updated] (YARN-4535) Fix checkstyle error in CapacityScheduler.java

[ https://issues.apache.org/jira/browse/YARN-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-4535: Attachment: YARN-4535.v1.001.patch attaching the patch and includes no test case as this is

[jira] [Updated] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4479: Attachment: 0004-YARN-4479.patch Updated the patch fixing some of checkstyle and findbugs

[jira] [Commented] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080805#comment-15080805 ] Vinayakumar B commented on YARN-4352: - +1 LGTM > Timeout for tests in TestYarnClient, TestAMRMClient

[jira] [Commented] (YARN-4352) Timeout for tests in TestYarnClient, TestAMRMClient and TestNMClient

[ https://issues.apache.org/jira/browse/YARN-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15080806#comment-15080806 ] Vinayakumar B commented on YARN-4352: - Also can move to hadoop-common before committing since change is

[jira] [Updated] (YARN-4232) TopCLI console support for HA mode

[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4232: --- Attachment: 0002-YARN-4232.patch Attaching patch for review Cluster info proto added >

[jira] [Updated] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sandflee updated YARN-4528: --- Attachment: YARN-4528.01.patch 1, pending container decrease msg util next heartbeat. 2, nodemanager#allocate

[jira] [Updated] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-2902: - Target Version/s: 2.7.2, 2.6.4 (was: 2.7.2) > Killing a container that is localizing can orphan resources

[jira] [Commented] (YARN-4412) Create ClusterManager to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082079#comment-15082079 ] Arun Suresh commented on YARN-4412: --- i meant : "solicit feedback on the approah" :) > Create

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082083#comment-15082083 ] MENG DING commented on YARN-4528: - Honestly I don't think the design needs to be changed, unless other

[jira] [Updated] (YARN-4412) Create ClusterManager to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Summary: Create ClusterManager to compute ordered list of preferred NMs for OPPORTUNITIC containers

[jira] [Updated] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4265: Attachment: YARN-4265-trunk.002.patch Thanks [~djp] for the review! In the 002 patch I addressed most of the

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081950#comment-15081950 ] Bikas Saha commented on YARN-1011: -- In Tez we always try to allocated the most important work to the next

[jira] [Assigned] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4468: -- Assignee: Carlo Curino > Document the general ReservationSystem functionality, and the REST API

[jira] [Created] (YARN-4542) Cleanup AHS code and configuration

Junping Du created YARN-4542: Summary: Cleanup AHS code and configuration Key: YARN-4542 URL: https://issues.apache.org/jira/browse/YARN-4542 Project: Hadoop YARN Issue Type: Bug

[jira] [Updated] (YARN-4412) Create ClusterManager to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Attachment: YARN-4412-yarn-2877.v1.patch Attaching initial patch to solicit approach. It depends on

[jira] [Updated] (YARN-3154) Should not upload partial logs for MR jobs or other "short-running' applications

[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3154: - Target Version/s: 2.7.0, 2.6.4 (was: 2.7.0, 2.6.1) > Should not upload partial logs for MR jobs or other

[jira] [Commented] (YARN-3154) Should not upload partial logs for MR jobs or other "short-running' applications

[ https://issues.apache.org/jira/browse/YARN-3154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082012#comment-15082012 ] Junping Du commented on YARN-3154: -- Hi [~xgong] and [~vinodkv], shall we consider to backport the fix to

[jira] [Created] (YARN-4541) Change log message in LocalizedResource#handle() to DEBUG

Ray Chiang created YARN-4541: Summary: Change log message in LocalizedResource#handle() to DEBUG Key: YARN-4541 URL: https://issues.apache.org/jira/browse/YARN-4541 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-3089) LinuxContainerExecutor does not handle file arguments to deleteAsUser

[ https://issues.apache.org/jira/browse/YARN-3089?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082008#comment-15082008 ] Junping Du commented on YARN-3089: -- Hi [~eepayne] and [~jlowe], does this fix need to be cherry-picked to

[jira] [Commented] (YARN-4304) AM max resource configuration per partition to be displayed/updated correctly in UI and in various partition related metrics

[ https://issues.apache.org/jira/browse/YARN-4304?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081826#comment-15081826 ] Wangda Tan commented on YARN-4304: -- 1) REST response: amResourceLimit -> amLimit (it's a part of

[jira] [Updated] (YARN-4541) Change log message in LocalizedResource#handle() to DEBUG

[ https://issues.apache.org/jira/browse/YARN-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4541: - Description: This section of code can fill up a log fairly quickly. {quote} if (oldState !=

[jira] [Updated] (YARN-4541) Change log message in LocalizedResource#handle() to DEBUG

[ https://issues.apache.org/jira/browse/YARN-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4541: - Description: This section of code can fill up a log fairly quickly. {code} if (oldState !=

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082021#comment-15082021 ] Junping Du commented on YARN-2902: -- bq. However, YARN-3089 is unlikely to be backported to branch-2.6 I

[jira] [Updated] (YARN-4412) Create ClusterManager to compute ordered list of preferred NMs for OPPORTUNITIC containers

[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-4412: -- Description: Introduce a Cluster Manager that aggregates Load and Policy information from individual

[jira] [Updated] (YARN-4541) Change log message in LocalizedResource#handle() to DEBUG

[ https://issues.apache.org/jira/browse/YARN-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4541: - Attachment: YARN-4541.001.patch > Change log message in LocalizedResource#handle() to DEBUG >

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082000#comment-15082000 ] Junping Du commented on YARN-2902: -- Thanks [~varun_saxena] for replying and delivering the patch! bq. Also

[jira] [Updated] (YARN-4542) Cleanup AHS code and configuration

[ https://issues.apache.org/jira/browse/YARN-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4542: - Description: ATS (Application Timeline Sever/Service, we already have many versions so far) has been

[jira] [Commented] (YARN-3692) Allow REST API to set a user generated message when killing an application

[ https://issues.apache.org/jira/browse/YARN-3692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082086#comment-15082086 ] Naganarasimha G R commented on YARN-3692: - bq. We can still generate a useful diagnostic message

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082152#comment-15082152 ] Li Lu commented on YARN-4224: - Thanks [~varun_saxena]. I briefly looked at the endpoints, generally looked

[jira] [Commented] (YARN-4535) Fix checkstyle error in CapacityScheduler.java

[ https://issues.apache.org/jira/browse/YARN-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082338#comment-15082338 ] Naganarasimha G R commented on YARN-4535: - [~rohithsharma], Test case failures are not related to

[jira] [Commented] (YARN-4536) DelayedProcessKiller may not work under heavy workload

[ https://issues.apache.org/jira/browse/YARN-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082168#comment-15082168 ] Jun Gong commented on YARN-4536: [~gu chi] Thanks for explaining it. Yes, we also came across the problem,

[jira] [Commented] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082332#comment-15082332 ] Naganarasimha G R commented on YARN-4537: - Hi [~rohithsharma], +1 for the approach, Few nits in the

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082344#comment-15082344 ] Hadoop QA commented on YARN-4265: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4360: --- Attachment: YARN-4360.5.patch > Improve GreedyReservationAgent to support "early" allocations, and >

[jira] [Commented] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082157#comment-15082157 ] Hadoop QA commented on YARN-4360: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4459) container-executor might kill process wrongly

[ https://issues.apache.org/jira/browse/YARN-4459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082158#comment-15082158 ] Jun Gong commented on YARN-4459: Thanks [~Naganarasimha] for the review, very appreciate it! {quote} IIUC

[jira] [Commented] (YARN-3678) DelayedProcessKiller may kill other process other than container

[ https://issues.apache.org/jira/browse/YARN-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082201#comment-15082201 ] gu-chi commented on YARN-3678: -- same issue as confirmed with [~hex108] > DelayedProcessKiller may kill other

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082312#comment-15082312 ] Subru Krishnan commented on YARN-3870: -- Regarding the ID, I am in principle fine with asking the AM to

[jira] [Commented] (YARN-4232) TopCLI console support for HA mode

[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082262#comment-15082262 ] Hadoop QA commented on YARN-4232: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082301#comment-15082301 ] Li Lu commented on YARN-4224: - Ah one more question: in the original design, /flows will return a list of

[jira] [Resolved] (YARN-4536) DelayedProcessKiller may not work under heavy workload

[ https://issues.apache.org/jira/browse/YARN-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] gu-chi resolved YARN-4536. -- Resolution: Not A Problem As analyzed further, this is introduced by some custom modification, sorry if bother.

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082305#comment-15082305 ] Subru Krishnan commented on YARN-1011: -- [~kasha], I had an offline discussion with [~curino] and

[jira] [Commented] (YARN-4542) Cleanup AHS code and configuration

[ https://issues.apache.org/jira/browse/YARN-4542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082322#comment-15082322 ] Naganarasimha G R commented on YARN-4542: - Shall i take this up, [~djp] ? > Cleanup AHS code and

[jira] [Updated] (YARN-4224) Change the ATSv2 reader side REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4224: --- Attachment: YARN-4224-feature-YARN-2928.wip.03.patch > Change the ATSv2 reader side REST interface to

[jira] [Commented] (YARN-4536) DelayedProcessKiller may not work under heavy workload

[ https://issues.apache.org/jira/browse/YARN-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081122#comment-15081122 ] Jun Gong commented on YARN-4536: hi [~gu chi] thanks for reporting the issue. {quote}but the parent

[jira] [Updated] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith Sharma K S updated YARN-4537: Attachment: 0002-YARN-4537.patch updated the patch fixing comments > Pull out priority

[jira] [Commented] (YARN-4536) DelayedProcessKiller may not work under heavy workload

[ https://issues.apache.org/jira/browse/YARN-4536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081159#comment-15081159 ] gu-chi commented on YARN-4536: -- Thanks for reply, the process group I not realize, this seems introduced by

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081130#comment-15081130 ] Varun Saxena commented on YARN-2902: Yes this issue should exist in 2.6 too. I can help you with

[jira] [Commented] (YARN-3893) Both RM in active state when Admin#transitionToActive failure from refeshAll()

[ https://issues.apache.org/jira/browse/YARN-3893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081150#comment-15081150 ] Junping Du commented on YARN-3893: -- Thanks [~rohithsharma]! > Both RM in active state when

[jira] [Commented] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081194#comment-15081194 ] Sunil G commented on YARN-3849: --- Yes. [~djp] I will provide a patch for 2.6 now. > Too much of preemption

[jira] [Updated] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena updated YARN-4224: --- Summary: Support fetching entities by UID and change the REST interface to conform to current REST

[jira] [Commented] (YARN-4479) Retrospect app-priority in pendingOrderingPolicy during recovering applications

[ https://issues.apache.org/jira/browse/YARN-4479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081156#comment-15081156 ] Hadoop QA commented on YARN-4479: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081157#comment-15081157 ] Hadoop QA commented on YARN-4224: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081186#comment-15081186 ] Junping Du commented on YARN-3849: -- Mark this JIRA target to 2.6.4 per discussion above. > Too much of

[jira] [Updated] (YARN-3849) Too much of preemption activity causing continuos killing of containers across queues

[ https://issues.apache.org/jira/browse/YARN-3849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3849: - Target Version/s: 2.6.4 > Too much of preemption activity causing continuos killing of containers >

[jira] [Commented] (YARN-4535) Fix checkstyle error in CapacityScheduler.java

[ https://issues.apache.org/jira/browse/YARN-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082568#comment-15082568 ] Naganarasimha G R commented on YARN-4535: - thanks [~rohithsharma] for review and commit ! > Fix

[jira] [Updated] (YARN-3446) FairScheduler HeadRoom calculation should exclude nodes in the blacklist.

[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3446: Attachment: YARN-3446.004.patch > FairScheduler HeadRoom calculation should exclude nodes in the blacklist.

[jira] [Commented] (YARN-4535) Fix checkstyle error in CapacityScheduler.java

[ https://issues.apache.org/jira/browse/YARN-4535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082530#comment-15082530 ] Hudson commented on YARN-4535: -- FAILURE: Integrated in Hadoop-trunk-Commit #9048 (See

[jira] [Commented] (YARN-2902) Killing a container that is localizing can orphan resources in the DOWNLOADING state

[ https://issues.apache.org/jira/browse/YARN-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082460#comment-15082460 ] Varun Saxena commented on YARN-2902: bq. Does that means if we need to pull that fix, the patch here

[jira] [Commented] (YARN-4538) QueueMetrics pending cores and memory metrics wrong

[ https://issues.apache.org/jira/browse/YARN-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082564#comment-15082564 ] Bibin A Chundatt commented on YARN-4538: [~sunilg]/[~rohithsharma] Thank you for looking into the

[jira] [Updated] (YARN-4538) QueueMetrics pending cores and memory metrics wrong

[ https://issues.apache.org/jira/browse/YARN-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4538: --- Priority: Critical (was: Major) > QueueMetrics pending cores and memory metrics wrong >

[jira] [Commented] (YARN-3446) FairScheduler HeadRoom calculation should exclude nodes in the blacklist.

[ https://issues.apache.org/jira/browse/YARN-3446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15082601#comment-15082601 ] zhihai xu commented on YARN-3446: - thanks for the review! Just updated the patch at YARN-3446.004.patch. >

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081267#comment-15081267 ] MENG DING commented on YARN-4528: - Hi, [~sandflee] I am not quite sure about the benefit of directly

[jira] [Commented] (YARN-4539) CommonNodeLabelsManager throw NullPointerException when the fairScheduler init failed

[ https://issues.apache.org/jira/browse/YARN-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081292#comment-15081292 ] tangshangwen commented on YARN-4539: I think asyncDispatcher should check whether the null before

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081242#comment-15081242 ] Lei Guo commented on YARN-3870: --- I am not against to combine this JIRA and YARN-371, There is common ground

[jira] [Created] (YARN-4539) CommonNodeLabelsManager throw NullPointerException when the fairScheduler init failed

tangshangwen created YARN-4539: -- Summary: CommonNodeLabelsManager throw NullPointerException when the fairScheduler init failed Key: YARN-4539 URL: https://issues.apache.org/jira/browse/YARN-4539

[jira] [Commented] (YARN-4224) Support fetching entities by UID and change the REST interface to conform to current REST APIs' in YARN

[ https://issues.apache.org/jira/browse/YARN-4224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081294#comment-15081294 ] Varun Saxena commented on YARN-4224: The WIP patch addresses few of the comments above. Following

[jira] [Commented] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081263#comment-15081263 ] Hadoop QA commented on YARN-4537: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-4539) CommonNodeLabelsManager throw NullPointerException when the fairScheduler init failed

[ https://issues.apache.org/jira/browse/YARN-4539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] tangshangwen updated YARN-4539: --- Attachment: YARN-4539.1.patch > CommonNodeLabelsManager throw NullPointerException when the

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081322#comment-15081322 ] sandflee commented on YARN-4528: HI, [~mding], container decrease msg is passed like container complete

[jira] [Updated] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla updated YARN-1011: --- Attachment: yarn-1011-design-v1.pdf > [Umbrella] Schedule containers based on utilization of

[jira] [Commented] (YARN-4537) Pull out priority comparison from fifocomparator and use compound comparator for FifoOrdering policy

[ https://issues.apache.org/jira/browse/YARN-4537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081331#comment-15081331 ] Hadoop QA commented on YARN-4537: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081353#comment-15081353 ] Carlo Curino commented on YARN-4195: [~subru] thanks for the review. I agree with most of what you say.

[jira] [Commented] (YARN-1856) cgroups based memory monitoring for containers

[ https://issues.apache.org/jira/browse/YARN-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081359#comment-15081359 ] Karthik Kambatla commented on YARN-1856: Was catching up on YARN-3 (the JIRA that added cgroups) to

[jira] [Updated] (YARN-4232) TopCLI console support for HA mode

[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4232: --- Attachment: (was: 0002-YARN-4232.patch) > TopCLI console support for HA mode >

[jira] [Updated] (YARN-4232) TopCLI console support for HA mode

[ https://issues.apache.org/jira/browse/YARN-4232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4232: --- Attachment: 0002-YARN-4232.patch [~djp] /[~rohithsharma] Attaching patch again to trigger CI,

[jira] [Commented] (YARN-4541) Change log message in LocalizedResource#handle() to DEBUG

[ https://issues.apache.org/jira/browse/YARN-4541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081945#comment-15081945 ] Hadoop QA commented on YARN-4541: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4528) decreaseContainer Message maybe lost if NM restart

[ https://issues.apache.org/jira/browse/YARN-4528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081969#comment-15081969 ] sandflee commented on YARN-4528: thanks [~mding], yes this could happen, but rarely. should this affect the

[jira] [Commented] (YARN-4265) Provide new timeline plugin storage to support fine-grained entity caching

[ https://issues.apache.org/jira/browse/YARN-4265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081472#comment-15081472 ] Junping Du commented on YARN-4265: -- Thanks [~gtCarrera9] for clarification. Assume Jason is fine with

[jira] [Created] (YARN-4540) Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not working as expected

Mark S created YARN-4540: Summary: Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not working as expected Key: YARN-4540 URL: https://issues.apache.org/jira/browse/YARN-4540 Project:

[jira] [Updated] (YARN-4540) Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not working as expected

[ https://issues.apache.org/jira/browse/YARN-4540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark S updated YARN-4540: - Component/s: yarn > Yarn property "yarn.nodemanager.localizer.cache.cleanup.interval-ms" not > working as

  1   2   >