[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290590#comment-15290590 ] Hadoop QA commented on YARN-4866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290587#comment-15290587 ] Hadoop QA commented on YARN-4878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290580#comment-15290580 ] Arun Suresh commented on YARN-2877: --- [~jianhe], I just cherry-picked all sub-task patches

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290572#comment-15290572 ] Arun Suresh commented on YARN-2877: --- Thanks for investigation [~leftnoteasy] and [~djp]

[jira] [Commented] (YARN-5050) Code cleanup for TestDistributedShell

[ https://issues.apache.org/jira/browse/YARN-5050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290570#comment-15290570 ] Sangjin Lee commented on YARN-5050: --- I'm curious, don't we want to enable SYSTEM_METRICS_

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290569#comment-15290569 ] Hadoop QA commented on YARN-4308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290567#comment-15290567 ] Hadoop QA commented on YARN-5112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290553#comment-15290553 ] Hadoop QA commented on YARN-1942: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290545#comment-15290545 ] Hadoop QA commented on YARN-4844: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5113) Refactoring and other clean-up for YARN-2877

[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290542#comment-15290542 ] Hadoop QA commented on YARN-5113: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290509#comment-15290509 ] Hadoop QA commented on YARN-4957: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-5114) TestRMWebServicesApps#testInvalidAppAttempts failure

[ https://issues.apache.org/jira/browse/YARN-5114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290476#comment-15290476 ] Bibin A Chundatt commented on YARN-5114: Looks like YARN-4417 is not available in 2

[jira] [Created] (YARN-5114) TestRMWebServicesApps#testInvalidAppAttempts failure

Bibin A Chundatt created YARN-5114: -- Summary: TestRMWebServicesApps#testInvalidAppAttempts failure Key: YARN-5114 URL: https://issues.apache.org/jira/browse/YARN-5114 Project: Hadoop YARN Is

[jira] [Commented] (YARN-3840) Resource Manager web ui issue when sorting application by id (with application having id > 9999)

[ https://issues.apache.org/jira/browse/YARN-3840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290444#comment-15290444 ] Rohith Sharma K S commented on YARN-3840: - At first glance, test failures looks not

[jira] [Commented] (YARN-5016) Add support for a minimum retry interval

[ https://issues.apache.org/jira/browse/YARN-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290433#comment-15290433 ] Jun Gong commented on YARN-5016: Thanks [~vvasudev] for the review. Attach a new patch to a

[jira] [Updated] (YARN-5016) Add support for a minimum retry interval

[ https://issues.apache.org/jira/browse/YARN-5016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Gong updated YARN-5016: --- Attachment: YARN-5016.02.patch > Add support for a minimum retry interval > ---

[jira] [Commented] (YARN-5047) Refactor nodeUpdate across schedulers

[ https://issues.apache.org/jira/browse/YARN-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290416#comment-15290416 ] Karthik Kambatla commented on YARN-5047: Excited to see progress here. Thanks for w

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290352#comment-15290352 ] Daniel Templeton commented on YARN-4464: Whoops. The patch got merged with another

[jira] [Commented] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290312#comment-15290312 ] Hadoop QA commented on YARN-5110: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (YARN-5111) YARN container system metrics are not aggregated to application

[ https://issues.apache.org/jira/browse/YARN-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-5111: --- Assignee: Naganarasimha G R > YARN container system metrics are not aggregated to appl

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290289#comment-15290289 ] Naganarasimha G R commented on YARN-4464: - Hi [~templedf], Seems like latest patch

[jira] [Updated] (YARN-4987) Read cache concurrency issue between read and evict in EntityGroupFS timeline store

[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4987: Attachment: YARN-4987-trunk.003.patch 003 patch addresses checkstyle issues. > Read cache concurrency issue between

[jira] [Commented] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290275#comment-15290275 ] Hudson commented on YARN-5110: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9819 (See [https:

[jira] [Commented] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290261#comment-15290261 ] Hadoop QA commented on YARN-4866: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Parent Issue: YARN-2877 (was: YARN-4742) > Fix OpportunisticContainerAllocator to insert complete HostAd

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290257#comment-15290257 ] Hadoop QA commented on YARN-4878: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Description: * Minor fix required in {{OpportunisticContainerAllocator}} : Fix ContainerTokenIdentifier:

[jira] [Updated] (YARN-5110) Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Summary: Fix OpportunisticContainerAllocator to insert complete HostAddress in issued ContainerTokenIds

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290249#comment-15290249 ] Hadoop QA commented on YARN-4308: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290250#comment-15290250 ] Hadoop QA commented on YARN-4464: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5110) Minor fixes for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Description: * Minor fix required in {{OpportunisticContainerAllocator}} : Fix ContainerTokenIdentifier:

[jira] [Commented] (YARN-4987) Read cache concurrency issue between read and evict in EntityGroupFS timeline store

[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290247#comment-15290247 ] Hadoop QA commented on YARN-4987: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for YARN-2877

[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5113: - Description: This JIRA focuses on the refactoring of classes related to YARN-2877.

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for YARN-2877

[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5113: - Attachment: YARN-5113.001.patch Adding first version of the patch. > Refactoring a

[jira] [Commented] (YARN-5110) Minor fixes for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290244#comment-15290244 ] Arun Suresh commented on YARN-5110: --- Committing this shortly... Thanks again [~kkaranasos

[jira] [Commented] (YARN-5110) Minor fixes for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290242#comment-15290242 ] Arun Suresh commented on YARN-5110: --- [~kkaranasos], lets stick with the 002 version of th

[jira] [Updated] (YARN-5113) Refactoring and other clean-up for YARN-2877

[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5113: -- Assignee: Konstantinos Karanasos (was: Arun Suresh) > Refactoring and other clean-up for YARN-2877 > ---

[jira] [Created] (YARN-5113) Refactoring and other clean-up for YARN-2877

Arun Suresh created YARN-5113: - Summary: Refactoring and other clean-up for YARN-2877 Key: YARN-5113 URL: https://issues.apache.org/jira/browse/YARN-5113 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Assigned] (YARN-5113) Refactoring and other clean-up for YARN-2877

[ https://issues.apache.org/jira/browse/YARN-5113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh reassigned YARN-5113: - Assignee: Arun Suresh > Refactoring and other clean-up for YARN-2877 > ---

[jira] [Updated] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Attachment: (was: YARN-5110.003.patch) > Minor fixes and refactoring for Distributed Scheduling > ---

[jira] [Updated] (YARN-5110) Minor fixes for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Summary: Minor fixes for Distributed Scheduling (was: Minor fixes and refactoring for Distributed Schedu

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290232#comment-15290232 ] Hadoop QA commented on YARN-5112: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5110: - Attachment: YARN-5110.003.patch Attaching new version with more refactoring and min

[jira] [Commented] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290210#comment-15290210 ] Hadoop QA commented on YARN-5110: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290208#comment-15290208 ] Yufei Gu commented on YARN-4878: My visual diff has the same problem. I tried some ways to

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290199#comment-15290199 ] Ray Chiang commented on YARN-4878: -- Oh weird. My visual diff made it look like "public sy

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290194#comment-15290194 ] Carlo Curino commented on YARN-4957: [~seanpo03] thanks for addressing my comments righ

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290175#comment-15290175 ] Sean Po commented on YARN-4957: --- The following are all the test failures with this patch. Bel

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290166#comment-15290166 ] Sangjin Lee commented on YARN-5109: --- Here is a proposal. Instead of blindly splitting alo

[jira] [Commented] (YARN-4457) Cleanup unchecked types for EventHandler

[ https://issues.apache.org/jira/browse/YARN-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290164#comment-15290164 ] Daniel Templeton commented on YARN-4457: Oh, [~kasha], if only it were that simple.

[jira] [Commented] (YARN-5112) Excessive log warnings on NM recovery

[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290125#comment-15290125 ] Jian He commented on YARN-5112: --- move the check and init part to the common LogAggregationSer

[jira] [Updated] (YARN-5112) Excessive log warnings on NM recovery

[ https://issues.apache.org/jira/browse/YARN-5112?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-5112: -- Attachment: YARN-5112.patch > Excessive log warnings on NM recovery > - > >

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Templeton updated YARN-4464: --- Attachment: YARN-4664.002.patch Added the yarn-defaults.xml change. > default value of yarn.re

[jira] [Updated] (YARN-4987) Read cache concurrency issue between read and evict in EntityGroupFS timeline store

[ https://issues.apache.org/jira/browse/YARN-4987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4987: Attachment: YARN-4987-trunk.002.patch Thanks [~djp] for the review! I addressed your comments in the latest patch. A

[jira] [Commented] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290090#comment-15290090 ] Arun Suresh commented on YARN-5110: --- Most of the test failures look un-related and are be

[jira] [Updated] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Attachment: YARN-5110.002.patch > Minor fixes and refactoring for Distributed Scheduling > --

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290083#comment-15290083 ] Daniel Templeton commented on YARN-4308: I'd go one step further and ask that the c

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290080#comment-15290080 ] Vrushali C commented on YARN-5093: -- Alright, I chatted with Sangjin offline. I think we

[jira] [Commented] (YARN-5107) TestContainerMetrics fails

[ https://issues.apache.org/jira/browse/YARN-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290070#comment-15290070 ] Arun Suresh commented on YARN-5107: --- +1, looks good.. > TestContainerMetrics fails > ---

[jira] [Updated] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4878: --- Attachment: YARN-4878.003.patch Upload patch 003 for [~rchiang]'s comments. > Expose scheduling policy and ma

[jira] [Commented] (YARN-5107) TestContainerMetrics fails

[ https://issues.apache.org/jira/browse/YARN-5107?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290054#comment-15290054 ] Daniel Templeton commented on YARN-5107: LGTM. +1 (non-binding). What I want to k

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290053#comment-15290053 ] Yufei Gu commented on YARN-4878: Thanks [~rchiang] for reviewing. 1. Nice point. 2. Since

[jira] [Updated] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4957: -- Attachment: YARN-4957.v7.patch YARN-4957.v7.patch addresses Carlo's comments and fixes the checkstyle and javado

[jira] [Updated] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun Suresh updated YARN-5110: -- Description: * Couple of Logs can be moved to debug rather than info * Minor fix required in {{Opportunis

[jira] [Created] (YARN-5112) Excessive log warnings on NM recovery

Jian He created YARN-5112: - Summary: Excessive log warnings on NM recovery Key: YARN-5112 URL: https://issues.apache.org/jira/browse/YARN-5112 Project: Hadoop YARN Issue Type: Bug Reporte

[jira] [Commented] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15290019#comment-15290019 ] Hadoop QA commented on YARN-5110: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-1942) Many of ConverterUtils methods need to have public interfaces

[ https://issues.apache.org/jira/browse/YARN-1942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-1942: - Attachment: YARN-1942.6.patch Attached ver.6 patch addressed more warnings. > Many of ConverterUtils metho

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289950#comment-15289950 ] Sean Po commented on YARN-4957: --- Are the classes "@Stable"? the methods are marked "@Unstable

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289917#comment-15289917 ] Sangjin Lee commented on YARN-5093: --- It is getting written. It's that subsequent writes f

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289911#comment-15289911 ] Ray Chiang commented on YARN-4464: -- Nope. Thanks for the explanation. > default value of

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289906#comment-15289906 ] Karthik Kambatla commented on YARN-4464: bq. If we change the default value to 0 Th

[jira] [Commented] (YARN-4999) [YARN-3368] Fix licensing issues in new Yarn-ui

[ https://issues.apache.org/jira/browse/YARN-4999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289904#comment-15289904 ] Wangda Tan commented on YARN-4999: -- +1, thanks [~sunilg] > [YARN-3368] Fix licensing issu

[jira] [Commented] (YARN-4494) Recover completed apps asynchronously

[ https://issues.apache.org/jira/browse/YARN-4494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289900#comment-15289900 ] Karthik Kambatla commented on YARN-4494: I am okay with asynchronous recovery so lo

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289895#comment-15289895 ] Sangjin Lee commented on YARN-5109: --- I spoke with [~jrottinghuis] offline about this. Ini

[jira] [Commented] (YARN-4882) Change the log level to DEBUG for recovering completed applications

[ https://issues.apache.org/jira/browse/YARN-4882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289885#comment-15289885 ] Karthik Kambatla commented on YARN-4882: Thanks for your inputs, [~jlowe]. I would

[jira] [Commented] (YARN-5001) Aggregated Logs root directory is created with wrong group if nonexistent

[ https://issues.apache.org/jira/browse/YARN-5001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289882#comment-15289882 ] Ray Chiang commented on YARN-5001: -- +1 (nonbinding). Looks like a simple enough change.

[jira] [Updated] (YARN-4844) Add getMemoryLong/getVirtualCoreLong to o.a.h.y.api.records.Resource

[ https://issues.apache.org/jira/browse/YARN-4844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4844: - Attachment: YARN-4844.10.patch Attached ver.10 patch, removed all YARN/MR internal usages of {{int getMemo

[jira] [Updated] (YARN-4866) FairScheduler: AMs can consume all vcores leading to a livelock when using FAIR policy

[ https://issues.apache.org/jira/browse/YARN-4866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4866: --- Attachment: YARN-4866.005.patch Thanks [~kasha] for reviewing. I upload a new patch for all suggestions. > F

[jira] [Updated] (YARN-5110) Minor fixes and refactoring for Distributed Scheduling

[ https://issues.apache.org/jira/browse/YARN-5110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-5110: - Attachment: YARN-5110.001.patch Attaching an intermediate version of the patch just

[jira] [Commented] (YARN-4766) NM should not aggregate logs older than the retention policy

[ https://issues.apache.org/jira/browse/YARN-4766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289743#comment-15289743 ] Ray Chiang commented on YARN-4766: -- Minor nit: Rename noMoreRetentionLogFiles to obsoleteR

[jira] [Commented] (YARN-5093) created time shows 0 in most REST output

[ https://issues.apache.org/jira/browse/YARN-5093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289720#comment-15289720 ] Vrushali C commented on YARN-5093: -- Related jira for "correctly set createdTime and remove

[jira] [Updated] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ray Chiang updated YARN-4464: - Target Version/s: 3.0.0-alpha1 > default value of yarn.resourcemanager.state-store.max-completed-applicatio

[jira] [Commented] (YARN-4464) default value of yarn.resourcemanager.state-store.max-completed-applications should lower.

[ https://issues.apache.org/jira/browse/YARN-4464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289707#comment-15289707 ] Ray Chiang commented on YARN-4464: -- Agree about making this trunk-only. One thought. If

[jira] [Updated] (YARN-5076) YARN web interfaces lack XFS protection

[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Maron updated YARN-5076: - Attachment: YARN-5076.003.patch [~vvasudev] - please review and see if this addresses the changes r

[jira] [Commented] (YARN-4878) Expose scheduling policy and max running apps over JMX for Yarn queues

[ https://issues.apache.org/jira/browse/YARN-4878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289697#comment-15289697 ] Ray Chiang commented on YARN-4878: -- Some minor nitpicks: - Change the metric description

[jira] [Commented] (YARN-5109) timestamps are stored unencoded causing parse errors

[ https://issues.apache.org/jira/browse/YARN-5109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289571#comment-15289571 ] Sangjin Lee commented on YARN-5109: --- These are the all the cases of "naked" joins: {nofor

[jira] [Updated] (YARN-5055) max per user can be larger than max per queue

[ https://issues.apache.org/jira/browse/YARN-5055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated YARN-5055: -- Attachment: YARN-5055.001.patch Attaching patch that limits the max per user application limit to the max

[jira] [Commented] (YARN-4876) [Phase 1] Decoupled Init / Destroy of Containers from Start / Stop

[ https://issues.apache.org/jira/browse/YARN-4876?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289656#comment-15289656 ] Varun Vasudev commented on YARN-4876: - Thanks for the patch [~marco.rabozzi]! Can you p

[jira] [Updated] (YARN-4751) In 2.7, Labeled queue usage not shown properly in capacity scheduler UI

[ https://issues.apache.org/jira/browse/YARN-4751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Payne updated YARN-4751: - Attachment: YARN-4751-branch-2.7.005.patch Thanks, [~Naganarasimha]. You are correct, most of the findbugs

[jira] [Created] (YARN-5111) YARN container system metrics are not aggregated to application

Sangjin Lee created YARN-5111: - Summary: YARN container system metrics are not aggregated to application Key: YARN-5111 URL: https://issues.apache.org/jira/browse/YARN-5111 Project: Hadoop YARN

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289535#comment-15289535 ] Wangda Tan commented on YARN-2877: -- An additional note: Junping and I investigated PB com

[jira] [Commented] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289516#comment-15289516 ] Yufei Gu commented on YARN-5077: Thanks [~kasha] for reviewing. To filter out the non-act

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Attachment: YARN-5077.003.patch > Fix FSLeafQueue#getFairShare() for queues with weight 0.0 > -

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Attachment: (was: YARN-5077.003.patch) > Fix FSLeafQueue#getFairShare() for queues with weight 0.0 > --

[jira] [Updated] (YARN-5077) Fix FSLeafQueue#getFairShare() for queues with weight 0.0

[ https://issues.apache.org/jira/browse/YARN-5077?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-5077: --- Attachment: YARN-5077.003.patch > Fix FSLeafQueue#getFairShare() for queues with weight 0.0 > -

[jira] [Commented] (YARN-5076) YARN web interfaces lack XFS protection

[ https://issues.apache.org/jira/browse/YARN-5076?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289507#comment-15289507 ] Junping Du commented on YARN-5076: -- Yes. Varun's list above is exactly what I prefer. Plea

[jira] [Commented] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289509#comment-15289509 ] Naganarasimha G R commented on YARN-4308: - Thanks for the patch [~sunilg], Patch se

[jira] [Updated] (YARN-4832) NM side resource value should get updated if change applied in RM side

[ https://issues.apache.org/jira/browse/YARN-4832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-4832: - Target Version/s: 2.8.0, 2.7.4 (was: 2.8.0) > NM side resource value should get updated if change applied

[jira] [Updated] (YARN-4308) ContainersAggregated CPU resource utilization reports negative usage in first few heartbeats

[ https://issues.apache.org/jira/browse/YARN-4308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-4308: -- Attachment: 0003-YARN-4308.patch Updating new patch as per the discussion. Kindly help to check the same. > Cont

[jira] [Commented] (YARN-4925) ContainerRequest in AMRMClient, application should be able to specify nodes/racks together with nodeLabelExpression

[ https://issues.apache.org/jira/browse/YARN-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15289440#comment-15289440 ] Hudson commented on YARN-4925: -- SUCCESS: Integrated in Hadoop-trunk-Commit #9816 (See [https:

  1   2   >