[jira] [Updated] (YARN-4734) Merge branch:YARN-3368 to trunk

[ https://issues.apache.org/jira/browse/YARN-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-4734: - Attachment: YARN-4734.6.patch Attached ver.6 patch and waiting for Jenkins result. > Merge

[jira] [Commented] (YARN-2306) leak of reservation metrics (fair scheduler)

[ https://issues.apache.org/jira/browse/YARN-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247184#comment-15247184 ] Yufei Gu commented on YARN-2306: YARN-2399 fixed this bug in trunk. > leak of reservation metrics (fair

[jira] [Commented] (YARN-4890) Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate

[ https://issues.apache.org/jira/browse/YARN-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247169#comment-15247169 ] Bibin A Chundatt commented on YARN-4890: Improvement looks LGTM > Unit test intermittent failure:

[jira] [Updated] (YARN-4890) Unit test intermittent failure: TestNodeLabelContainerAllocation#testQueueUsedCapacitiesUpdate

[ https://issues.apache.org/jira/browse/YARN-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bibin A Chundatt updated YARN-4890: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4478 > Unit test intermittent failure:

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15247081#comment-15247081 ] Sean Po commented on YARN-4957: --- Thanks [~subru] for the comments. I updated the documentation to include

[jira] [Updated] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4957: -- Labels: api-breaking (was: ) > Add getNewReservation in ApplicationClientProtocol >

[jira] [Updated] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Po updated YARN-4957: -- Attachment: YARN-4957.v1.patch > Add getNewReservation in ApplicationClientProtocol >

[jira] [Commented] (YARN-4905) Improve Yarn log Command line option to show log metadata

[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246943#comment-15246943 ] Hadoop QA commented on YARN-4905: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246863#comment-15246863 ] Hadoop QA commented on YARN-4807: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246767#comment-15246767 ] Vrushali C commented on YARN-3150: -- Working through the deployment steps, will update it shortly >

[jira] [Commented] (YARN-3816) [Aggregation] App-level aggregation and accumulation for YARN system metrics

[ https://issues.apache.org/jira/browse/YARN-3816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246736#comment-15246736 ] Sangjin Lee commented on YARN-3816: --- Thanks for updating the patch [~gtCarrera9]! It appears that the

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246717#comment-15246717 ] Yufei Gu commented on YARN-4807: Thanks [~templedf] for all nice suggestions. The new patch I attached

[jira] [Commented] (YARN-4905) Improve Yarn log Command line option to show log metadata

[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246712#comment-15246712 ] Xuan Gong commented on YARN-4905: - Thanks for the review. Uploaded a new patch to address all the comments.

[jira] [Updated] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4807: --- Attachment: YARN-4807.010.patch > MockAM#waitForState sleep duration is too long >

[jira] [Updated] (YARN-4905) Improve Yarn log Command line option to show log metadata

[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4905: Attachment: YARN-4905.3.patch > Improve Yarn log Command line option to show log metadata >

[jira] [Updated] (YARN-4929) Explore a better way than sleeping for a while in some test cases

[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4929: --- Assignee: (was: Yufei Gu) > Explore a better way than sleeping for a while in some test cases >

[jira] [Updated] (YARN-4929) Explore a better way than sleeping for a while in some test cases

[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4929: --- Description: The following unit test cases failed because we removed the minimum wait time for attempt in

[jira] [Updated] (YARN-4929) Explore a better way than sleeping for a while in some test cases

[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4929: --- Summary: Explore a better way than sleeping for a while in some test cases (was: Explore a better way than

[jira] [Updated] (YARN-4929) Explore a better way than sleeping for a while (Fix test failures because of removing the minimum wait time for attempts.

[ https://issues.apache.org/jira/browse/YARN-4929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yufei Gu updated YARN-4929: --- Summary: Explore a better way than sleeping for a while (Fix test failures because of removing the minimum

[jira] [Commented] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246690#comment-15246690 ] Hadoop QA commented on YARN-4311: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4023) Publish Application Priority to TimelineServer

[ https://issues.apache.org/jira/browse/YARN-4023?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246650#comment-15246650 ] Jian He commented on YARN-4023: --- [~rohithsharma], [~sunilg], should we have a null check in publishing the

[jira] [Commented] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

[ https://issues.apache.org/jira/browse/YARN-4957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246606#comment-15246606 ] Subru Krishnan commented on YARN-4957: -- Thanks [~seanpo03] for working on this. I went through the

[jira] [Commented] (YARN-4747) AHS error 500 due to NPE when container start event is missing

[ https://issues.apache.org/jira/browse/YARN-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246546#comment-15246546 ] Eric Badger commented on YARN-4747: --- [~varun_saxena], are you still working on this? If not, I can take

[jira] [Updated] (YARN-4815) ATS 1.5 timelineclient impl try to create attempt directory for every event call

[ https://issues.apache.org/jira/browse/YARN-4815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Lu updated YARN-4815: Summary: ATS 1.5 timelineclient impl try to create attempt directory for every event call (was: ATS 1.5

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246396#comment-15246396 ] Hadoop QA commented on YARN-2883: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4905) Improve Yarn log Command line option to show log metadata

[ https://issues.apache.org/jira/browse/YARN-4905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246395#comment-15246395 ] Vinod Kumar Vavilapalli commented on YARN-4905: --- Thanks for working on this [~xgong], this is

[jira] [Commented] (YARN-4955) Add retry for SocketTimeoutException in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246298#comment-15246298 ] Vinod Kumar Vavilapalli commented on YARN-4955: --- The checkstyle warnings are spurious - they

[jira] [Commented] (YARN-2883) Queuing of container requests in the NM

[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246283#comment-15246283 ] Arun Suresh commented on YARN-2883: --- [~kasha], bq. As I said, for the config, I am comfortable filing a

[jira] [Updated] (YARN-2883) Queuing of container requests in the NM

[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Karanasos updated YARN-2883: - Attachment: YARN-2883.015.patch Fixing whitespace and checkstyle issues. >

[jira] [Commented] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246239#comment-15246239 ] Carlo Curino commented on YARN-4468: Thanks to [~subru] for rebasing/cleaning up and to [~asuresh] for

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246225#comment-15246225 ] Vrushali C commented on YARN-3150: -- Yes, will do it by today. > [Documentation] Documenting the timeline

[jira] [Commented] (YARN-4807) MockAM#waitForState sleep duration is too long

[ https://issues.apache.org/jira/browse/YARN-4807?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246217#comment-15246217 ] Daniel Templeton commented on YARN-4807: Thanks for the update, [~yufeigu]. Back to those loops...

[jira] [Commented] (YARN-3150) [Documentation] Documenting the timeline service v2

[ https://issues.apache.org/jira/browse/YARN-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246216#comment-15246216 ] Sangjin Lee commented on YARN-3150: --- I realized that the document is missing the steps for enabling the

[jira] [Commented] (YARN-4955) Add retry for SocketTimeoutException in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246209#comment-15246209 ] Hadoop QA commented on YARN-4955: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246173#comment-15246173 ] Sangjin Lee commented on YARN-4577: --- I think the above should be a viable solution that addresses all

[jira] [Commented] (YARN-4577) Enable aux services to have their own custom classpath/jar file

[ https://issues.apache.org/jira/browse/YARN-4577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246170#comment-15246170 ] Sangjin Lee commented on YARN-4577: --- Thanks for your comments [~vinodkv]. bq. Xuan Gong reminded me

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246141#comment-15246141 ] Sunil G commented on YARN-3362: --- I tested with both patches, and metrics was coming fine (tested w/o labels

[jira] [Commented] (YARN-4955) Add retry for SocketTimeoutException in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15246130#comment-15246130 ] Xuan Gong commented on YARN-4955: - update a new patch to fix the testcase > Add retry for

[jira] [Updated] (YARN-4955) Add retry for SocketTimeoutException in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-4955: Attachment: YARN-4955.6.patch > Add retry for SocketTimeoutException in TimelineClient >

[jira] [Commented] (YARN-4955) Add retry for SocketTimeoutException in TimelineClient

[ https://issues.apache.org/jira/browse/YARN-4955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245920#comment-15245920 ] Vinod Kumar Vavilapalli commented on YARN-4955: --- [~djp], whatever works - nested class or

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245787#comment-15245787 ] Naganarasimha G R commented on YARN-3362: - Oops let me apply both and test i had applied only the

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245728#comment-15245728 ] Eric Payne commented on YARN-3362: -- {quote} After applying the patch then partition usage information

[jira] [Commented] (YARN-3971) Skip RMNodeLabelsManager#checkRemoveFromClusterNodeLabelsOfQueue on nodelabel recovery

[ https://issues.apache.org/jira/browse/YARN-3971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245685#comment-15245685 ] Naganarasimha G R commented on YARN-3971: - Hi [~wangda] & [~bibinchundatt], Bibin has raised

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245669#comment-15245669 ] Naganarasimha G R commented on YARN-3362: - Hi [~eepayne], Thanks for providing the back ground, i

[jira] [Commented] (YARN-4954) TestYarnClient.testReservationAPIs fails on machines with less than 4 GB available memory

[ https://issues.apache.org/jira/browse/YARN-4954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245658#comment-15245658 ] Junping Du commented on YARN-4954: -- Thanks [~GergelyNovak] for reporting this issue and deliver the patch.

[jira] [Commented] (YARN-3362) Add node label usage in RM CapacityScheduler web UI

[ https://issues.apache.org/jira/browse/YARN-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245610#comment-15245610 ] Eric Payne commented on YARN-3362: -- {quote} - When i submit a app to a queue with default node label

[jira] [Updated] (YARN-4311) Removing nodes from include and exclude lists will not remove them from decommissioned nodes list

[ https://issues.apache.org/jira/browse/YARN-4311?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuhu Shukla updated YARN-4311: -- Attachment: YARN-4311-v15.patch Updated patch for addressing rebooted, lost NMs which adds logic to the

[jira] [Commented] (YARN-4966) More improvement to get Container logs without specify nodeId

[ https://issues.apache.org/jira/browse/YARN-4966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245229#comment-15245229 ] Hadoop QA commented on YARN-4966: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245212#comment-15245212 ] Naganarasimha G R commented on YARN-4963: - bq. I think application specific configurations should

[jira] [Commented] (YARN-4963) capacity scheduler: Make number of OFF_SWITCH assignments per heartbeat configurable

[ https://issues.apache.org/jira/browse/YARN-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15245187#comment-15245187 ] Rohith Sharma K S commented on YARN-4963: - Thanks [~nroberts] for initiating discussion on this. We