[jira] [Updated] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rohith updated YARN-3494: - Attachment: 0001-YARN-3494.patch > Expose AM resource limit and user limit in QueueMetrics > -

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502635#comment-14502635 ] Rohith commented on YARN-3494: -- Updated the patch adding metric for AMResourceLimit, UserAMRes

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502707#comment-14502707 ] Rohith commented on YARN-3494: -- One self review is move below code to setupQueueConfigs. Will

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502713#comment-14502713 ] Hadoop QA commented on YARN-3494: - {color:green}+1 overall{color}. Here are the results of

[jira] [Resolved] (YARN-3177) Fix the order of the parameters in YarnConfiguration

[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula resolved YARN-3177. Resolution: Not A Problem > Fix the order of the parameters in YarnConfiguration > --

[jira] [Commented] (YARN-3177) Fix the order of the parameters in YarnConfiguration

[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502746#comment-14502746 ] Brahma Reddy Battula commented on YARN-3177: Closing this issue.. > Fix the or

[jira] [Commented] (YARN-3177) Fix the order of the parameters in YarnConfiguration

[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502750#comment-14502750 ] Brahma Reddy Battula commented on YARN-3177: Agreed with chris..Hence closing t

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502813#comment-14502813 ] Wilfred Spiegelenburg commented on YARN-3491: - Could this change not cause a ne

[jira] [Resolved] (YARN-3502) Expose number of unhealthy disks on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev resolved YARN-3502. - Resolution: Won't Fix > Expose number of unhealthy disks on NM via JMX > --

[jira] [Commented] (YARN-3502) Expose number of unhealthy disks on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502888#comment-14502888 ] Varun Vasudev commented on YARN-3502: - There is a lot of common work between this and Y

[jira] [Updated] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Summary: Expose disk utilization percentage and bad disk counts on NM via JMX (was: Expose disk util

[jira] [Updated] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Attachment: YARN-3503.0.patch First cut of the patch. Currently exposes the information only via JMX.

[jira] [Updated] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Vasudev updated YARN-3503: Description: It would be useful to expose the disk utilization as well as the number of bad local dis

[jira] [Updated] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3497: - Attachment: YARN-3497.002.patch Thanks for the review, Jian! I updated the patch to use this.conf when set

[jira] [Commented] (YARN-3503) Expose disk utilization percentage and bad disk counts on NM via JMX

[ https://issues.apache.org/jira/browse/YARN-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14502951#comment-14502951 ] Hadoop QA commented on YARN-3503: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503019#comment-14503019 ] Hadoop QA commented on YARN-3497: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503043#comment-14503043 ] Jason Lowe commented on YARN-2004: -- I don't think it matters if we allow negative prioriti

[jira] [Updated] (YARN-3445) NM notify RM on running Apps in NM-RM heartbeat

[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3445: - Attachment: YARN-3445.patch Upload a patch. > NM notify RM on running Apps in NM-RM heartbeat > --

[jira] [Created] (YARN-3508) Preemption processing occuring on the main RM dispatcher

Jason Lowe created YARN-3508: Summary: Preemption processing occuring on the main RM dispatcher Key: YARN-3508 URL: https://issues.apache.org/jira/browse/YARN-3508 Project: Hadoop YARN Issue Type

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503105#comment-14503105 ] Junping Du commented on YARN-3366: -- Thanks [~sidharta-s] for updating the patch! The lates

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503133#comment-14503133 ] Zhijie Shen commented on YARN-3046: --- Another issue: Shall we do nullcheck in TimelineEve

[jira] [Assigned] (YARN-3508) Preemption processing occuring on the main RM dispatcher

[ https://issues.apache.org/jira/browse/YARN-3508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Varun Saxena reassigned YARN-3508: -- Assignee: Varun Saxena > Preemption processing occuring on the main RM dispatcher >

[jira] [Created] (YARN-3509) CollectorNodemanagerProtocol's authorization doesn't work

Zhijie Shen created YARN-3509: - Summary: CollectorNodemanagerProtocol's authorization doesn't work Key: YARN-3509 URL: https://issues.apache.org/jira/browse/YARN-3509 Project: Hadoop YARN Issue T

[jira] [Commented] (YARN-3445) NM notify RM on running Apps in NM-RM heartbeat

[ https://issues.apache.org/jira/browse/YARN-3445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503153#comment-14503153 ] Hadoop QA commented on YARN-3445: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503158#comment-14503158 ] Sunil G commented on YARN-2004: --- Thank you very much for the comments. bq. default of defaul

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503175#comment-14503175 ] Junping Du commented on YARN-3046: -- bq. Shall we do nullcheck in TimelineEvent. Theoretica

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Attachment: YARN-3046-v4.patch Upload a patch against v3 with removing changes in TimelineEvent. > [Event

[jira] [Created] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

Craig Welch created YARN-3510: - Summary: Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness Key: YARN-3510 URL: ht

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503181#comment-14503181 ] Sidharta Seethana commented on YARN-3366: - Thanks, [~djp] ! > Outbound network ban

[jira] [Commented] (YARN-2369) Environment variable handling assumes values should be appended

[ https://issues.apache.org/jira/browse/YARN-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503230#comment-14503230 ] Dustin Cote commented on YARN-2369: --- I don't see a unit test suite dealing with env varia

[jira] [Updated] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-3510: - Issue Type: Sub-task (was: Improvement) Parent: YARN-3306 > Create an extension of ProportionalCap

[jira] [Commented] (YARN-3510) Create an extension of ProportionalCapacityPreemptionPolicy which preempts a number of containers from each application in a way which respects fairness

[ https://issues.apache.org/jira/browse/YARN-3510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503244#comment-14503244 ] Wangda Tan commented on YARN-3510: -- Put this as a subtask of YARN-3306 to better tracking.

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503258#comment-14503258 ] zhihai xu commented on YARN-3464: - Thanks [~kasha] for the detail explanation. For the sugg

[jira] [Commented] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503265#comment-14503265 ] Jian He commented on YARN-3497: --- looks good , + 1 > ContainerManagementProtocolProxy modifie

[jira] [Commented] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503283#comment-14503283 ] Hudson commented on YARN-3497: -- FAILURE: Integrated in Hadoop-trunk-Commit #7617 (See [https:

[jira] [Updated] (YARN-3509) CollectorNodemanagerProtocol's authorization doesn't work

[ https://issues.apache.org/jira/browse/YARN-3509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhijie Shen updated YARN-3509: -- Attachment: YARN-3509.1.patch Created a patch to fix the problem > CollectorNodemanagerProtocol's author

[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed

[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503294#comment-14503294 ] Ravi Prakash commented on YARN-3500: We have gone back and forth on paging server side

[jira] [Created] (YARN-3511) Add errors and warnings page to ATS

Varun Vasudev created YARN-3511: --- Summary: Add errors and warnings page to ATS Key: YARN-3511 URL: https://issues.apache.org/jira/browse/YARN-3511 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503302#comment-14503302 ] Wangda Tan commented on YARN-3463: -- bq. I have to say I prefer getInfo to getStatusMessage

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503305#comment-14503305 ] Jian He commented on YARN-3463: --- patch looks good to me. bq. as getStatusMessage suggests to

[jira] [Updated] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3492: -- Target Version/s: 2.7.1 (was: 2.7.0) bq. I took your mapred-site.xml and yarn-si

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.70.patch Ok, getInfo it is, attached > Integrate OrderingPolicy Framework with Cap

[jira] [Updated] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3481: -- Target Version/s: 2.8.0 (was: 2.7.0) 2.7.0 is done, please don't use in-progress

[jira] [Updated] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated YARN-3481: -- Priority: Major (was: Minor) > Report NM aggregated container resource utilizati

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503328#comment-14503328 ] Karthik Kambatla commented on YARN-3464: [~jlowe] - do you think any of my earlier

[jira] [Updated] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-2740: Attachment: YARN-2740.20150420-1.patch Hi [~wangda], i have updated the patch with the requir

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1450#comment-1450 ] Vinod Kumar Vavilapalli commented on YARN-3481: --- We should decouple the recor

[jira] [Updated] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2003: -- Attachment: 00010-YARN-2003.patch Removing dependency with YARN-2004. > Support to process Job priority from Su

[jira] [Commented] (YARN-2729) Support script based NodeLabelsProvider Interface in Distributed Node Label Configuration Setup

[ https://issues.apache.org/jira/browse/YARN-2729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503339#comment-14503339 ] Naganarasimha G R commented on YARN-2729: - [~wangda], any updates on this patch req

[jira] [Commented] (YARN-3492) AM fails to come up because RM and NM can't connect to each other

[ https://issues.apache.org/jira/browse/YARN-3492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503340#comment-14503340 ] Karthik Kambatla commented on YARN-3492: I am fine with relegating it to 2.7.1 or l

[jira] [Updated] (YARN-2004) Priority scheduling support in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-2004: -- Attachment: 0006-YARN-2004.patch Updated patch as per the comments. [~leftnoteasy] [~jlowe] Please check the same

[jira] [Updated] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3045: Attachment: YARN-3045.20150420-1.patch WIP patch for initial review, additional test case on

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503383#comment-14503383 ] Sangjin Lee commented on YARN-3437: --- [~jeagles], thanks for your comment. Yes, I agree t

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503363#comment-14503363 ] Sangjin Lee commented on YARN-3046: --- Sorry my review is late for this [~djp]! Some high

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503384#comment-14503384 ] Carlo Curino commented on YARN-3481: I agree with [~vinodkv]... let's go for the new Re

[jira] [Created] (YARN-3512) add more fine-grained metrics that measure write performance

Sangjin Lee created YARN-3512: - Summary: add more fine-grained metrics that measure write performance Key: YARN-3512 URL: https://issues.apache.org/jira/browse/YARN-3512 Project: Hadoop YARN Iss

[jira] [Commented] (YARN-3437) convert load test driver to timeline service v.2

[ https://issues.apache.org/jira/browse/YARN-3437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503391#comment-14503391 ] Sangjin Lee commented on YARN-3437: --- Added YARN-3512. > convert load test driver to time

[jira] [Created] (YARN-3513) Remove unused variables in ContainersMonitorImpl

Naganarasimha G R created YARN-3513: --- Summary: Remove unused variables in ContainersMonitorImpl Key: YARN-3513 URL: https://issues.apache.org/jira/browse/YARN-3513 Project: Hadoop YARN Issu

[jira] [Assigned] (YARN-3513) Remove unused variables in ContainersMonitorImpl

[ https://issues.apache.org/jira/browse/YARN-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R reassigned YARN-3513: --- Assignee: Naganarasimha G R > Remove unused variables in ContainersMonitorImpl > -

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503414#comment-14503414 ] Zhijie Shen commented on YARN-3134: --- I noticed that both Phoenix writer and HBase writer

[jira] [Updated] (YARN-3513) Remove unused variables in ContainersMonitorImpl

[ https://issues.apache.org/jira/browse/YARN-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3513: Attachment: YARN-3513.20150421-1.patch attaching a patch with removing the unused variables

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503425#comment-14503425 ] Sangjin Lee commented on YARN-3431: --- Thanks for the update [~zjshen]! I quickly went over

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503427#comment-14503427 ] Vrushali C commented on YARN-3134: -- Hi [~zjshen] Actually, [~gtCarrera9], [~sjlee0] and I

[jira] [Commented] (YARN-3045) [Event producers] Implement NM writing container lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503429#comment-14503429 ] Hadoop QA commented on YARN-3045: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-3434: Attachment: YARN-3434.patch Updated patch with review comments. > Interaction between reservations a

[jira] [Commented] (YARN-3297) Changes for ResourceCalculatorProcessTree in YARN-3122 could be done in a more compatible manner

[ https://issues.apache.org/jira/browse/YARN-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503443#comment-14503443 ] Mit Desai commented on YARN-3297: - nice catch +1 (non-binding) > Changes for ResourceCalcu

[jira] [Commented] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503447#comment-14503447 ] Hadoop QA commented on YARN-3434: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3513) Remove unused variables in ContainersMonitorImpl

[ https://issues.apache.org/jira/browse/YARN-3513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503487#comment-14503487 ] Hadoop QA commented on YARN-3513: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503496#comment-14503496 ] Hadoop QA commented on YARN-3463: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3297) Changes for ResourceCalculatorProcessTree in YARN-3122 could be done in a more compatible manner

[ https://issues.apache.org/jira/browse/YARN-3297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503501#comment-14503501 ] Karthik Kambatla commented on YARN-3297: I wonder if this is still relevant. YARN-3

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503507#comment-14503507 ] Hadoop QA commented on YARN-2003: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-857) Errors when localizing end up with the localization failure not being seen by the NM

[ https://issues.apache.org/jira/browse/YARN-857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503509#comment-14503509 ] Steve Loughran commented on YARN-857: - +1 for getting this into the container diagnostic

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503515#comment-14503515 ] Hadoop QA commented on YARN-2740: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-2392) add more diags about app retry limits on AM failures

[ https://issues.apache.org/jira/browse/YARN-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503516#comment-14503516 ] Hadoop QA commented on YARN-2392: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (YARN-3302) TestDockerContainerExecutor should run automatically if it can detect docker in the usual place

[ https://issues.apache.org/jira/browse/YARN-3302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503521#comment-14503521 ] Ravi Prakash commented on YARN-3302: Thank you for the patch Ravindra! I'm sorry for th

[jira] [Commented] (YARN-2004) Priority scheduling support in Capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503526#comment-14503526 ] Jason Lowe commented on YARN-2004: -- I'm still missing why it makes sense for queues to hav

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503540#comment-14503540 ] Jason Lowe commented on YARN-3464: -- We shouldn't leave a ContainerLocalizer lingering arou

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503551#comment-14503551 ] Junping Du commented on YARN-3046: -- Thanks [~sjlee0] for review and comments! bq. So am I

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503552#comment-14503552 ] Wangda Tan commented on YARN-3463: -- Great! I will commit this today if no opposite opinion

[jira] [Created] (YARN-3514) Active directory usernames like domain\login cause YARN failures

john lilley created YARN-3514: - Summary: Active directory usernames like domain\login cause YARN failures Key: YARN-3514 URL: https://issues.apache.org/jira/browse/YARN-3514 Project: Hadoop YARN

[jira] [Commented] (YARN-3464) Race condition in LocalizerRunner causes container localization timeout.

[ https://issues.apache.org/jira/browse/YARN-3464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503588#comment-14503588 ] Karthik Kambatla commented on YARN-3464: bq. So I'd look into changing the logic fr

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: YARN-2498.patch) > Respect labels in preemption policy of capacity scheduler > --

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: YARN-2498.patch) > Respect labels in preemption policy of capacity scheduler > --

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: yarn-2498-implementation-notes.pdf) > Respect labels in preemption policy of capacity

[jira] [Updated] (YARN-3434) Interaction between reservations and userlimit can result in significant ULF violation

[ https://issues.apache.org/jira/browse/YARN-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves updated YARN-3434: Attachment: YARN-3434.patch Upmerged to latest > Interaction between reservations and userlimit can

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: (was: YARN-2498.patch) > Respect labels in preemption policy of capacity scheduler > --

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503648#comment-14503648 ] Inigo Goiri commented on YARN-3481: --- [~vinodkc] thanks for fixing the JIRA; these are my

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: STALED-YARN-2498.zip Since patch+designdoc is already staled, make them to be an archive and ma

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Attachment: YARN-2498.1.patch Attached new initial patch. (ver.1) > Respect labels in preemption policy of

[jira] [Commented] (YARN-3514) Active directory usernames like domain\login cause YARN failures

[ https://issues.apache.org/jira/browse/YARN-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503666#comment-14503666 ] Chris Nauroth commented on YARN-3514: - [~john.lil...@redpoint.net], thank you for the d

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503692#comment-14503692 ] Wangda Tan commented on YARN-2498: -- Short notes about this patch: - It indepdently compute

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Description: There're 3 stages in ProportionalCapacityPreemptionPolicy, # Recursively calculate {{ideal_ass

[jira] [Created] (YARN-3515) Support intra-queue non-exclusive container allocation within a LeafQueue

Wangda Tan created YARN-3515: Summary: Support intra-queue non-exclusive container allocation within a LeafQueue Key: YARN-3515 URL: https://issues.apache.org/jira/browse/YARN-3515 Project: Hadoop YARN

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Attachment: YARN-3046-v5.patch Update patch to address latest comments from [~sjlee0], verify it works fine

[jira] [Commented] (YARN-2498) Respect labels in preemption policy of capacity scheduler

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503745#comment-14503745 ] Wangda Tan commented on YARN-2498: -- Linked to YARN-3515, which is to support intra-queue p

[jira] [Updated] (YARN-2498) Respect labels in preemption policy of capacity scheduler for inter-queue preemption

[ https://issues.apache.org/jira/browse/YARN-2498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wangda Tan updated YARN-2498: - Summary: Respect labels in preemption policy of capacity scheduler for inter-queue preemption (was: Respec

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503750#comment-14503750 ] Wangda Tan commented on YARN-2740: -- Retriggered Jenkins. > ResourceManager side should pr

[jira] [Commented] (YARN-3294) Allow dumping of Capacity Scheduler debug logs via web UI for a fixed time period

[ https://issues.apache.org/jira/browse/YARN-3294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14503760#comment-14503760 ] Thomas Graves commented on YARN-3294: - [~xgong] [~vvasudev] I saw this show up in the

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing MR events to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Summary: [Event producers] Implement MapReduce AM writing MR events to ATS (was: [Event producers] Impleme

[jira] [Updated] (YARN-3046) [Event producers] Implement MapReduce AM writing MR events to v2 ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated YARN-3046: - Summary: [Event producers] Implement MapReduce AM writing MR events to v2 ATS (was: [Event producers] Impl

  1   2   >