[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679438#comment-16679438 ] Tao Yang commented on YARN-8988: Attached v1 patch with updating log level to DEBUG. > Reduce the verbose

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and comments.

[jira] [Updated] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8988: --- Attachment: YARN-8988.001.patch > Reduce the verbose log on RM heartbeat path when distributed

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679371#comment-16679371 ] Tao Yang edited comment on YARN-8925 at 11/8/18 7:16 AM: - Thanks [~cheersyang] for

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679416#comment-16679416 ] Tao Yang commented on YARN-8925: Attached v4 patch for review. [~cheersyang], pls help to review at your

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Attachment: YARN-9007.001.patch > CS preemption monitor should only select GUARANTEED containers as

[jira] [Commented] (YARN-7461) DominantResourceCalculator#ratio calculation problem when right resource contains zero value

[ https://issues.apache.org/jira/browse/YARN-7461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682339#comment-16682339 ] Tao Yang commented on YARN-7461: Hi, [~sunilg], [~leftnoteasy], [~templedf], [~cheersyang]. Can we keep

[jira] [Created] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

Tao Yang created YARN-9007: -- Summary: CS preemption monitor should only select GUARANTEED containers as candidates Key: YARN-9007 URL: https://issues.apache.org/jira/browse/YARN-9007 Project: Hadoop YARN

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682402#comment-16682402 ] Tao Yang commented on YARN-9007: Attached v1 patch. [~leftnoteasy], [~sunilg], could you help to review

[jira] [Commented] (YARN-8988) Reduce the verbose log on RM heartbeat path when distributed node-attributes is enabled

[ https://issues.apache.org/jira/browse/YARN-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680632#comment-16680632 ] Tao Yang commented on YARN-8988: Thanks [~cheersyang] for the review and commit. > Reduce the verbose log

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680649#comment-16680649 ] Tao Yang edited comment on YARN-8233 at 11/9/18 12:24 AM: -- Thanks [~ajisakaa] for

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16680649#comment-16680649 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa] for your effort to figure out this failure. Is this

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682851#comment-16682851 ] Tao Yang commented on YARN-9007: Add "for queue and reserved container preemption" to the end of this

[jira] [Comment Edited] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682851#comment-16682851 ] Tao Yang edited comment on YARN-9007 at 11/11/18 11:53 AM: --- Add "for queue and

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682846#comment-16682846 ] Tao Yang commented on YARN-9007: Thanks [~sunilg] for your attention. IIUC,

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue/reserved

[jira] [Updated] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9007: --- Summary: CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689162#comment-16689162 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Thanks for your mention! Yes, there is a mistake in v6

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689162#comment-16689162 ] Tao Yang edited comment on YARN-8925 at 11/16/18 8:31 AM: -- Hi, [~cheersyang]

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.007.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8958) Schedulable entities leak in fair ordering policy when recovering containers between remove app attempt and remove app

[ https://issues.apache.org/jira/browse/YARN-8958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16689143#comment-16689143 ] Tao Yang commented on YARN-8958: Hi，[~cheersyang] I think the race condition may happen when app is moving

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678045#comment-16678045 ] Tao Yang commented on YARN-8233: Hi, [~ajisakaa], [~cheersyang] I have attached 3 patches: (1) patch for

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8233: --- Attachment: YARN-8233.001.branch-3.1.patch YARN-8233.001.branch-3.0.patch

[jira] [Comment Edited] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678045#comment-16678045 ] Tao Yang edited comment on YARN-8233 at 11/7/18 11:06 AM: -- Hi, [~ajisakaa],

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677689#comment-16677689 ] Tao Yang commented on YARN-8233: Thanks [~ajisakaa], [~cheersyang] for the review and commit ! I will

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.006.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687430#comment-16687430 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for your suggestion. Attached v6 patch to fix

[jira] [Commented] (YARN-8995) Log the event type of the too big AsyncDispatcher event queue size, and add the information to the metrics.

[ https://issues.apache.org/jira/browse/YARN-8995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681183#comment-16681183 ] Tao Yang commented on YARN-8995: Hi, [~zhuqi] +1 for this improvement. We have encountered bottleneck of

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16681186#comment-16681186 ] Tao Yang commented on YARN-8233: (y)(y), thanks [~ajisakaa] for your help to solve this problem. > NPE in

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674624#comment-16674624 ] Tao Yang commented on YARN-2599: Hi, [~Naganarasimha] & [~kasha] & [~rohithsharma], We have met problems

[jira] [Updated] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8233: --- Attachment: YARN-8233.003.patch > NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal

[jira] [Commented] (YARN-8233) NPE in CapacityScheduler#tryCommit when handling allocate/reserve proposal whose allocatedOrReservedContainer is null

[ https://issues.apache.org/jira/browse/YARN-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16674625#comment-16674625 ] Tao Yang commented on YARN-8233: Attached v3 patch to fix checkstyle warnings through removing useless

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16633185#comment-16633185 ] Tao Yang commented on YARN-8774: Thanks [~eepayne] for the review and commit. {quote} It would have been

[jira] [Commented] (YARN-8729) Node status updater thread could be lost after it restarted

[ https://issues.apache.org/jira/browse/YARN-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16601938#comment-16601938 ] Tao Yang commented on YARN-8729: Thanks [~ebadger], [~cheersyang] for your reply. {quote} Setting

[jira] [Updated] (YARN-8729) Node status updater thread could be lost after it restarted

[ https://issues.apache.org/jira/browse/YARN-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8729: --- Attachment: YARN-8729.001.patch > Node status updater thread could be lost after it restarted >

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623035#comment-16623035 ] Tao Yang commented on YARN-8804: Thanks [~jlowe],[~leftnoteasy] for your review and reply.  For the 

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.002.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in >

[jira] [Commented] (YARN-8513) CapacityScheduler infinite loop when queue is near fully utilized

[ https://issues.apache.org/jira/browse/YARN-8513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623040#comment-16623040 ] Tao Yang commented on YARN-8513: Hi, [~cyfdecyf] Dose your cluster have empty resource type? This problem

[jira] [Comment Edited] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623035#comment-16623035 ] Tao Yang edited comment on YARN-8804 at 9/21/18 4:17 AM: - Thanks

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623037#comment-16623037 ] Tao Yang commented on YARN-8804: Attached v2 patch to remove violate keyword and improve the calculation.

[jira] [Comment Edited] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623035#comment-16623035 ] Tao Yang edited comment on YARN-8804 at 9/21/18 4:05 AM: - Thanks

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Description: This problem is due to YARN-4280, parent queue will deduct child queue's headroom when the

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621414#comment-16621414 ] Tao Yang commented on YARN-8771: Thanks [~cheersyang] and [~leftnoteasy] ! > CapacityScheduler fails to

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.001.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in >

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621631#comment-16621631 ] Tao Yang commented on YARN-8804: Attached v1 patch which will add a blockedHeadroom field in

[jira] [Commented] (YARN-2599) Standby RM should also expose some jmx and metrics

[ https://issues.apache.org/jira/browse/YARN-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623315#comment-16623315 ] Tao Yang commented on YARN-2599: Hi, [~Naganarasimha]. Some JVM metrics of standby RM can be evaluated

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624281#comment-16624281 ] Tao Yang commented on YARN-8804: Thanks [~jlowe] for the review. Attached v3 patch to rebase it on latest

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.branch-2.001.patch > Memory leak when CapacityScheduler allocates from reserved

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: (was: YARN-8774.branch-2.001.patch) > Memory leak when CapacityScheduler allocates from

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.branch-2.8.001.patch > Memory leak when CapacityScheduler allocates from reserved

[jira] [Updated] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8804: --- Attachment: YARN-8804.003.patch > resourceLimits may be wrongly calculated when leaf-queue is blocked in >

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: (was: YARN-8774.branch-2.8.001.patch) > Memory leak when CapacityScheduler allocates from

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.002.patch > Memory leak when CapacityScheduler allocates from reserved container with

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.branch-2.001.patch > Memory leak when CapacityScheduler allocates from reserved

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.branch-2.8.001.patch > Memory leak when CapacityScheduler allocates from reserved

[jira] [Comment Edited] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624367#comment-16624367 ] Tao Yang edited comment on YARN-8774 at 9/22/18 12:17 AM: -- Thanks [~eepayne] for

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16624367#comment-16624367 ] Tao Yang commented on YARN-8774: Thanks [~eepayne] for the review. Attached v2 patch to improve the UT

[jira] [Commented] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

[ https://issues.apache.org/jira/browse/YARN-8804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16629699#comment-16629699 ] Tao Yang commented on YARN-8804: Thanks [~jlowe] for the review and commit! > resourceLimits may be

[jira] [Created] (YARN-8804) resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues

Tao Yang created YARN-8804: -- Summary: resourceLimits may be wrongly calculated when leaf-queue is blocked in cluster with 3+ level queues Key: YARN-8804 URL: https://issues.apache.org/jira/browse/YARN-8804

[jira] [Commented] (YARN-9163) Deadlock when use yarn rmadmin -refreshQueues

[ https://issues.apache.org/jira/browse/YARN-9163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16732634#comment-16732634 ] Tao Yang commented on YARN-9163: Hi [~ziqian hu] We have communicated about this problem offline before,

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743796#comment-16743796 ] Tao Yang commented on YARN-9050: Hi, [~cheersyang]. As a footnote, this change will only record one

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743735#comment-16743735 ] Tao Yang commented on YARN-9050: Thanks [~cheersyang] for the review. {quote} Will this add a lot of

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725825#comment-16725825 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang]. Perhaps there is no

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925-branch-3.2.001.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726451#comment-16726451 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review and commit. Attached a patch for

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16716634#comment-16716634 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Just noticed DISTRIBUTED and CENTRALIZED attributes can

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.010.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16701600#comment-16701600 ] Tao Yang commented on YARN-9050: cc: [~cheersyang], [~leftnoteasy], [~sunil.g]. I would be interested in

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16707010#comment-16707010 ] Tao Yang commented on YARN-9050: Thanks [~leftnoteasy] for your support. I would like to work on this

[jira] [Created] (YARN-9050) Usability improvements for scheduler activities

Tao Yang created YARN-9050: -- Summary: Usability improvements for scheduler activities Key: YARN-9050 URL: https://issues.apache.org/jira/browse/YARN-9050 Project: Hadoop YARN Issue Type:

[jira] [Commented] (YARN-9007) CS preemption monitor should only select GUARANTEED containers as candidates for queue and reserved container preemption

[ https://issues.apache.org/jira/browse/YARN-9007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16694173#comment-16694173 ] Tao Yang commented on YARN-9007: Thanks [~wilfreds] for the comments. I agree that current preemptions

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692724#comment-16692724 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the review. {quote} 1. Both RM/NM side logs

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: (was: YARN-8925.008.patch) > Updating distributed node attributes only when necessary >

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.008.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692750#comment-16692750 ] Tao Yang commented on YARN-8925: Replaced v8 patch to apply for latest trunk. > Updating distributed node

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.008.patch > Updating distributed node attributes only when necessary >

[jira] [Comment Edited] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692794#comment-16692794 ] Tao Yang edited comment on YARN-8925 at 11/20/18 7:45 AM: -- Hi, [~cheersyang] Can

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692807#comment-16692807 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang]. Attached v9 patch to change the log level of

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692794#comment-16692794 ] Tao Yang commented on YARN-8925: Hi, [~cheersyang] Can we change the log level of updating node

[jira] [Updated] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8925: --- Attachment: YARN-8925.009.patch > Updating distributed node attributes only when necessary >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16692726#comment-16692726 ] Tao Yang commented on YARN-8925: Attached v8 patch to improve the log contents. > Updating distributed

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Description: To reproduce this problem in UT, we can setup a cluster with resource <40,18> and create 3

[jira] [Created] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

Tao Yang created YARN-9043: -- Summary: Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator Key: YARN-9043 URL: https://issues.apache.org/jira/browse/YARN-9043

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Description: We have did some usability improvements for scheduler activities based on YARN3.1 in our

[jira] [Updated] (YARN-9043) Inter-queue preemption sometimes starves an underserved queue when using DominantResourceCalculator

[ https://issues.apache.org/jira/browse/YARN-9043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9043: --- Attachment: YARN-9043.001.patch > Inter-queue preemption sometimes starves an underserved queue when using >

[jira] [Commented] (YARN-8925) Updating distributed node attributes only when necessary

[ https://issues.apache.org/jira/browse/YARN-8925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16691219#comment-16691219 ] Tao Yang commented on YARN-8925: Thanks [~cheersyang] for the testing. I think the node attributes are

[jira] [Updated] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-9050: --- Component/s: capacityscheduler > Usability improvements for scheduler activities >

[jira] [Commented] (YARN-9050) Usability improvements for scheduler activities

[ https://issues.apache.org/jira/browse/YARN-9050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16738219#comment-16738219 ] Tao Yang commented on YARN-9050: Hi [~leftnoteasy], [~cheersyang]  Design doc is attached

[jira] [Commented] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16613299#comment-16613299 ] Tao Yang commented on YARN-8771: Attached v1 patch for review. [~cheersyang], can you help to review this

[jira] [Created] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

Tao Yang created YARN-8771: -- Summary: CapacityScheduler fails to unreserve when cluster resource contains empty resource type Key: YARN-8771 URL: https://issues.apache.org/jira/browse/YARN-8771 Project:

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.001.patch > CapacityScheduler fails to unreserve when cluster resource contains empty

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Affects Version/s: 2.8.5 3.2.0 > Memory leak when CapacityScheduler allocates from

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.002.patch > CapacityScheduler fails to unreserve when cluster resource contains empty

[jira] [Commented] (YARN-8729) Node status updater thread could be lost after it is restarted

[ https://issues.apache.org/jira/browse/YARN-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614289#comment-16614289 ] Tao Yang commented on YARN-8729: Thanks [~cheersyang], [~ebadger] ! > Node status updater thread could be

[jira] [Created] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

Tao Yang created YARN-8774: -- Summary: Memory leak when CapacityScheduler allocates from reserved container with non-default label Key: YARN-8774 URL: https://issues.apache.org/jira/browse/YARN-8774 Project:

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Description: The cause is that the RMContainerImpl instance of reserved container lost its node label

[jira] [Updated] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8774: --- Attachment: YARN-8774.001.patch > Memory leak when CapacityScheduler allocates from reserved container with

[jira] [Commented] (YARN-8774) Memory leak when CapacityScheduler allocates from reserved container with non-default label

[ https://issues.apache.org/jira/browse/YARN-8774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614866#comment-16614866 ] Tao Yang commented on YARN-8774: Attached v1 patch for review. > Memory leak when CapacityScheduler

[jira] [Updated] (YARN-8771) CapacityScheduler fails to unreserve when cluster resource contains empty resource type

[ https://issues.apache.org/jira/browse/YARN-8771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Yang updated YARN-8771: --- Attachment: YARN-8771.004.patch > CapacityScheduler fails to unreserve when cluster resource contains empty

<    1   2   3   4   5   6   7   8   9   10   >