[jira] [Commented] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

2020-03-16 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17060563#comment-17060563 ] Jonathan Hung commented on YARN-8849: - Hey [~brahmareddy], we're working on the open s

[jira] [Updated] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-16 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10200: - Description: It would be useful to persist this so we can track containers processed by RM. (was

[jira] [Created] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-16 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10200: Summary: Add number of containers to RMAppManager summary Key: YARN-10200 URL: https://issues.apache.org/jira/browse/YARN-10200 Project: Hadoop YARN Issue Ty

[jira] [Commented] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17057259#comment-17057259 ] Jonathan Hung commented on YARN-10192: -- cc [~ebadger], [~epayne], [~leftnoteasy] Th

[jira] [Updated] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10192: - Affects Version/s: 2.10.0 > CapacityScheduler stuck in loop rejecting allocation proposals >

[jira] [Created] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-11 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10192: Summary: CapacityScheduler stuck in loop rejecting allocation proposals Key: YARN-10192 URL: https://issues.apache.org/jira/browse/YARN-10192 Project: Hadoop YARN

[jira] [Created] (YARN-10134) Periodically sync backend scheduler configuration changes to capacity-scheduler.xml

2020-02-12 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10134: Summary: Periodically sync backend scheduler configuration changes to capacity-scheduler.xml Key: YARN-10134 URL: https://issues.apache.org/jira/browse/YARN-10134 Pro

[jira] [Updated] (YARN-10116) Expose diagnostics in RMAppManager summary

2020-02-04 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10116: - Attachment: YARN-10116.002.patch > Expose diagnostics in RMAppManager summary > -

[jira] [Commented] (YARN-10116) Expose diagnostics in RMAppManager summary

2020-02-04 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17030292#comment-17030292 ] Jonathan Hung commented on YARN-10116: -- Uploaded [^YARN-10116.002.patch] to fix chec

[jira] [Updated] (YARN-10116) Expose diagnostics in RMAppManager summary

2020-02-04 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10116?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10116: - Attachment: YARN-10116.001.patch > Expose diagnostics in RMAppManager summary > -

[jira] [Created] (YARN-10116) Expose diagnostics in RMAppManager summary

2020-02-04 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10116: Summary: Expose diagnostics in RMAppManager summary Key: YARN-10116 URL: https://issues.apache.org/jira/browse/YARN-10116 Project: Hadoop YARN Issue Type: Im

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-18 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16999525#comment-16999525 ] Jonathan Hung commented on YARN-8292: - Thanks [~epayne] for the update. Should we just

[jira] [Commented] (YARN-10039) Allow disabling app submission from REST endpoints

2019-12-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998682#comment-16998682 ] Jonathan Hung commented on YARN-10039: -- Thanks [~haibochen], not sure that is within

[jira] [Assigned] (YARN-10039) Allow disabling app submission from REST endpoints

2019-12-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-10039: Assignee: Jonathan Hung > Allow disabling app submission from REST endpoints > ---

[jira] [Commented] (YARN-10039) Allow disabling app submission from REST endpoints

2019-12-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998655#comment-16998655 ] Jonathan Hung commented on YARN-10039: -- Attached [^YARN-10039.001.patch] which adds 

[jira] [Updated] (YARN-10039) Allow disabling app submission from REST endpoints

2019-12-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10039: - Attachment: YARN-10039.001.patch > Allow disabling app submission from REST endpoints > -

[jira] [Created] (YARN-10039) Allow disabling app submission from REST endpoints

2019-12-17 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10039: Summary: Allow disabling app submission from REST endpoints Key: YARN-10039 URL: https://issues.apache.org/jira/browse/YARN-10039 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-12-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16993943#comment-16993943 ] Jonathan Hung commented on YARN-9894: - Thx! [^YARN-9894.002.patch] lgtm, pending jenki

[jira] [Updated] (YARN-9914) Use separate configs for free disk space checking for full and not-full disks

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9914: Fix Version/s: (was: 2.11.0) > Use separate configs for free disk space checking for full and no

[jira] [Updated] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-4901: Fix Version/s: (was: 2.11.0) > QueueMetrics needs to be cleared before MockRM is initialized > -

[jira] [Commented] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991918#comment-16991918 ] Jonathan Hung commented on YARN-4901: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991920#comment-16991920 ] Jonathan Hung commented on YARN-10012: -- Removing 2.11.0 fix version after branch-2 -

[jira] [Updated] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10012: - Fix Version/s: (was: 2.11.0) > Guaranteed and max capacity queue metrics for custom resources

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9205: Fix Version/s: (was: 2.11.0) > When using custom resource type, application will fail to run due

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991913#comment-16991913 ] Jonathan Hung commented on YARN-9205: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-9915) Fix FindBug issue in QueueMetrics

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9915: Fix Version/s: (was: 2.11.0) > Fix FindBug issue in QueueMetrics > -

[jira] [Commented] (YARN-9915) Fix FindBug issue in QueueMetrics

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991909#comment-16991909 ] Jonathan Hung commented on YARN-9915: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-9773) Add QueueMetrics for Custom Resources

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9773: Fix Version/s: (was: 2.11.0) > Add QueueMetrics for Custom Resources > -

[jira] [Commented] (YARN-9773) Add QueueMetrics for Custom Resources

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991908#comment-16991908 ] Jonathan Hung commented on YARN-9773: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-9838) Fix resource inconsistency for queues when moving app with reserved container to another queue

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9838: Fix Version/s: 2.10.1 > Fix resource inconsistency for queues when moving app with reserved containe

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991907#comment-16991907 ] Jonathan Hung commented on YARN-7589: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7589: Fix Version/s: (was: 2.11.0) > TestPBImplRecords fails with NullPointerException > -

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991905#comment-16991905 ] Jonathan Hung commented on YARN-8842: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8842: Fix Version/s: (was: 2.11.0) > Expose metrics for custom resource types in QueueMetrics > --

[jira] [Commented] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991902#comment-16991902 ] Jonathan Hung commented on YARN-8179: - Seems this was committed to branch-2.10, adding

[jira] [Updated] (YARN-8179) Preemption does not happen due to natural_termination_factor when DRF is used

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8179: Fix Version/s: 2.10.1 > Preemption does not happen due to natural_termination_factor when DRF is use

[jira] [Commented] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991900#comment-16991900 ] Jonathan Hung commented on YARN-7411: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-7411) Inter-Queue preemption's computeFixpointAllocation need to handle absolute resources while computing normalizedGuarantee

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7411: Fix Version/s: (was: 2.11.0) > Inter-Queue preemption's computeFixpointAllocation need to handle

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991895#comment-16991895 ] Jonathan Hung commented on YARN-8202: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8202: Fix Version/s: (was: 2.11.0) > DefaultAMSProcessor should properly check units of requested cust

[jira] [Updated] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7739: Fix Version/s: (was: 2.11.0) > DefaultAMSProcessor should properly check customized resource typ

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991892#comment-16991892 ] Jonathan Hung commented on YARN-7739: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991894#comment-16991894 ] Jonathan Hung commented on YARN-7541: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7541: Fix Version/s: (was: 2.11.0) > Node updates don't update the maximum cluster capability for reso

[jira] [Updated] (YARN-8004) Add unit tests for inter queue preemption for dominant resource calculator

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8004: Fix Version/s: (was: 2.11.0) > Add unit tests for inter queue preemption for dominant resource c

[jira] [Commented] (YARN-8004) Add unit tests for inter queue preemption for dominant resource calculator

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991888#comment-16991888 ] Jonathan Hung commented on YARN-8004: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-9945) Fix javadoc in FederationProxyProviderUtil in branch-2

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9945: Fix Version/s: (was: 2.11.0) > Fix javadoc in FederationProxyProviderUtil in branch-2 >

[jira] [Commented] (YARN-9945) Fix javadoc in FederationProxyProviderUtil in branch-2

2019-12-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991887#comment-16991887 ] Jonathan Hung commented on YARN-9945: - Removing 2.11.0 fix version after branch-2 -> b

[jira] [Updated] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10012: - Attachment: YARN-10012-branch-2.001.patch > Guaranteed and max capacity queue metrics for custom

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991036#comment-16991036 ] Jonathan Hung commented on YARN-10012: -- Thanks. That seems to fix the issue. Commit

[jira] [Updated] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10012: - Fix Version/s: 2.11.0 2.10.1 3.1.4 3.2.2

[jira] [Commented] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

2019-12-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16991019#comment-16991019 ] Jonathan Hung commented on YARN-4901: - Thanks [~maniraj...@gmail.com], I've committed

[jira] [Updated] (YARN-4901) QueueMetrics needs to be cleared before MockRM is initialized

2019-12-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-4901?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-4901: Fix Version/s: 2.11.0 2.10.1 3.1.4 3.2.2 >

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-06 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990109#comment-16990109 ] Jonathan Hung commented on YARN-10012: -- [~maniraj...@gmail.com], I tried backporting

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-06 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16990063#comment-16990063 ] Jonathan Hung commented on YARN-10012: -- Thanks. [^YARN-10012.002.patch] LGTM pending

[jira] [Comment Edited] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989202#comment-16989202 ] Jonathan Hung edited comment on YARN-10012 at 12/5/19 10:14 PM: ---

[jira] [Comment Edited] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989202#comment-16989202 ] Jonathan Hung edited comment on YARN-10012 at 12/5/19 10:11 PM: ---

[jira] [Commented] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16989202#comment-16989202 ] Jonathan Hung commented on YARN-10012: -- Thanks [~maniraj...@gmail.com]. A few commen

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2019-12-04 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988370#comment-16988370 ] Jonathan Hung edited comment on YARN-6492 at 12/5/19 1:36 AM: --

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-12-04 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16988370#comment-16988370 ] Jonathan Hung commented on YARN-6492: - A couple more high level comments: * In places

[jira] [Created] (YARN-10012) Guaranteed and max capacity queue metrics for custom resources

2019-12-03 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10012: Summary: Guaranteed and max capacity queue metrics for custom resources Key: YARN-10012 URL: https://issues.apache.org/jira/browse/YARN-10012 Project: Hadoop YARN

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-12-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9205: Fix Version/s: 2.11.0 2.10.1 > When using custom resource type, application will

[jira] [Commented] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-12-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987304#comment-16987304 ] Jonathan Hung commented on YARN-9205: - attached [^YARN-9205-branch-2.001.patch] which

[jira] [Updated] (YARN-9205) When using custom resource type, application will fail to run due to the CapacityScheduler throws InvalidResourceRequestException(GREATER_THEN_MAX_ALLOCATION)

2019-12-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9205: Attachment: YARN-9205-branch-2.001.patch > When using custom resource type, application will fail to

[jira] [Commented] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-12-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987270#comment-16987270 ] Jonathan Hung commented on YARN-9992: - Hmm, not sure how I missed this before, I think

[jira] [Commented] (YARN-8292) Fix the dominant resource preemption cannot happen when some of the resource vector becomes negative

2019-12-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16987236#comment-16987236 ] Jonathan Hung commented on YARN-8292: - [^YARN-8292.branch-2.010.patch] looks fine to m

[jira] [Updated] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-11-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9992: Target Version/s: 2.10.1 > Max allocation per queue is zero for custom resource types on RM startup

[jira] [Assigned] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-11-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-9992: --- Assignee: Jonathan Hung > Max allocation per queue is zero for custom resource types on RM st

[jira] [Commented] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-11-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983036#comment-16983036 ] Jonathan Hung commented on YARN-9992: - Attached a simple one liner [^YARN-9992.001.pat

[jira] [Updated] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-11-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9992: Attachment: YARN-9992.001.patch > Max allocation per queue is zero for custom resource types on RM s

[jira] [Created] (YARN-9992) Max allocation per queue is zero for custom resource types on RM startup

2019-11-26 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-9992: --- Summary: Max allocation per queue is zero for custom resource types on RM startup Key: YARN-9992 URL: https://issues.apache.org/jira/browse/YARN-9992 Project: Hadoop YA

[jira] [Comment Edited] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-11-21 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979582#comment-16979582 ] Jonathan Hung edited comment on YARN-7589 at 11/21/19 11:40 PM:

[jira] [Updated] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-11-21 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7589: Fix Version/s: 2.10.1 > TestPBImplRecords fails with NullPointerException >

[jira] [Commented] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-11-21 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979582#comment-16979582 ] Jonathan Hung commented on YARN-7589: - Pushed to branch-2 > TestPBImplRecords fails w

[jira] [Updated] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-11-21 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7589: Fix Version/s: 2.11.0 > TestPBImplRecords fails with NullPointerException >

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-21 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16979576#comment-16979576 ] Jonathan Hung commented on YARN-8842: - Thanks [~epayne], no objections from me! > Exp

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2019-11-18 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977070#comment-16977070 ] Jonathan Hung edited comment on YARN-6492 at 11/19/19 2:32 AM: -

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-11-18 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16977070#comment-16977070 ] Jonathan Hung commented on YARN-6492: - [~maniraj...@gmail.com] thanks for working on t

[jira] [Assigned] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-11-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7589: --- Assignee: Daniel Templeton (was: Jonathan Hung) > TestPBImplRecords fails with NullPointerEx

[jira] [Assigned] (YARN-7589) TestPBImplRecords fails with NullPointerException

2019-11-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-7589: --- Assignee: Jonathan Hung (was: Daniel Templeton) > TestPBImplRecords fails with NullPointerEx

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975499#comment-16975499 ] Jonathan Hung commented on YARN-8842: - I think the additional hadoop-yarn-server-resou

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16975332#comment-16975332 ] Jonathan Hung commented on YARN-8842: - Thanks [~epayne]! Uploading [^YARN-8842-branch-

[jira] [Updated] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8842: Attachment: YARN-8842-branch-2.003.patch > Expose metrics for custom resource types in QueueMetrics

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974877#comment-16974877 ] Jonathan Hung commented on YARN-8842: - Unit test failure is related to YARN-7589, I'll

[jira] [Updated] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8842: Attachment: YARN-8842-branch-2.002.patch > Expose metrics for custom resource types in QueueMetrics

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974747#comment-16974747 ] Jonathan Hung commented on YARN-8842: - I've attached [^YARN-8842-branch-2.001.patch].

[jira] [Updated] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8842: Attachment: YARN-8842-branch-2.001.patch > Expose metrics for custom resource types in QueueMetrics

[jira] [Reopened] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reopened YARN-8842: - > Expose metrics for custom resource types in QueueMetrics > -

[jira] [Comment Edited] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974701#comment-16974701 ] Jonathan Hung edited comment on YARN-8842 at 11/15/19 12:28 AM:

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974701#comment-16974701 ] Jonathan Hung commented on YARN-8842: - [~epayne] regarding the tangled web of dependen

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8202: Fix Version/s: 2.11.0 > DefaultAMSProcessor should properly check units of requested custom resource

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974700#comment-16974700 ] Jonathan Hung commented on YARN-8202: - ported to branch-2.   > DefaultAMSProcessor s

[jira] [Commented] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974699#comment-16974699 ] Jonathan Hung commented on YARN-7541: - ported to branch-2. > Node updates don't updat

[jira] [Updated] (YARN-7541) Node updates don't update the maximum cluster capability for resources other than CPU and memory

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7541: Fix Version/s: 2.11.0 > Node updates don't update the maximum cluster capability for resources other

[jira] [Commented] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974698#comment-16974698 ] Jonathan Hung commented on YARN-7739: - ported to branch-2. > DefaultAMSProcessor shou

[jira] [Updated] (YARN-7739) DefaultAMSProcessor should properly check customized resource types against minimum/maximum allocation

2019-11-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-7739: Fix Version/s: 2.11.0 > DefaultAMSProcessor should properly check customized resource types against

[jira] [Comment Edited] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-11-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971809#comment-16971809 ] Jonathan Hung edited comment on YARN-9894 at 11/11/19 7:24 PM: -

[jira] [Comment Edited] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-11-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971809#comment-16971809 ] Jonathan Hung edited comment on YARN-9894 at 11/11/19 7:24 PM: -

[jira] [Commented] (YARN-9894) CapacitySchedulerPerf test for measuring hundreds of apps in a large number of queues.

2019-11-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16971809#comment-16971809 ] Jonathan Hung commented on YARN-9894: - Thanks [[~epayne] for working on this - * for

[jira] [Commented] (YARN-9964) Queue metrics turn negative when relabeling a node with running containers to default partition

2019-11-07 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16969729#comment-16969729 ] Jonathan Hung commented on YARN-9964: - Hi [~maniraj...@gmail.com]/[~Naganarasimha], mi

<    1   2   3   4   5   6   7   8   9   10   >