[jira] [Resolved] (YARN-8849) DynoYARN: A simulation and testing infrastructure for YARN clusters

2021-09-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung resolved YARN-8849. - Resolution: Fixed FYI we have open source DynoYARN on Github:

[jira] [Commented] (YARN-10697) Resources are displayed in bytes in UI for schedulers other than capacity

2021-03-18 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304467#comment-17304467 ] Jonathan Hung commented on YARN-10697: -- [~Jim_Brennan] [~BilwaST] I agree, I don't think we should

[jira] [Comment Edited] (YARN-10651) CapacityScheduler crashed with NPE in AbstractYarnScheduler.updateNodeResource()

2021-02-25 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291305#comment-17291305 ] Jonathan Hung edited comment on YARN-10651 at 2/26/21, 12:04 AM: - +1 from

[jira] [Commented] (YARN-10651) CapacityScheduler crashed with NPE in AbstractYarnScheduler.updateNodeResource()

2021-02-25 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17291225#comment-17291225 ] Jonathan Hung commented on YARN-10651: -- Thanks [~haibochen] - should we add some logging in this

[jira] [Comment Edited] (YARN-10467) ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers

2020-10-28 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17222309#comment-17222309 ] Jonathan Hung edited comment on YARN-10467 at 10/28/20, 8:14 PM: - I

[jira] [Commented] (YARN-10467) ContainerIdPBImpl objects can be leaked in RMNodeImpl.completedContainers

2020-10-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17221747#comment-17221747 ] Jonathan Hung commented on YARN-10467: -- [~haibochen], thank you for the patch. It looks good. It

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-15 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17214939#comment-17214939 ] Jonathan Hung commented on YARN-10450: -- Thanks [~Jim_Brennan] that is fine with me. > Add cpu and

[jira] [Commented] (YARN-10450) Add cpu and memory utilization per node and cluster-wide metrics

2020-10-12 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17212676#comment-17212676 ] Jonathan Hung commented on YARN-10450: -- [~Jim_Brennan], Physical Mem Used % makes sense to me. We

[jira] [Updated] (YARN-8210) AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs

2020-09-10 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8210: Fix Version/s: (was: 2.10.2) 2.10.1 > AMRMClient logging on every heartbeat

[jira] [Updated] (YARN-8210) AMRMClient logging on every heartbeat to track updation of AM RM token causes too many log lines to be generated in AM logs

2020-09-10 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8210: Fix Version/s: 2.10.2 Pushed to branch-2.10. > AMRMClient logging on every heartbeat to track

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-08-07 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17173478#comment-17173478 ] Jonathan Hung commented on YARN-10251: -- Unit test failures aren't related.

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-28 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166685#comment-17166685 ] Jonathan Hung commented on YARN-10343: -- [^YARN-10343.branch-3.2.001.patch],

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17160242#comment-17160242 ] Jonathan Hung commented on YARN-10343: -- +1 for [^YARN-10343.001.patch]. Test failure looks related

[jira] [Commented] (YARN-10263) Application summary is logged multiple times due to RM recovery

2020-07-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10263?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17157748#comment-17157748 ] Jonathan Hung commented on YARN-10263: -- My understanding is that the sequence looks like: (1) app

[jira] [Commented] (YARN-10343) Legacy RM UI should include labeled metrics for allocated, total, and reserved resources.

2020-07-13 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156970#comment-17156970 ] Jonathan Hung commented on YARN-10343: -- thanks [~epayne] generally looks fine. I think the running

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-13 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17156889#comment-17156889 ] Jonathan Hung commented on YARN-10251: -- Hey [~epayne] do you plan to post a follow up patch

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-02 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17150555#comment-17150555 ] Jonathan Hung commented on YARN-10251: -- I see. Can you file a follow up jira for this? I think we

[jira] [Commented] (YARN-10251) Show extended resources on legacy RM UI.

2020-07-01 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17149697#comment-17149697 ] Jonathan Hung commented on YARN-10251: -- [~epayne] thanks, generally 006 looks good to me, but have a

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-06-01 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Fix Version/s: 2.10.1 2.9.3 > Generate queue metrics for each partition >

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120351#comment-17120351 ] Jonathan Hung commented on YARN-10297: -- Thanks. TestContinuousScheduling stops rm on teardown. Also

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: YARN-6492-branch-2.10.019.patch > Generate queue metrics for each partition >

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120349#comment-17120349 ] Jonathan Hung commented on YARN-6492: - Thanks. I see this method is only used in tests in trunk too. I

[jira] [Issue Comment Deleted] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10297: - Comment: was deleted (was: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: YARN-6492-branch-3.2.017.patch YARN-6492-branch-3.1.018.patch >

[jira] [Assigned] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-10297: Assignee: (was: Jonathan Hung) >

[jira] [Updated] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10297: - Description: After YARN-6492, testFairSchedulerContinuousSchedulingInitTime fails

[jira] [Commented] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119970#comment-17119970 ] Jonathan Hung commented on YARN-10297: -- [~maniraj...@gmail.com] while debugging this, I noticed

[jira] [Updated] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10297: - Attachment: (was: YARN-10297.001.patch) >

[jira] [Assigned] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-10297: Assignee: Jonathan Hung >

[jira] [Updated] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10297: - Attachment: YARN-10297.001.patch >

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119915#comment-17119915 ] Jonathan Hung edited comment on YARN-6492 at 5/29/20, 9:26 PM: --- Looks like

[jira] [Created] (YARN-10297) TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently

2020-05-29 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10297: Summary: TestContinuousScheduling#testFairSchedulerContinuousSchedulingInitTime fails intermittently Key: YARN-10297 URL: https://issues.apache.org/jira/browse/YARN-10297

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119915#comment-17119915 ] Jonathan Hung edited comment on YARN-6492 at 5/29/20, 8:43 PM: --- Looks like

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119915#comment-17119915 ] Jonathan Hung commented on YARN-6492: - Looks like TestContinuousScheduling is failing in branch-3.1

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Fix Version/s: 3.1.5 3.3.1 3.2.2 > Generate queue metrics for

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119823#comment-17119823 ] Jonathan Hung commented on YARN-6492: - Thanks [~maniraj...@gmail.com]. For the branch-2.10 patch, do

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: (was: YARN-6492-branch-3.2.017.patch) > Generate queue metrics for each partition >

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: (was: YARN-6492-branch-3.1.018.patch) > Generate queue metrics for each partition >

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: YARN-6492-branch-3.1.018.patch > Generate queue metrics for each partition >

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-29 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: YARN-6492-branch-3.2.017.patch > Generate queue metrics for each partition >

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Fix Version/s: 3.4.0 > Generate queue metrics for each partition >

[jira] [Updated] (YARN-6492) Generate queue metrics for each partition

2020-05-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-6492: Attachment: YARN-6492.013.patch > Generate queue metrics for each partition >

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117171#comment-17117171 ] Jonathan Hung commented on YARN-6492: - Attached [^YARN-6492.013.patch] which fixes the whitespace

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-26 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116955#comment-17116955 ] Jonathan Hung commented on YARN-6492: - Thanks [~maniraj...@gmail.com]. [^YARN-6492.012.WIP.patch]

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-25 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116274#comment-17116274 ] Jonathan Hung commented on YARN-6492: - Ok, I see. On line 2542, can we remove the nm1 heartbeats and

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114350#comment-17114350 ] Jonathan Hung edited comment on YARN-6492 at 5/22/20, 11:34 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114350#comment-17114350 ] Jonathan Hung edited comment on YARN-6492 at 5/22/20, 10:50 PM: Thank you

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-22 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114350#comment-17114350 ] Jonathan Hung commented on YARN-6492: - Thank you [~maniraj...@gmail.com]. Some more comments: * Delete

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:59 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:58 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:57 PM: Thank you

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung edited comment on YARN-6492 at 5/20/20, 10:57 PM: Thank you

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-20 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17112648#comment-17112648 ] Jonathan Hung commented on YARN-6492: - Thank you [~maniraj...@gmail.com]. Looks fine at a high level.

[jira] [Commented] (YARN-10260) Allow transitioning queue from DRAINING to RUNNING state

2020-05-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104940#comment-17104940 ] Jonathan Hung commented on YARN-10260: -- +1 looks fine to me. I'll commit this tomorrow if no

[jira] [Created] (YARN-10263) Application summary is logged multiple times due to RM recovery

2020-05-11 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10263: Summary: Application summary is logged multiple times due to RM recovery Key: YARN-10263 URL: https://issues.apache.org/jira/browse/YARN-10263 Project: Hadoop YARN

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-11 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17104672#comment-17104672 ] Jonathan Hung commented on YARN-6492: - IMO we should still have {noformat} "name" :

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17103520#comment-17103520 ] Jonathan Hung commented on YARN-6492: - Ok I see. This was not my original understanding. I assumed

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-07 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101990#comment-17101990 ] Jonathan Hung edited comment on YARN-6492 at 5/7/20, 7:28 PM: --

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-07 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101990#comment-17101990 ] Jonathan Hung edited comment on YARN-6492 at 5/7/20, 7:28 PM: --

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-07 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17101990#comment-17101990 ] Jonathan Hung commented on YARN-6492: - [~maniraj...@gmail.com], thanks. Seems you missed uploading

[jira] [Created] (YARN-10260) Allow transitioning queue from DRAINING to RUNNING state

2020-05-06 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10260: Summary: Allow transitioning queue from DRAINING to RUNNING state Key: YARN-10260 URL: https://issues.apache.org/jira/browse/YARN-10260 Project: Hadoop YARN

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100369#comment-17100369 ] Jonathan Hung edited comment on YARN-6492 at 5/6/20, 1:15 AM: -- OK thanks

[jira] [Comment Edited] (YARN-6492) Generate queue metrics for each partition

2020-05-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100369#comment-17100369 ] Jonathan Hung edited comment on YARN-6492 at 5/6/20, 1:14 AM: -- OK thanks

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2020-05-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100369#comment-17100369 ] Jonathan Hung commented on YARN-6492: - OK thanks [~maniraj...@gmail.com] for the explanation. Sorry

[jira] [Assigned] (YARN-6492) Generate queue metrics for each partition

2020-05-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-6492: --- Assignee: Manikandan R (was: Jonathan Hung) > Generate queue metrics for each partition >

[jira] [Assigned] (YARN-6492) Generate queue metrics for each partition

2020-05-05 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-6492: --- Assignee: Jonathan Hung (was: Manikandan R) > Generate queue metrics for each partition >

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2020-04-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096901#comment-17096901 ] Jonathan Hung commented on YARN-8193: - javadoc complains about AbstractYarnScheduler which this patch

[jira] [Commented] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2020-04-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096807#comment-17096807 ] Jonathan Hung commented on YARN-8193: - Hit this issue on 2.10.0 cluster. Reuploading patch > YARN RM

[jira] [Updated] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2020-04-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8193: Attachment: YARN-8193-branch-2.10-001.patch > YARN RM hangs abruptly (stops allocating resources)

[jira] [Comment Edited] (YARN-8193) YARN RM hangs abruptly (stops allocating resources) when running successive applications.

2020-04-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17096807#comment-17096807 ] Jonathan Hung edited comment on YARN-8193 at 4/30/20, 5:32 PM: --- Hit this

[jira] [Updated] (YARN-8382) cgroup file leak in NM

2020-04-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8382: Fix Version/s: 2.10.1 > cgroup file leak in NM > -- > > Key:

[jira] [Commented] (YARN-8382) cgroup file leak in NM

2020-04-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17093935#comment-17093935 ] Jonathan Hung commented on YARN-8382: - Pushed to branch-2.10 > cgroup file leak in NM >

[jira] [Commented] (YARN-9954) Configurable max application tags and max tag length

2020-04-16 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17085196#comment-17085196 ] Jonathan Hung commented on YARN-9954: - Thanks [~BilwaST], can you add some tests verifying that app

[jira] [Comment Edited] (YARN-9954) Configurable max application tags and max tag length

2020-04-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083602#comment-17083602 ] Jonathan Hung edited comment on YARN-9954 at 4/14/20, 8:54 PM: --- Thanks

[jira] [Comment Edited] (YARN-9954) Configurable max application tags and max tag length

2020-04-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083602#comment-17083602 ] Jonathan Hung edited comment on YARN-9954 at 4/14/20, 8:53 PM: --- Thanks

[jira] [Commented] (YARN-9954) Configurable max application tags and max tag length

2020-04-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083602#comment-17083602 ] Jonathan Hung commented on YARN-9954: - Thanks [~BilwaST], a few comments * Let's change {{/**Max size

[jira] [Comment Edited] (YARN-9954) Configurable max application tags and max tag length

2020-04-14 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-9954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17083602#comment-17083602 ] Jonathan Hung edited comment on YARN-9954 at 4/14/20, 8:52 PM: --- Thanks

[jira] [Commented] (YARN-10227) Pull YARN-8242 back to branch-2.10

2020-04-09 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17079656#comment-17079656 ] Jonathan Hung commented on YARN-10227: -- Thanks Jim for fixing this. Belated +1 from me. > Pull

[jira] [Comment Edited] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078598#comment-17078598 ] Jonathan Hung edited comment on YARN-10212 at 4/8/20, 6:56 PM: --- Thanks

[jira] [Commented] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-08 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17078598#comment-17078598 ] Jonathan Hung commented on YARN-10212: -- Thanks [~BilwaST], in general looks good, some minor style

[jira] [Commented] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-07 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17077515#comment-17077515 ] Jonathan Hung commented on YARN-10212: -- Thanks [~BilwaST]. A few comments: * The javadoc for

[jira] [Commented] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-04 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17075044#comment-17075044 ] Jonathan Hung commented on YARN-10212: -- [~BilwaST] it's used in RMAppImpl when validating user's

[jira] [Comment Edited] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074847#comment-17074847 ] Jonathan Hung edited comment on YARN-10212 at 4/3/20, 7:35 PM: --- [~BilwaST] 

[jira] [Comment Edited] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074847#comment-17074847 ] Jonathan Hung edited comment on YARN-10212 at 4/3/20, 7:34 PM: --- [~BilwaST] 

[jira] [Commented] (YARN-10212) Create separate configuration for max global AM attempts

2020-04-03 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17074847#comment-17074847 ] Jonathan Hung commented on YARN-10212: -- [~BilwaST] user's default max AM attempts is how many AM

[jira] [Commented] (YARN-10212) Create separate configuration for max global AM attempts

2020-03-30 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17071249#comment-17071249 ] Jonathan Hung commented on YARN-10212: -- Hey [~BilwaST], do you plan to take on this task? > Create

[jira] [Commented] (YARN-8213) Add Capacity Scheduler performance metrics

2020-03-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069084#comment-17069084 ] Jonathan Hung commented on YARN-8213: - I ran the failed 

[jira] [Comment Edited] (YARN-8213) Add Capacity Scheduler performance metrics

2020-03-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17069030#comment-17069030 ] Jonathan Hung edited comment on YARN-8213 at 3/27/20, 8:33 PM: --- Attached

[jira] [Reopened] (YARN-8213) Add Capacity Scheduler performance metrics

2020-03-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reopened YARN-8213: - > Add Capacity Scheduler performance metrics > -- > >

[jira] [Updated] (YARN-8213) Add Capacity Scheduler performance metrics

2020-03-27 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-8213: Attachment: YARN-8213-branch-2.10.001.patch > Add Capacity Scheduler performance metrics >

[jira] [Created] (YARN-10212) Create separate configuration for max global AM attempts

2020-03-27 Thread Jonathan Hung (Jira)
Jonathan Hung created YARN-10212: Summary: Create separate configuration for max global AM attempts Key: YARN-10212 URL: https://issues.apache.org/jira/browse/YARN-10212 Project: Hadoop YARN

[jira] [Commented] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-24 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066178#comment-17066178 ] Jonathan Hung commented on YARN-10200: -- Jenkins looks good, [~tangzhankun] mind having another look?

[jira] [Commented] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-24 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066051#comment-17066051 ] Jonathan Hung commented on YARN-10200: -- Thanks [~tangzhankun] for looking. Seems reasonable.

[jira] [Updated] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-24 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10200: - Attachment: YARN-10200.003.patch > Add number of containers to RMAppManager summary >

[jira] [Commented] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17065126#comment-17065126 ] Jonathan Hung commented on YARN-10200: -- Thanks Haibo, attached [^YARN-10200.002.patch] to fix

[jira] [Updated] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-23 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10200: - Attachment: YARN-10200.002.patch > Add number of containers to RMAppManager summary >

[jira] [Commented] (YARN-10192) CapacityScheduler stuck in loop rejecting allocation proposals

2020-03-18 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061976#comment-17061976 ] Jonathan Hung commented on YARN-10192: -- Thanks. Yeah Tao, agreed, we plan on turning DEBUG on for

[jira] [Updated] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-10200: - Attachment: YARN-10200.001.patch > Add number of containers to RMAppManager summary >

[jira] [Assigned] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung reassigned YARN-10200: Assignee: Jonathan Hung > Add number of containers to RMAppManager summary >

[jira] [Commented] (YARN-10200) Add number of containers to RMAppManager summary

2020-03-17 Thread Jonathan Hung (Jira)
[ https://issues.apache.org/jira/browse/YARN-10200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17061059#comment-17061059 ] Jonathan Hung commented on YARN-10200: -- Yeah [~maniraj...@gmail.com] I think that makes sense. >

  1   2   3   4   5   6   7   8   9   10   >