[jira] [Reopened] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reopened YARN-6966: -- > NodeManager metrics may return wrong negative values when NM restart >

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6966: - Target Version/s: 2.10.0, 3.2.0, 3.1.2 > NodeManager metrics may return wrong negative values

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555480#comment-16555480 ] Szilard Nemeth commented on YARN-6966: -- Hi [~haibochen]! Reopened and moved this issue to Patch

[jira] [Assigned] (YARN-4946) RM should write out Aggregated Log Completion file flag next to logs

2018-07-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-4946: Assignee: Szilard Nemeth > RM should write out Aggregated Log Completion file flag next to

[jira] [Commented] (YARN-4946) RM should write out Aggregated Log Completion file flag next to logs

2018-07-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555607#comment-16555607 ] Szilard Nemeth commented on YARN-4946: -- Hi [~rkanter]! I'm trying to pick this one up. Since this is

[jira] [Comment Edited] (YARN-4946) RM should write out Aggregated Log Completion file flag next to logs

2018-07-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16555607#comment-16555607 ] Szilard Nemeth edited comment on YARN-4946 at 7/25/18 12:58 PM: Hi

[jira] [Updated] (YARN-8566) Add diagnostic message for unschedulable containers

2018-07-23 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8566: - Attachment: YARN-8566.001.patch > Add diagnostic message for unschedulable containers >

[jira] [Updated] (YARN-8566) Add diagnostic message for unschedulable containers

2018-07-23 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8566: - Attachment: YARN-8566.002.patch > Add diagnostic message for unschedulable containers >

[jira] [Updated] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6966: - Attachment: YARN-6966.005.patch > NodeManager metrics may return wrong negative values when NM

[jira] [Commented] (YARN-6966) NodeManager metrics may return wrong negative values when NM restart

2018-07-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16546439#comment-16546439 ] Szilard Nemeth commented on YARN-6966: -- Hi [~haibochen] and [~rkanter]! Thanks for taking time for

[jira] [Updated] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2018-07-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-6995: - Attachment: YARN-6995.008.patch > Improve use of ResourceNotFoundException in resource types code

[jira] [Commented] (YARN-6995) Improve use of ResourceNotFoundException in resource types code

2018-07-17 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16546451#comment-16546451 ] Szilard Nemeth commented on YARN-6995: -- Thanks [~haibochen]! Uploaded a new patch. Actually,

[jira] [Commented] (YARN-8644) Make RMAppImpl$FinalTransition more readable + add more test coverage

2018-08-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16596476#comment-16596476 ] Szilard Nemeth commented on YARN-8644: -- Hi [~zsiegl]! Thanks for your review comments, both findings

[jira] [Updated] (YARN-8644) Make RMAppImpl$FinalTransition more readable + add more test coverage

2018-08-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8644: - Attachment: YARN-8644.003.patch > Make RMAppImpl$FinalTransition more readable + add more test

[jira] [Commented] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-09-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604755#comment-16604755 ] Szilard Nemeth commented on YARN-8659: -- Hi [~Prabhu Joseph]! I found out the root cause of this bug

[jira] [Updated] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-09-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8659: - Attachment: YARN-8659.001.patch > RMWebServices returns only RUNNING apps when filtered with

[jira] [Comment Edited] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-09-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16604755#comment-16604755 ] Szilard Nemeth edited comment on YARN-8659 at 9/5/18 6:23 PM: -- Hi [~Prabhu

[jira] [Updated] (YARN-8750) Refactor TestQueueMetrics

2018-09-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8750: - Attachment: YARN-8750.001.patch > Refactor TestQueueMetrics > - > >

[jira] [Commented] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2018-09-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603139#comment-16603139 ] Szilard Nemeth commented on YARN-5464: -- Hi [~bsteinbach]! Are the unit test failures related? >

[jira] [Comment Edited] (YARN-5464) Server-Side NM Graceful Decommissioning with RM HA

2018-09-04 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603139#comment-16603139 ] Szilard Nemeth edited comment on YARN-5464 at 9/4/18 2:53 PM: -- Hi

[jira] [Created] (YARN-8750) Refactor TestQueueMetrics

2018-09-06 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8750: Summary: Refactor TestQueueMetrics Key: YARN-8750 URL: https://issues.apache.org/jira/browse/YARN-8750 Project: Hadoop YARN Issue Type: Improvement

[jira] [Updated] (YARN-8738) FairScheduler configures maxResources or minResources as negative, the value parse to a positive number.

2018-08-31 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8738: - Summary: FairScheduler configures maxResources or minResources as negative, the value parse to a

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538344#comment-16538344 ] Szilard Nemeth commented on YARN-8480: -- Uploaded second patch that fixes the trailing whitespace

[jira] [Updated] (YARN-8480) Add boolean option for resources

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8480: - Attachment: YARN-8480.002.patch > Add boolean option for resources >

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538323#comment-16538323 ] Szilard Nemeth commented on YARN-8468: -- Hi [~bsteinbach]! Thanks for the patch. This is high quality

[jira] [Comment Edited] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538323#comment-16538323 ] Szilard Nemeth edited comment on YARN-8468 at 7/10/18 9:41 AM: --- Hi

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537387#comment-16537387 ] Szilard Nemeth commented on YARN-8468: -- TestAMRestart is a known flaky and it has nothing to do with

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538764#comment-16538764 ] Szilard Nemeth commented on YARN-8502: -- Hey [~giovanni.fumarola]! I would vote for a separate jira as

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16538770#comment-16538770 ] Szilard Nemeth commented on YARN-8501: -- Hi [~Zian Chen]! As my intellij marks this method with a

[jira] [Commented] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-10 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539097#comment-16539097 ] Szilard Nemeth commented on YARN-8502: -- Thanks [~giovanni.fumarola] for the quick responses and for

[jira] [Commented] (YARN-8468) Limit container sizes per queue in FairScheduler

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539748#comment-16539748 ] Szilard Nemeth commented on YARN-8468: -- Hey [~bsteinbach]! Thanks for the updated patch. LGTM, +1

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Attachment: YARN-8501.001.patch > Reduce complexity of RMWebServices' getApps method >

[jira] [Updated] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8517: - Description: Looking at the documentation here:

[jira] [Updated] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8517: - Description: Looking at the documentation here:

[jira] [Created] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8517: Summary: getContainer and getContainers ResourceManager REST API methods are not documented Key: YARN-8517 URL: https://issues.apache.org/jira/browse/YARN-8517

[jira] [Updated] (YARN-8517) getContainer and getContainers ResourceManager REST API methods are not documented

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8517: - Description: Looking at the documentation here:

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Attachment: YARN-8501.002.patch > Reduce complexity of RMWebServices' getApps method >

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Summary: Reduce complexity of RMWebServices' getApps method (was: Decrease complexity of

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2018-07-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535748#comment-16535748 ] Szilard Nemeth commented on YARN-7556: -- Hi [~leftnoteasy]! I agree that this can be confusing. Could

[jira] [Comment Edited] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2018-07-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535748#comment-16535748 ] Szilard Nemeth edited comment on YARN-7556 at 7/7/18 12:41 PM: --- Hi

[jira] [Created] (YARN-8501) Decrease complexity of RMWebServices' getApps method

2018-07-07 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8501: Summary: Decrease complexity of RMWebServices' getApps method Key: YARN-8501 URL: https://issues.apache.org/jira/browse/YARN-8501 Project: Hadoop YARN Issue

[jira] [Created] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-07 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8502: Summary: Use path strings consistently for webservice endpoints in RMWebServices Key: YARN-8502 URL: https://issues.apache.org/jira/browse/YARN-8502 Project: Hadoop

[jira] [Commented] (YARN-7451) Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints

2018-07-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16535747#comment-16535747 ] Szilard Nemeth commented on YARN-7451: -- Hi [~rkanter]! Thanks for the commit. > Add missing tests to

[jira] [Updated] (YARN-8502) Use path strings consistently for webservice endpoints in RMWebServices

2018-07-07 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8502: - Attachment: YARN-8502-001.patch > Use path strings consistently for webservice endpoints in

[jira] [Commented] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542805#comment-16542805 ] Szilard Nemeth commented on YARN-8524: -- Thanks [~sunilg] for your comments. 1. I still used a

[jira] [Updated] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8524: - Attachment: YARN-8524.003.patch > Single parameter Resource / LightWeightResource constructor

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Attachment: YARN-8501.004.patch > Reduce complexity of RMWebServices' getApps method >

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542715#comment-16542715 ] Szilard Nemeth commented on YARN-8501: -- Hi [~eyang]! Sure, I renamed the class, please check the new

[jira] [Updated] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8524: - Attachment: YARN-8524.002.patch > Single parameter Resource / LightWeightResource constructor

[jira] [Comment Edited] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542731#comment-16542731 ] Szilard Nemeth edited comment on YARN-8524 at 7/13/18 8:59 AM: --- Hi [~Zian

[jira] [Commented] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542731#comment-16542731 ] Szilard Nemeth commented on YARN-8524: -- Hi [~Zian Chen]! 1. Yes it's definitely better with a

[jira] [Updated] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8501: - Attachment: YARN-8501.003.patch > Reduce complexity of RMWebServices' getApps method >

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541634#comment-16541634 ] Szilard Nemeth commented on YARN-8501: -- Hi [~suma.shivaprasad], [~Zian Chen]! Please check the latest

[jira] [Comment Edited] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541471#comment-16541471 ] Szilard Nemeth edited comment on YARN-8501 at 7/12/18 11:05 AM: Hey

[jira] [Commented] (YARN-8501) Reduce complexity of RMWebServices' getApps method

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541471#comment-16541471 ] Szilard Nemeth commented on YARN-8501: -- Hey [~suma.shivaprasad]! I think the class

[jira] [Updated] (YARN-7133) Clean up lock-try order in fair scheduler

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7133: - Attachment: YARN-7133.001.patch > Clean up lock-try order in fair scheduler >

[jira] [Updated] (YARN-7300) DiskValidator is not used in LocalDirAllocator

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7300: - Attachment: YARN-7300.001.patch > DiskValidator is not used in LocalDirAllocator >

[jira] [Created] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-12 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8524: Summary: Single parameter Resource / LightWeightResource constructor looks confusing Key: YARN-8524 URL: https://issues.apache.org/jira/browse/YARN-8524 Project:

[jira] [Commented] (YARN-7556) Fair scheduler configuration should allow resource types in the minResources and maxResources properties

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16541978#comment-16541978 ] Szilard Nemeth commented on YARN-7556: -- Hi [~leftnoteasy]! YARN-8524 is created. > Fair scheduler

[jira] [Updated] (YARN-8524) Single parameter Resource / LightWeightResource constructor looks confusing

2018-07-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8524: - Attachment: YARN-8524.001.patch > Single parameter Resource / LightWeightResource constructor

[jira] [Commented] (YARN-8436) FSParentQueue: Comparison method violates its general contract

2018-07-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536760#comment-16536760 ] Szilard Nemeth commented on YARN-8436: -- Hi [~wilfreds]! Thanks for uploading this patch. LGTM, +1

[jira] [Assigned] (YARN-6964) Fair scheduler misuses Resources operations

2018-07-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-6964: Assignee: Szilard Nemeth (was: Daniel Templeton) > Fair scheduler misuses Resources

[jira] [Updated] (YARN-8480) Add boolean option for resources

2018-07-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8480: - Attachment: YARN-8480.001.patch > Add boolean option for resources >

[jira] [Commented] (YARN-8480) Add boolean option for resources

2018-07-09 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16536640#comment-16536640 ] Szilard Nemeth commented on YARN-8480: -- Hi, I understand that we need to come to a conclusion about

[jira] [Commented] (YARN-4022) queue not remove from webpage(/cluster/scheduler) when delete queue in xxx-scheduler.xml

2018-01-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16337412#comment-16337412 ] Szilard Nemeth commented on YARN-4022: -- Hey [~yufeigu]! Sorry, there was a confusion from my side so

[jira] [Updated] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7451: - Attachment: YARN-7451.006.patch Thanks [~grepas] for your comments. All of them are fixed except

[jira] [Comment Edited] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323935#comment-16323935 ] Szilard Nemeth edited comment on YARN-7451 at 1/12/18 1:11 PM: --- Thanks

[jira] [Comment Edited] (YARN-7451) Resources Types should be visible in the Cluster Apps API "resourceRequests" section

2018-01-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16323935#comment-16323935 ] Szilard Nemeth edited comment on YARN-7451 at 1/12/18 1:10 PM: --- Thanks

[jira] [Created] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-24 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-8202: Summary: DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation Key: YARN-8202 URL:

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Description:   When I execute a pi job with arguments:  *-Dmapreduce.map.resource.memory-mb=200

[jira] [Commented] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450126#comment-16450126 ] Szilard Nemeth commented on YARN-8202: -- YARN-7739 fixed the missing check for custom resource types

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Description:   When I execute a pi job with arguments:  {code:java}

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Attachment: YARN-8202-001.patch > DefaultAMSProcessor should properly check units of requested

[jira] [Commented] (YARN-8039) Clean up log dir configuration in TestLinuxContainerExecutorWithMocks.testStartLocalizer

2018-03-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16402429#comment-16402429 ] Szilard Nemeth commented on YARN-8039: -- +1 (non-binding) > Clean up log dir configuration in >

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-25 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Attachment: YARN-8202-002.patch > DefaultAMSProcessor should properly check units of requested

[jira] [Commented] (YARN-8191) Fair scheduler: queue deletion without RM restart

2018-04-26 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16454191#comment-16454191 ] Szilard Nemeth commented on YARN-8191: -- # Please remove block comment from QueueManager.isEmpty #

[jira] [Updated] (YARN-8202) DefaultAMSProcessor should properly check units of requested custom resource types against minimum/maximum allocation

2018-04-26 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8202: - Attachment: YARN-8202-004.patch > DefaultAMSProcessor should properly check units of requested

[jira] [Commented] (YARN-7451) Add missing tests to verify the presence of custom resources of RM apps and scheduler webservice endpoints

2018-06-20 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16517986#comment-16517986 ] Szilard Nemeth commented on YARN-7451: -- Hey [~rkanter]! This is ready to committer review, finally.

[jira] [Commented] (YARN-8644) Improve unit test for RMAppImpl.FinalTransition

2018-10-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640067#comment-16640067 ] Szilard Nemeth commented on YARN-8644: -- Thanks [~haibochen]! > Improve unit test for

[jira] [Commented] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-10-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16640192#comment-16640192 ] Szilard Nemeth commented on YARN-8659: -- Thanks [~haibochen] for confirming that this is a bug. 1.

[jira] [Updated] (YARN-8659) RMWebServices returns only RUNNING apps when filtered with queue

2018-10-05 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8659: - Attachment: YARN-8659.002.patch > RMWebServices returns only RUNNING apps when filtered with

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.009.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-11 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16646831#comment-16646831 ] Szilard Nemeth commented on YARN-8842: -- Based on our offline discussion with [~wilfreds], here are

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648407#comment-16648407 ] Szilard Nemeth commented on YARN-8842: -- Hi [~wilfreds]! Thanks for the review! > Update QueueMetrics

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.010.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16648649#comment-16648649 ] Szilard Nemeth commented on YARN-8842: -- I cleaned up the patch a little bit. Let's wait for jenkins

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.012.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651012#comment-16651012 ] Szilard Nemeth commented on YARN-8842: -- Hi [~haibochen]! I applied the changes you suggested, please

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8059: - Attachment: YARN-8059.004.patch > Resource type is ignored when FS decide to preempt >

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16655353#comment-16655353 ] Szilard Nemeth commented on YARN-8059: -- patch004 fixes the remaining test failure as well > Resource

[jira] [Commented] (YARN-8842) Expose metrics for custom resource types in QueueMetrics

2018-10-16 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16652730#comment-16652730 ] Szilard Nemeth commented on YARN-8842: -- Thanks [~haibochen] for the commit and for fixing the

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-19 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16656820#comment-16656820 ] Szilard Nemeth commented on YARN-8059: -- Hi [~wilfreds]! Thanks for your comments! 1. If you meant we

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-19 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8059: - Attachment: YARN-8059.005.patch > Resource type is ignored when FS decide to preempt >

[jira] [Commented] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654711#comment-16654711 ] Szilard Nemeth commented on YARN-8059: -- Hi [~wilfreds]! Please see the updated patch that fixes your

[jira] [Updated] (YARN-8059) Resource type is ignored when FS decide to preempt

2018-10-18 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8059: - Attachment: YARN-8059.003.patch > Resource type is ignored when FS decide to preempt >

[jira] [Updated] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-8842: - Attachment: YARN-8842.011.patch > Update QueueMetrics with custom resource values >

[jira] [Commented] (YARN-8842) Update QueueMetrics with custom resource values

2018-10-13 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16649193#comment-16649193 ] Szilard Nemeth commented on YARN-8842: -- Hi [~haibochen]! Fixed some checkstyle issues with patch011.

[jira] [Assigned] (YARN-8818) Yarn log aggregation of spark streaming job

2018-10-24 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8818: Assignee: Szilard Nemeth > Yarn log aggregation of spark streaming job >

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-10-28 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5106: - Attachment: YARN-5106.001.patch > Provide a builder interface for FairScheduler allocations for

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2018-10-29 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5106: - Attachment: YARN-5106.002.patch > Provide a builder interface for FairScheduler allocations for

<    1   2   3   4   5   6   7   8   9   10   >