[jira] [Commented] (YARN-9360) Do not expose innards of QueueMetrics object into FSLeafQueue#computeMaxAMResource

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884931#comment-16884931 ] Szilard Nemeth commented on YARN-9360: -- HI [~pbacsko]! +1 for the latest patch, commi

[jira] [Comment Edited] (YARN-9360) Do not expose innards of QueueMetrics object into FSLeafQueue#computeMaxAMResource

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884931#comment-16884931 ] Szilard Nemeth edited comment on YARN-9360 at 7/15/19 8:49 AM: -

[jira] [Commented] (YARN-9360) Do not expose innards of QueueMetrics object into FSLeafQueue#computeMaxAMResource

2019-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884964#comment-16884964 ] Hudson commented on YARN-9360: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #169

[jira] [Commented] (YARN-9360) Do not expose innards of QueueMetrics object into FSLeafQueue#computeMaxAMResource

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16884965#comment-16884965 ] Szilard Nemeth commented on YARN-9360: -- Hi [~pbacsko]! Thanks for the contribution, c

[jira] [Created] (YARN-9675) Expose log aggregation diagnostic messages through RM API

2019-07-15 Thread Adam Antal (JIRA)
Adam Antal created YARN-9675: Summary: Expose log aggregation diagnostic messages through RM API Key: YARN-9675 URL: https://issues.apache.org/jira/browse/YARN-9675 Project: Hadoop YARN Issue Typ

[jira] [Assigned] (YARN-9675) Expose log aggregation diagnostic messages through RM API

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9675: Assignee: Adam Antal > Expose log aggregation diagnostic messages through RM API >

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885026#comment-16885026 ] Szilard Nemeth commented on YARN-9127: -- Thanks [~pbacsko]! +1 for the latest patch, c

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885029#comment-16885029 ] Hudson commented on YARN-9127: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #169

[jira] [Assigned] (YARN-9676) Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9676: Assignee: Adam Antal > Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected >

[jira] [Created] (YARN-9676) Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes

2019-07-15 Thread Adam Antal (JIRA)
Adam Antal created YARN-9676: Summary: Add DEBUG and TRACE level messages to AppLogAggregatorImpl and connected classes Key: YARN-9676 URL: https://issues.apache.org/jira/browse/YARN-9676 Project: Hadoop

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9127: - Attachment: YARN-9127.branch-3.2.001.patch > Create more tests to verify GpuDeviceInformationParse

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885041#comment-16885041 ] Hadoop QA commented on YARN-9127: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9127: - Attachment: YARN-9127.branch-3.1.001.patch > Create more tests to verify GpuDeviceInformationParse

[jira] [Commented] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885083#comment-16885083 ] Szilard Nemeth commented on YARN-9127: -- Committed to trunk! Thanks [~pbacsko] for you

[jira] [Comment Edited] (YARN-9127) Create more tests to verify GpuDeviceInformationParser

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885083#comment-16885083 ] Szilard Nemeth edited comment on YARN-9127 at 7/15/19 10:54 AM:

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885102#comment-16885102 ] Szilard Nemeth commented on YARN-9326: -- Hi [~adam.antal]! +1 for the latest patch! Co

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885103#comment-16885103 ] Hadoop QA commented on YARN-9326: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885104#comment-16885104 ] Szilard Nemeth commented on YARN-9326: -- Committed to trunk / branch-3.2. Thanks [~ada

[jira] [Commented] (YARN-9451) AggregatedLogsBlock shows wrong NM http port

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885111#comment-16885111 ] Szilard Nemeth commented on YARN-9451: -- Hi [~cheersyang]! Patch looks good to me. Do

[jira] [Assigned] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8586: Assignee: Peter Bacsko (was: Szilard Nemeth) > Extract log aggregation related fields and

[jira] [Assigned] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth reassigned YARN-8224: Assignee: Peter Bacsko (was: Szilard Nemeth) > LogAggregation status TIME_OUT for absent c

[jira] [Commented] (YARN-8224) LogAggregation status TIME_OUT for absent container misleading

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8224?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885115#comment-16885115 ] Szilard Nemeth commented on YARN-8224: -- Hi [~pbacsko]! Can you check this one? Thank

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885118#comment-16885118 ] Hadoop QA commented on YARN-8586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8480) Add boolean option for resources

2019-07-15 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885128#comment-16885128 ] Szilard Nemeth commented on YARN-8480: -- Hi [~leftnoteasy], [~templedf], [~sunilg]! Gi

[jira] [Commented] (YARN-8480) Add boolean option for resources

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885134#comment-16885134 ] Hadoop QA commented on YARN-8480: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885150#comment-16885150 ] Adam Antal commented on YARN-8199: -- Thanks for patch [~Prabhu Joseph], 1) When one of th

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-07-15 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885160#comment-16885160 ] Hudson commented on YARN-9326: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #169

[jira] [Created] (YARN-9677) Make FpgaDevice and GpuDevice classes more similar to each other

2019-07-15 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9677: Summary: Make FpgaDevice and GpuDevice classes more similar to each other Key: YARN-9677 URL: https://issues.apache.org/jira/browse/YARN-9677 Project: Hadoop YARN

[jira] [Created] (YARN-9678) TestGpuResourceHandler / TestFpgaResourceHandler should be renamed

2019-07-15 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9678: Summary: TestGpuResourceHandler / TestFpgaResourceHandler should be renamed Key: YARN-9678 URL: https://issues.apache.org/jira/browse/YARN-9678 Project: Hadoop YARN

[jira] [Created] (YARN-9679) Regular code cleanup in TestResourcePluginManager

2019-07-15 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9679: Summary: Regular code cleanup in TestResourcePluginManager Key: YARN-9679 URL: https://issues.apache.org/jira/browse/YARN-9679 Project: Hadoop YARN Issue Typ

[jira] [Created] (YARN-9680) Code cleanup in ResourcePluginManager init methods

2019-07-15 Thread Szilard Nemeth (JIRA)
Szilard Nemeth created YARN-9680: Summary: Code cleanup in ResourcePluginManager init methods Key: YARN-9680 URL: https://issues.apache.org/jira/browse/YARN-9680 Project: Hadoop YARN Issue Ty

[jira] [Assigned] (YARN-9679) Regular code cleanup in TestResourcePluginManager

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Antal reassigned YARN-9679: Assignee: Adam Antal > Regular code cleanup in TestResourcePluginManager >

[jira] [Comment Edited] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885305#comment-16885305 ] Adam Antal edited comment on YARN-9326 at 7/15/19 2:53 PM: --- Than

[jira] [Commented] (YARN-9326) Fair Scheduler configuration defaults are not documented in case of min and maxResources

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885305#comment-16885305 ] Adam Antal commented on YARN-9326: -- Thanks for the commit and the reviewers! > Fair Sche

[jira] [Commented] (YARN-9337) GPU auto-discovery script runs even when the resource is given by hand

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885307#comment-16885307 ] Adam Antal commented on YARN-9337: -- Thanks for the commit and the reviews! > GPU auto-di

[jira] [Commented] (YARN-9573) DistributedShell cannot specify LogAggregationContext

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885311#comment-16885311 ] Adam Antal commented on YARN-9573: -- Thanks [~snemeth]! > DistributedShell cannot specify

[jira] [Commented] (YARN-9667) Container-executor.c duplicates messages to stdout

2019-07-15 Thread Adam Antal (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885318#comment-16885318 ] Adam Antal commented on YARN-9667: -- The error message reproduced intermittently in our se

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-07-15 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885321#comment-16885321 ] Eric Payne commented on YARN-6492: -- [~maniraj...@gmail.com], the current patches don't ap

[jira] [Commented] (YARN-9451) AggregatedLogsBlock shows wrong NM http port

2019-07-15 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885322#comment-16885322 ] Prabhu Joseph commented on YARN-9451: - Thanks [~snemeth] for reviewing. Can we backpor

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-07-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885353#comment-16885353 ] Haibo Chen commented on YARN-9646: -- Thanks [~ste...@apache.org] for the clarification. Ag

[jira] [Updated] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-07-15 Thread Haibo Chen (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haibo Chen updated YARN-9646: - Attachment: YARN-9646.00.patch > Yarn miniYarn cluster tests failed to bind to a local host name > ---

[jira] [Updated] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-07-15 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-8199: Attachment: YARN-8199-004.patch > Logging fileSize of log files under NM Local Dir > ---

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-07-15 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885389#comment-16885389 ] Prabhu Joseph commented on YARN-8199: - Thanks [~adam.antal] for the review. Have addre

[jira] [Commented] (YARN-9668) UGI conf doesn't read user overridden configurations on RM and NM startup

2019-07-15 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885443#comment-16885443 ] Jonathan Hung commented on YARN-9668: - TestCapacityOverTimePolicy test failure looks r

[jira] [Updated] (YARN-9671) Improve Locality Scheduling when cluster is busy

2019-07-15 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Muhammad Samir Khan updated YARN-9671: -- Description: When a cluster is very busy, scheduling opportunities are few and far betwe

[jira] [Commented] (YARN-9671) Improve Locality Scheduling when cluster is busy

2019-07-15 Thread Muhammad Samir Khan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885468#comment-16885468 ] Muhammad Samir Khan commented on YARN-9671: --- Edited description: will handle pri

[jira] [Commented] (YARN-8199) Logging fileSize of log files under NM Local Dir

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885624#comment-16885624 ] Hadoop QA commented on YARN-8199: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885857#comment-16885857 ] Hadoop QA commented on YARN-9646: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (YARN-9646) Yarn miniYarn cluster tests failed to bind to a local host name

2019-07-15 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16885863#comment-16885863 ] Hadoop QA commented on YARN-9646: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote

[jira] [Created] (YARN-9681) AM resource limit is incorrect for queue

2019-07-15 Thread ANANDA G B (JIRA)
ANANDA G B created YARN-9681: Summary: AM resource limit is incorrect for queue Key: YARN-9681 URL: https://issues.apache.org/jira/browse/YARN-9681 Project: Hadoop YARN Issue Type: Bug

[jira] [Assigned] (YARN-9657) AbstractLivelinessMonitor add serviceName to PingChecker thread

2019-07-15 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T reassigned YARN-9657: --- Assignee: Bilwa S T > AbstractLivelinessMonitor add serviceName to PingChecker thread > -