[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905055#comment-16905055 ] Szilard Nemeth commented on YARN-5106: -- Hi [~zsiegl]! Could you please check the results? Thanks! >

[jira] [Commented] (YARN-9133) Make tests more easy to comprehend in TestGpuResourceHandler

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905143#comment-16905143 ] Szilard Nemeth commented on YARN-9133: -- Hi [~pbacsko]! I do agree to not bother with backports, then.

[jira] [Commented] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905195#comment-16905195 ] Hadoop QA commented on YARN-9610: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905233#comment-16905233 ] Peter Bacsko commented on YARN-9140: Note: patch v3, v4 and v5 are totally unrelated changesets. I

[jira] [Commented] (YARN-9701) Yarn service cli commands do not connect to ssl enabled RM using ssl-client.xml configs

2019-08-12 Thread Billie Rinaldi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905261#comment-16905261 ] Billie Rinaldi commented on YARN-9701: -- cc [~eyang] > Yarn service cli commands do not connect to

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905045#comment-16905045 ] Prabhu Joseph commented on YARN-9464: - Thanks [~abmodi]. > Support "Pending Resource" metrics in RM's

[jira] [Commented] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-08-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905067#comment-16905067 ] Bibin A Chundatt commented on YARN-9738: Did an offline testing with sample code . With 10K

[jira] [Comment Edited] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-08-12 Thread Bibin A Chundatt (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905067#comment-16905067 ] Bibin A Chundatt edited comment on YARN-9738 at 8/12/19 10:59 AM: -- Did an

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905140#comment-16905140 ] Szilard Nemeth commented on YARN-9134: -- Hi [~pbacsko]! Committed to trunk! Please provide branch-3.2

[jira] [Commented] (YARN-9451) AggregatedLogsBlock shows wrong NM http port

2019-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905171#comment-16905171 ] Hudson commented on YARN-9451: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17094 (See

[jira] [Updated] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9140: --- Attachment: YARN-9140.006.patch > Code cleanup in ResourcePluginManager.initialize and in >

[jira] [Updated] (YARN-9727) Allowed Origin pattern is discouraged if regex contains *

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-9727: - Description: HADOOP-14908 if allowed-origins regex contains any * characters an incorrect

[jira] [Commented] (YARN-9488) Skip YARNFeatureNotEnabledException from ClientRMService

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905279#comment-16905279 ] Prabhu Joseph commented on YARN-9488: - [~adam.antal] [~snemeth] Can you review this Jira when you get

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905048#comment-16905048 ] Hadoop QA commented on YARN-5106: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905105#comment-16905105 ] Morty Zhong commented on YARN-9610: --- In my production, use this patch work fine > HeartbeatCallBack int

[jira] [Updated] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-08-12 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9738: Attachment: YARN-9738-001.patch > Remove lock on ClusterNodeTracker#getNodeReport as it blocks application

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905119#comment-16905119 ] Szilard Nemeth commented on YARN-9135: -- Hi [~pbacsko]! Thanks for the patches, committed to branch

[jira] [Commented] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905150#comment-16905150 ] Morty Zhong commented on YARN-9610: --- git diff from trunk YARN-9610.patch.2 > HeartbeatCallBack int

[jira] [Issue Comment Deleted] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Morty Zhong updated YARN-9610: -- Comment: was deleted (was: diff from trunk [^YARN-9610.patch.1]2) > HeartbeatCallBack int

[jira] [Commented] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905149#comment-16905149 ] Morty Zhong commented on YARN-9610: --- diff from trunk [^YARN-9610.patch.1]2 > HeartbeatCallBack int

[jira] [Commented] (YARN-7291) Better input parsing for resource in allocation file

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905126#comment-16905126 ] Hadoop QA commented on YARN-7291: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9451) AggregatedLogsBlock shows wrong NM http port

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905251#comment-16905251 ] Prabhu Joseph commented on YARN-9451: - Thanks [~snemeth]. > AggregatedLogsBlock shows wrong NM http

[jira] [Commented] (YARN-9723) ApplicationPlacementContext is not required for terminated jobs during recovery

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905249#comment-16905249 ] Prabhu Joseph commented on YARN-9723: - Thanks [~snemeth]. > ApplicationPlacementContext is not

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905152#comment-16905152 ] Hudson commented on YARN-9134: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17093 (See

[jira] [Commented] (YARN-8148) Update decimal values for queue capacities shown on queue status cli

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905280#comment-16905280 ] Prabhu Joseph commented on YARN-8148: - [~snemeth] Can you review this Jira when you get time. This

[jira] [Updated] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Morty Zhong updated YARN-9610: -- Attachment: YARN-9610.patch.2 > HeartbeatCallBack int FederationInterceptor clear AMRMToken in response

[jira] [Commented] (YARN-9451) AggregatedLogsBlock shows wrong NM http port

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905164#comment-16905164 ] Szilard Nemeth commented on YARN-9451: -- Hi [~Prabhu Joseph]! Thanks for the latest patch, committed

[jira] [Commented] (YARN-9723) ApplicationPlacementContext is not required for terminated jobs during recovery

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905177#comment-16905177 ] Szilard Nemeth commented on YARN-9723: -- Hi [~Prabhu Joseph]! Thanks for the latest patch, committed

[jira] [Updated] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9290: Attachment: YARN-9290-004.patch > Invalid SchedulingRequest not rejected in Scheduler >

[jira] [Commented] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905109#comment-16905109 ] Hadoop QA commented on YARN-9610: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905148#comment-16905148 ] Szilard Nemeth commented on YARN-9140: -- Hi [~pbacsko]! I do agree to not bother with backports, then.

[jira] [Commented] (YARN-9723) ApplicationPlacementContext is not required for terminated jobs during recovery

2019-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905192#comment-16905192 ] Hudson commented on YARN-9723: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17095 (See

[jira] [Updated] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-9134: --- Attachment: YARN-9134.branch-3.2.001.patch > No test coverage for redefining FPGA / GPU resource

[jira] [Commented] (YARN-6492) Generate queue metrics for each partition

2019-08-12 Thread Eric Payne (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905471#comment-16905471 ] Eric Payne commented on YARN-6492: -- Thanks for the updated patch [~maniraj...@gmail.com]. I feel like

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905470#comment-16905470 ] Hadoop QA commented on YARN-9290: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905321#comment-16905321 ] Hadoop QA commented on YARN-9290: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9290: Attachment: YARN-9290-005.patch > Invalid SchedulingRequest not rejected in Scheduler >

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905323#comment-16905323 ] Peter Bacsko commented on YARN-9134: [~snemeth] I'd skip 3.1. Way too many conflicts even if I use the

[jira] [Updated] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9290: Attachment: (was: YARN-9290-005.patch) > Invalid SchedulingRequest not rejected in Scheduler >

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905306#comment-16905306 ] Hadoop QA commented on YARN-9140: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Comment Edited] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905323#comment-16905323 ] Peter Bacsko edited comment on YARN-9134 at 8/12/19 3:49 PM: - [~snemeth] I'd

[jira] [Updated] (YARN-9290) Invalid SchedulingRequest not rejected in Scheduler PlacementConstraintsHandler

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Prabhu Joseph updated YARN-9290: Attachment: YARN-9290-005.patch > Invalid SchedulingRequest not rejected in Scheduler >

[jira] [Commented] (YARN-8148) Update decimal values for queue capacities shown on queue status cli

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905345#comment-16905345 ] Hadoop QA commented on YARN-8148: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Peter Bacsko updated YARN-8586: --- Attachment: YARN-8586.004.patch > Extract log aggregation related fields and methods from RMAppImpl >

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905375#comment-16905375 ] Hadoop QA commented on YARN-9134: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9134) No test coverage for redefining FPGA / GPU resource types in TestResourceUtils

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905452#comment-16905452 ] Peter Bacsko commented on YARN-9134: ASF warning can be safely ignored: {noformat} Lines that start

[jira] [Commented] (YARN-8586) Extract log aggregation related fields and methods from RMAppImpl

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8586?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905479#comment-16905479 ] Hadoop QA commented on YARN-8586: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9140) Code cleanup in ResourcePluginManager.initialize and in TestResourcePluginManager

2019-08-12 Thread Peter Bacsko (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905327#comment-16905327 ] Peter Bacsko commented on YARN-9140: Unit test failure is unrelated. > Code cleanup in

[jira] [Updated] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-12 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Hung updated YARN-9730: Attachment: YARN-9730.002.patch > Support forcing configured partitions to be exclusive based on

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-12 Thread Jonathan Hung (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905458#comment-16905458 ] Jonathan Hung commented on YARN-9730: - 002 fixes unit test, license error, and most checkstyle (some

[jira] [Updated] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-12 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] KWON BYUNGCHANG updated YARN-9731: -- Attachment: YARN-9731.005.patch > In ATS v1.5, all jobs are visible to all users without

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-12 Thread KWON BYUNGCHANG (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904882#comment-16904882 ] KWON BYUNGCHANG commented on YARN-9731: --- [~abmodi] thank you for review. I've attched patch.  > In

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904904#comment-16904904 ] Prabhu Joseph commented on YARN-9464: - [~abmodi] The testcase works fine on local and looks not

[jira] [Comment Edited] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904904#comment-16904904 ] Prabhu Joseph edited comment on YARN-9464 at 8/12/19 7:03 AM: -- [~abmodi] The

[jira] [Commented] (YARN-6539) Create SecureLogin inside Router

2019-08-12 Thread Xie YiFan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904992#comment-16904992 ] Xie YiFan commented on YARN-6539: - [~subru], I cant' find any test that was related to RM and NM

[jira] [Comment Edited] (YARN-9728)  ResourceManager REST API can produce an illegal xml response

2019-08-12 Thread Thomas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9728?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904179#comment-16904179 ] Thomas edited comment on YARN-9728 at 8/12/19 9:45 AM: --- Hi [~Prabhu Joseph], I

[jira] [Updated] (YARN-7291) Better input parsing for resource in allocation file

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-7291: - Attachment: YARN-7291.005.patch > Better input parsing for resource in allocation file >

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905001#comment-16905001 ] Hudson commented on YARN-9464: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17090 (See

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: heap1.png stack.png > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: heap0.png > appsTableData in AppsBlock may cause OOM > >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: 选区_001 (1).png > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: (was: 选区_003.png) > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: (was: 选区_001 (1).png) > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: 选区_003.png 选区_004.png > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated YARN-9739: --- Attachment: (was: 选区_004.png) > appsTableData in AppsBlock may cause OOM >

[jira] [Updated] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Morty Zhong updated YARN-9610: -- Description: in federation, `allocate` is async. the response from RM is cached in

[jira] [Updated] (YARN-9610) HeartbeatCallBack int FederationInterceptor clear AMRMToken in response from UAM should before add to aysncResponseSink

2019-08-12 Thread Morty Zhong (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Morty Zhong updated YARN-9610: -- Environment: (was: in federation, `allocate` is async. the response from RM is cached in

[jira] [Commented] (YARN-8432) Verbose error message when YARN service is disabled

2019-08-12 Thread Alexander Ermakov (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905032#comment-16905032 ] Alexander Ermakov commented on YARN-8432: - We have the same issue, any changes? > Verbose error

[jira] [Commented] (YARN-9731) In ATS v1.5, all jobs are visible to all users without view-acl

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904932#comment-16904932 ] Hadoop QA commented on YARN-9731: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9464) Support "Pending Resource" metrics in RM's RESTful API

2019-08-12 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904993#comment-16904993 ] Abhishek Modi commented on YARN-9464: - Thanks [~Prabhu Joseph]. Committed to trunk. > Support

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-12 Thread kyungwan nam (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904875#comment-16904875 ] kyungwan nam commented on YARN-9719: [~eyang], [~Prabhu Joseph] 007 patch was passed without failure.

[jira] [Created] (YARN-9740) TestSystemMetricsPublisher.testPublishContainerMetrics fails intermittent

2019-08-12 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created YARN-9740: --- Summary: TestSystemMetricsPublisher.testPublishContainerMetrics fails intermittent Key: YARN-9740 URL: https://issues.apache.org/jira/browse/YARN-9740 Project: Hadoop

[jira] [Commented] (YARN-9135) NM State store ResourceMappings serialization are tested with Strings instead of real Device objects

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905004#comment-16905004 ] Hadoop QA commented on YARN-9135: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szilard Nemeth updated YARN-5106: - Attachment: YARN-5106.008.patch > Provide a builder interface for FairScheduler allocations for

[jira] [Commented] (YARN-5106) Provide a builder interface for FairScheduler allocations for use in tests

2019-08-12 Thread Szilard Nemeth (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905003#comment-16905003 ] Szilard Nemeth commented on YARN-5106: -- Re-attached latest patch targeting trunk to have a fresh

[jira] [Created] (YARN-9739) appsTableData in AppsBlock may cause OOM

2019-08-12 Thread zhoukang (JIRA)
zhoukang created YARN-9739: -- Summary: appsTableData in AppsBlock may cause OOM Key: YARN-9739 URL: https://issues.apache.org/jira/browse/YARN-9739 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905616#comment-16905616 ] Eric Yang commented on YARN-9562: - [~ebadger] The config is written as: {code}

[jira] [Commented] (YARN-9373) HBaseTimelineSchemaCreator has to allow user to configure pre-splits

2019-08-12 Thread Abhishek Modi (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905783#comment-16905783 ] Abhishek Modi commented on YARN-9373: - Thanks [~Prabhu Joseph] for the patch. I will review it as soon

[jira] [Commented] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905807#comment-16905807 ] Hadoop QA commented on YARN-9738: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9373) HBaseTimelineSchemaCreator has to allow user to configure pre-splits

2019-08-12 Thread Prabhu Joseph (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905836#comment-16905836 ] Prabhu Joseph commented on YARN-9373: - Yes Sure [~abmodi]. Thanks. > HBaseTimelineSchemaCreator has

[jira] [Updated] (YARN-9738) Remove lock on ClusterNodeTracker#getNodeReport as it blocks application submission

2019-08-12 Thread Bilwa S T (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bilwa S T updated YARN-9738: Attachment: YARN-9738-002.patch > Remove lock on ClusterNodeTracker#getNodeReport as it blocks application

[jira] [Commented] (YARN-9701) Yarn service cli commands do not connect to ssl enabled RM using ssl-client.xml configs

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905681#comment-16905681 ] Eric Yang commented on YARN-9701: - [~tarunparimi] Thank you for the patch. The patch is nicely written.

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905579#comment-16905579 ] Eric Badger commented on YARN-9564: --- [~eyang], those logs are normal. When debug logging is enabled, the

[jira] [Commented] (YARN-9683) Remove reapDockerContainerNoPid left behind by YARN-9074

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905587#comment-16905587 ] Eric Yang commented on YARN-9683: - +1 Good catch, will commit to trunk if no objections. [~pingsutw]

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905656#comment-16905656 ] Eric Yang commented on YARN-9719: - +1 for patch 007. [~kyungwan nam], thank you for the patches. [~Prabhu

[jira] [Commented] (YARN-9564) Create docker-to-squash tool for image conversion

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905554#comment-16905554 ] Eric Yang commented on YARN-9564: - [~ebadger] This script works with root user only and there are a number

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905667#comment-16905667 ] Eric Yang commented on YARN-9562: - [~ebadger] {quote}I'm not quite sure how it's possible that your config

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Yang (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905561#comment-16905561 ] Eric Yang commented on YARN-9562: - By combining YARN-9561, YARN-9562, YARN-9564, I got a few steps further

[jira] [Commented] (YARN-9730) Support forcing configured partitions to be exclusive based on app node label

2019-08-12 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9730?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905591#comment-16905591 ] Hadoop QA commented on YARN-9730: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (YARN-9719) Failed to restart yarn-service if it doesn’t exist in RM

2019-08-12 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905644#comment-16905644 ] Hudson commented on YARN-9719: -- FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #17096 (See

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905586#comment-16905586 ] Eric Badger commented on YARN-9562: --- [~eyang], could you post your relevant config settings? It looks

[jira] [Commented] (YARN-9562) Add Java changes for the new RuncContainerRuntime

2019-08-12 Thread Eric Badger (JIRA)
[ https://issues.apache.org/jira/browse/YARN-9562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905630#comment-16905630 ] Eric Badger commented on YARN-9562: --- {noformat:title=ImageTagToManifestPlugin.java} Path