[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497807#comment-14497807 ] Rohith commented on YARN-3494: -- AM Resource Limit and User Limit are specific to

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497669#comment-14497669 ] Hadoop QA commented on YARN-3044: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3496) Add a configuration to disable/enable storing localization state in NMLeveldbStateStore

[ https://issues.apache.org/jira/browse/YARN-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhihai xu updated YARN-3496: Description: Add a configuration to disable/enable storing localization state in NMLeveldbStateStore. Store

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497775#comment-14497775 ] Sunil G commented on YARN-3136: --- HI [~jianhe] Specific tests are not needed for this. But we

[jira] [Commented] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497673#comment-14497673 ] Naganarasimha G R commented on YARN-3044: - Hi [~zjshen], [~djp] [~sjlee0], I have

[jira] [Updated] (YARN-3044) [Event producers] Implement RM writing app lifecycle events to ATS

[ https://issues.apache.org/jira/browse/YARN-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naganarasimha G R updated YARN-3044: Attachment: YARN-3044.20150416-1.patch [Event producers] Implement RM writing app lifecycle

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497872#comment-14497872 ] Junping Du commented on YARN-3046: -- Hi [~zjshen] and [~rkanter], any comments on latest

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497934#comment-14497934 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2097 (See

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497932#comment-14497932 ] Hudson commented on YARN-3354: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2097 (See

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497933#comment-14497933 ] Hudson commented on YARN-3404: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2097 (See

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497960#comment-14497960 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-Yarn-trunk #899 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497953#comment-14497953 ] Hudson commented on YARN-3326: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #165 (See

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497951#comment-14497951 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #165 (See

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497949#comment-14497949 ] Hudson commented on YARN-3354: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #165 (See

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497950#comment-14497950 ] Hudson commented on YARN-3404: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #165 (See

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497941#comment-14497941 ] Hudson commented on YARN-3354: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #156 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497945#comment-14497945 ] Hudson commented on YARN-3326: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #156 (See

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497943#comment-14497943 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #156 (See

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497942#comment-14497942 ] Hudson commented on YARN-3404: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #156 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497936#comment-14497936 ] Hudson commented on YARN-3326: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2097 (See

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497915#comment-14497915 ] Junping Du commented on YARN-1402: -- Thanks [~xgong] for the patch! I have a few comments

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497959#comment-14497959 ] Hudson commented on YARN-3404: -- FAILURE: Integrated in Hadoop-Yarn-trunk #899 (See

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497958#comment-14497958 ] Hudson commented on YARN-3354: -- FAILURE: Integrated in Hadoop-Yarn-trunk #899 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14497962#comment-14497962 ] Hudson commented on YARN-3326: -- FAILURE: Integrated in Hadoop-Yarn-trunk #899 (See

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Attachment: YARN-3448.9.patch Add Rolling Time To Lives Level DB Plugin Capabilities

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498092#comment-14498092 ] Jason Lowe commented on YARN-3491: -- Storing asynchronously is going to be a bit dangerous

[jira] [Commented] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498146#comment-14498146 ] Hadoop QA commented on YARN-3448: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498100#comment-14498100 ] Junping Du commented on YARN-3366: -- Thanks [~sidharta-s] for delivering the patch! A few

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498127#comment-14498127 ] Hudson commented on YARN-3318: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498125#comment-14498125 ] Hudson commented on YARN-3354: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498126#comment-14498126 ] Hudson commented on YARN-3404: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498129#comment-14498129 ] Hudson commented on YARN-3326: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #166 (See

[jira] [Commented] (YARN-3326) Support RESTful API for getLabelsToNodes

[ https://issues.apache.org/jira/browse/YARN-3326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498183#comment-14498183 ] Hudson commented on YARN-3326: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See

[jira] [Commented] (YARN-3354) Container should contains node-labels asked by original ResourceRequests

[ https://issues.apache.org/jira/browse/YARN-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498178#comment-14498178 ] Hudson commented on YARN-3354: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See

[jira] [Commented] (YARN-3318) Create Initial OrderingPolicy Framework and FifoOrderingPolicy

[ https://issues.apache.org/jira/browse/YARN-3318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498180#comment-14498180 ] Hudson commented on YARN-3318: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See

[jira] [Commented] (YARN-3404) View the queue name to YARN Application page

[ https://issues.apache.org/jira/browse/YARN-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498179#comment-14498179 ] Hudson commented on YARN-3404: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk #2115 (See

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498169#comment-14498169 ] Junping Du commented on YARN-3431: -- Thanks [~zjshen] for delivering a updated patch to fix

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498253#comment-14498253 ] Yongjun Zhang commented on YARN-3021: - HI [~jianhe], Thanks for looking at it again

[jira] [Commented] (YARN-3491) PublicLocalizer#addResource is too slow.

[ https://issues.apache.org/jira/browse/YARN-3491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498312#comment-14498312 ] zhihai xu commented on YARN-3491: - Yes, I agree Storing asynchronously is going to be a bit

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498324#comment-14498324 ] Sunil G commented on YARN-3487: --- Hi [~leftnoteasy] and [~jlowe] During reloading CS config,

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498326#comment-14498326 ] Wangda Tan commented on YARN-3463: -- Some comments: LeafQueue: - activeApplications now

[jira] [Commented] (YARN-3431) Sub resources of timeline entity needs to be passed to a separate endpoint.

[ https://issues.apache.org/jira/browse/YARN-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498321#comment-14498321 ] Zhijie Shen commented on YARN-3431: --- bq. There is always exception get thrown here. We

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498306#comment-14498306 ] Sunil G commented on YARN-3494: --- Could we define the metric in QueueMetrics, but the setter

[jira] [Updated] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated YARN-3021: Attachment: YARN-3021.007.patch YARN's delegation-token handling disallows certain trust setups to

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498275#comment-14498275 ] Sidharta Seethana commented on YARN-3366: - hi [~djp] , Thanks for review.

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498278#comment-14498278 ] Junping Du commented on YARN-3411: -- Just quickly go through the poc patch which is good

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498322#comment-14498322 ] Jian He commented on YARN-3136: --- Hi [~sunilg], for that I think we can add these two in the

[jira] [Commented] (YARN-3496) Add a configuration to disable/enable storing localization state in NMLeveldbStateStore

[ https://issues.apache.org/jira/browse/YARN-3496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498088#comment-14498088 ] Jason Lowe commented on YARN-3496: -- How are we going to support recovery of containers

[jira] [Updated] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunil G updated YARN-3136: -- Attachment: 00011-YARN-3136.patch Thank you [~jianhe] I have added the check in exclude file. Will kick in

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498372#comment-14498372 ] Wangda Tan commented on YARN-2740: -- 1. CommonNodeLabelsManager: 1.1)

[jira] [Assigned] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vijay Bhat reassigned YARN-2976: Assignee: Vijay Bhat Invalid docs for specifying

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498387#comment-14498387 ] Sunil G commented on YARN-3476: --- HI [~jlowe] and [~rohithsharma] A retention logic to handle

[jira] [Updated] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

[ https://issues.apache.org/jira/browse/YARN-3497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Lowe updated YARN-3497: - Attachment: YARN-3497.001.patch This causes the Tez AM to reconnect to the RM on every AM heartbeat.

[jira] [Updated] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sidharta Seethana updated YARN-3366: Attachment: YARN-3366.006.patch hi [~djp] , Uploading a new patch based on your feedback.

[jira] [Commented] (YARN-3411) [Storage implementation] explore the native HBase write schema for storage

[ https://issues.apache.org/jira/browse/YARN-3411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498366#comment-14498366 ] Vrushali C commented on YARN-3411: -- Thanks [~djp] ! bq. Just quickly go through the poc

[jira] [Created] (YARN-3497) ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy

Jason Lowe created YARN-3497: Summary: ContainerManagementProtocolProxy modifies IPC timeout conf without making a copy Key: YARN-3497 URL: https://issues.apache.org/jira/browse/YARN-3497 Project: Hadoop

[jira] [Created] (YARN-3498) Improve Timeline Server Memory Usage

Jonathan Eagles created YARN-3498: - Summary: Improve Timeline Server Memory Usage Key: YARN-3498 URL: https://issues.apache.org/jira/browse/YARN-3498 Project: Hadoop YARN Issue Type: Bug

[jira] [Commented] (YARN-2976) Invalid docs for specifying yarn.nodemanager.docker-container-executor.exec-name

[ https://issues.apache.org/jira/browse/YARN-2976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498389#comment-14498389 ] Vijay Bhat commented on YARN-2976: -- [~hitesh], I can take this on. Would your preference

[jira] [Updated] (YARN-3448) Add Rolling Time To Lives Level DB Plugin Capabilities

[ https://issues.apache.org/jira/browse/YARN-3448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated YARN-3448: -- Attachment: YARN-3448.10.patch Add Rolling Time To Lives Level DB Plugin Capabilities

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.3.2.patch Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498603#comment-14498603 ] Wangda Tan commented on YARN-3463: -- bq. No, applications still start as they did before,

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498773#comment-14498773 ] Yongjun Zhang commented on YARN-3021: - Thanks a lot [~jianhe]! YARN's

[jira] [Updated] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3494: -- Issue Type: Improvement (was: Bug) Expose AM resource limit and user limit in QueueMetrics

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498674#comment-14498674 ] Jian He commented on YARN-3021: --- [~yzhangal], I think the failure is not related. Patch

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.3.patch Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498752#comment-14498752 ] Xuan Gong commented on YARN-1402: - bq. if only one container (other containers haven't

[jira] [Commented] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498661#comment-14498661 ] Hadoop QA commented on YARN-3463: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3494) Expose AM resource limit and user limit in QueueMetrics

[ https://issues.apache.org/jira/browse/YARN-3494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498662#comment-14498662 ] Jian He commented on YARN-3494: --- I think AM resource usage and limit can be in the

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498760#comment-14498760 ] Inigo Goiri commented on YARN-3481: --- I started implementing this and I hit a

[jira] [Commented] (YARN-3136) getTransferredContainers can be a bottleneck during AM registration

[ https://issues.apache.org/jira/browse/YARN-3136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498524#comment-14498524 ] Hadoop QA commented on YARN-3136: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498601#comment-14498601 ] Sidharta Seethana commented on YARN-3366: - All the -1s are not valid for this

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498510#comment-14498510 ] Hadoop QA commented on YARN-3366: - {color:red}-1 overall{color}. Here are the results of

[jira] [Updated] (YARN-3463) Integrate OrderingPolicy Framework with CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-3463?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Craig Welch updated YARN-3463: -- Attachment: YARN-3463.67.patch rm unneeded capached change Integrate OrderingPolicy Framework with

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498754#comment-14498754 ] Hadoop QA commented on YARN-3493: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498528#comment-14498528 ] Naganarasimha G R commented on YARN-2740: - Thanks for the review [~wangda], bq.

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498565#comment-14498565 ] Yongjun Zhang commented on YARN-3021: - I don't see {code} java.lang.AssertionError:

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498692#comment-14498692 ] Hadoop QA commented on YARN-3366: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-1402: Attachment: YARN-1402.3.1.patch Related Web UI, CLI changes on exposing client API to check log aggregation

[jira] [Updated] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xuan Gong updated YARN-2605: Attachment: YARN-2605.1.patch [RM HA] Rest api endpoints doing redirect incorrectly

[jira] [Commented] (YARN-3487) CapacityScheduler scheduler lock obtained unnecessarily

[ https://issues.apache.org/jira/browse/YARN-3487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499038#comment-14499038 ] Wangda Tan commented on YARN-3487: -- [~sunilg], Sorry I didn't get what you meant, could

[jira] [Commented] (YARN-2696) Queue sorting in CapacityScheduler should consider node label

[ https://issues.apache.org/jira/browse/YARN-2696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499069#comment-14499069 ] Hadoop QA commented on YARN-2696: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499101#comment-14499101 ] Xuan Gong commented on YARN-1402: - bq. Also, there is one important thing we need to think

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499171#comment-14499171 ] Hadoop QA commented on YARN-1402: - {color:red}-1 overall{color}. Here are the results of

[jira] [Commented] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499142#comment-14499142 ] Jian He commented on YARN-3493: --- bq. This causes throw InvalidResourceRequestException to AM

[jira] [Commented] (YARN-2605) [RM HA] Rest api endpoints doing redirect incorrectly

[ https://issues.apache.org/jira/browse/YARN-2605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499058#comment-14499058 ] Hadoop QA commented on YARN-2605: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498992#comment-14498992 ] Wangda Tan commented on YARN-2003: -- Some comments: 1) Don't need to change

[jira] [Commented] (YARN-3500) Optimize ResourceManager Web loading speed

[ https://issues.apache.org/jira/browse/YARN-3500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499183#comment-14499183 ] Naganarasimha G R commented on YARN-3500: - I think by mistake submitter raised the

[jira] [Commented] (YARN-3046) [Event producers] Implement MapReduce AM writing some MR metrics to ATS

[ https://issues.apache.org/jira/browse/YARN-3046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499087#comment-14499087 ] Robert Kanter commented on YARN-3046: - LGTM +1 But let's wait on any additional

[jira] [Commented] (YARN-2003) Support to process Job priority from Submission Context in AppAttemptAddedSchedulerEvent [RM side]

[ https://issues.apache.org/jira/browse/YARN-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499009#comment-14499009 ] Wangda Tan commented on YARN-2003: -- Another comment is about

[jira] [Commented] (YARN-3481) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499037#comment-14499037 ] Carlo Curino commented on YARN-3481: Creating a new ResourceUtilization class, I think

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499000#comment-14499000 ] Junping Du commented on YARN-1402: -- Thanks [~xgong] for updating the patch! bq. No need to

[jira] [Commented] (YARN-3476) Nodemanager can fail to delete local logs if log aggregation fails

[ https://issues.apache.org/jira/browse/YARN-3476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498951#comment-14498951 ] Rohith commented on YARN-3476: -- Thanks [~sunilg] for sharing your thoughts. Going for

[jira] [Commented] (YARN-3390) Reuse TimelineCollectorManager for RM

[ https://issues.apache.org/jira/browse/YARN-3390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499039#comment-14499039 ] Li Lu commented on YARN-3390: - I skimmed through both patches. The two patches got significant

[jira] [Updated] (YARN-3493) RM fails to come up with error Failed to load/recover state when mem settings are changed

[ https://issues.apache.org/jira/browse/YARN-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jian He updated YARN-3493: -- Attachment: YARN-3493.3.patch RM fails to come up with error Failed to load/recover state when mem settings

[jira] [Commented] (YARN-3021) YARN's delegation-token handling disallows certain trust setups to operate properly over DistCp

[ https://issues.apache.org/jira/browse/YARN-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499160#comment-14499160 ] Hudson commented on YARN-3021: -- FAILURE: Integrated in Hadoop-trunk-Commit #7602 (See

[jira] [Commented] (YARN-3134) [Storage implementation] Exploiting the option of using Phoenix to access HBase backend

[ https://issues.apache.org/jira/browse/YARN-3134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498924#comment-14498924 ] Junping Du commented on YARN-3134: -- Thanks [~gtCarrera9] for delivering a patch here!

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498926#comment-14498926 ] Inigo Goiri commented on YARN-3482: --- After some testing, I figured that it might be

[jira] [Created] (YARN-3500) Optimize ResourceManager Web loading speed

Peter Shi created YARN-3500: --- Summary: Optimize ResourceManager Web loading speed Key: YARN-3500 URL: https://issues.apache.org/jira/browse/YARN-3500 Project: Hadoop YARN Issue Type: Improvement

[jira] [Commented] (YARN-2740) ResourceManager side should properly handle node label modifications when distributed node label configuration enabled

[ https://issues.apache.org/jira/browse/YARN-2740?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14499033#comment-14499033 ] Wangda Tan commented on YARN-2740: -- Thanks for your quick update [~Naganarasimha]. bq.

[jira] [Commented] (YARN-1402) Related Web UI, CLI changes on exposing client API to check log aggregation status

[ https://issues.apache.org/jira/browse/YARN-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14498946#comment-14498946 ] Hadoop QA commented on YARN-1402: - {color:green}+1 overall{color}. Here are the results of

  1   2   >