[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16308713#comment-16308713 ] VP commented on YARN-3348: -- When i redirect the output of yarn top to a file , it shows junk characters in the file . Normally , we have top -b which removes this data , but here in yarn top , do we have any similar options > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0, 3.0.0-alpha1 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14493632#comment-14493632 ] Allen Wittenauer commented on YARN-3348: Sorry, I've been traveling. But we need to do a follow up to fix up the shell code. I'll file a new JIRA. > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491069#comment-14491069 ] Hudson commented on YARN-3348: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2110 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2110/]) YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev (jianhe: rev 577d755e4bf72d6adedeba51be01ff5f3f028de0) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueStatisticsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/TestPBImplRecords.java * hadoop-yarn-project/hadoop-yarn/bin/yarn * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueStatistics.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueInfo.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueInfoPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractCSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/TopCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/YarnClusterMetrics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/YarnClusterMetricsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/ProtocolHATestBase.java > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14491025#comment-14491025 ] Hudson commented on YARN-3348: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #161 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/161/]) YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev (jianhe: rev 577d755e4bf72d6adedeba51be01ff5f3f028de0) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueStatisticsPBImpl.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueInfoPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueStatistics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/YarnClusterMetrics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/TopCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/TestPBImplRecords.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractCSQueue.java * hadoop-yarn-project/hadoop-yarn/bin/yarn * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueInfo.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/YarnClusterMetricsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/ProtocolHATestBase.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490974#comment-14490974 ] Hudson commented on YARN-3348: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #894 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk/894/]) YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev (jianhe: rev 577d755e4bf72d6adedeba51be01ff5f3f028de0) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/TestPBImplRecords.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueStatistics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/YarnClusterMetrics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/TopCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/ProtocolHATestBase.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractCSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/YarnClusterMetricsPBImpl.java * hadoop-yarn-project/hadoop-yarn/bin/yarn * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueInfo.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueInfoPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueStatisticsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490954#comment-14490954 ] Hudson commented on YARN-3348: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #151 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/151/]) YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev (jianhe: rev 577d755e4bf72d6adedeba51be01ff5f3f028de0) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/ProtocolHATestBase.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java * hadoop-yarn-project/hadoop-yarn/bin/yarn * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/YarnClusterMetrics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueInfoPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/TopCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueStatisticsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/TestPBImplRecords.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/YarnClusterMetricsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractCSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueInfo.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueStatistics.java > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490946#comment-14490946 ] Hudson commented on YARN-3348: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2092 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/2092/]) YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev (jianhe: rev 577d755e4bf72d6adedeba51be01ff5f3f028de0) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/TopCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractCSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/YarnClusterMetricsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueStatistics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueStatisticsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/YarnClusterMetrics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/ProtocolHATestBase.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/TestPBImplRecords.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueInfoPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueInfo.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java * hadoop-yarn-project/hadoop-yarn/bin/yarn > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14490937#comment-14490937 ] Hudson commented on YARN-3348: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #160 (See [https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/160/]) YARN-3348. Add a 'yarn top' tool to help understand cluster usage. Contributed by Varun Vasudev (jianhe: rev 577d755e4bf72d6adedeba51be01ff5f3f028de0) * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/ProtocolHATestBase.java * hadoop-yarn-project/CHANGES.txt * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/ClientRMService.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/test/java/org/apache/hadoop/yarn/api/TestPBImplRecords.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/impl/YarnClientImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/YarnClusterMetrics.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueInfo.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueStatisticsPBImpl.java * hadoop-yarn-project/hadoop-yarn/bin/yarn * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/test/java/org/apache/hadoop/yarn/client/cli/TestYarnCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/capacity/AbstractCSQueue.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/api/YarnClient.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/java/org/apache/hadoop/yarn/api/records/QueueStatistics.java * hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient/src/main/java/org/apache/hadoop/mapred/ResourceMgrDelegate.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/YarnClusterMetricsPBImpl.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api/src/main/proto/yarn_protos.proto * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client/src/main/java/org/apache/hadoop/yarn/client/cli/TopCLI.java * hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common/src/main/java/org/apache/hadoop/yarn/api/records/impl/pb/QueueInfoPBImpl.java > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Fix For: 2.8.0 > > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch, apache-yarn-3348.branch-2.0.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488206#comment-14488206
]
Hadoop QA commented on YARN-3348:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12724296/apache-yarn-3348.5.patch
against trunk revision 61dc2ea.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/7279//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7279//console
This message is automatically generated.
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch,
> apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch,
> apache-yarn-3348.5.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14488023#comment-14488023 ] Varun Vasudev commented on YARN-3348: - Uploaded a new patch that fixes a scrolling issue and makes the new method in YarnClient abstract. > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch, > apache-yarn-3348.5.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487992#comment-14487992 ] Varun Vasudev commented on YARN-3348: - Hit submit a little too soon. Deleted the patch I uploaded. > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487642#comment-14487642
]
Hadoop QA commented on YARN-3348:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12724231/apache-yarn-3348.4.patch
against trunk revision 6495940.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/7274//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7274//console
This message is automatically generated.
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch,
> apache-yarn-3348.2.patch, apache-yarn-3348.3.patch, apache-yarn-3348.4.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14487357#comment-14487357
]
Hadoop QA commented on YARN-3348:
-
{color:green}+1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12724206/apache-yarn-3348.3.patch
against trunk revision 6495940.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 3 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager.
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/7270//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7270//console
This message is automatically generated.
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch,
> apache-yarn-3348.2.patch, apache-yarn-3348.3.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14486578#comment-14486578 ] Jian He commented on YARN-3348: --- Thanks for updating, - In YarnClusterMetricsPBImpl, should the default num*NodeManagers return 0 ? - getApplications in YarnClient.java may be an abstract method? - “Queue Applications:” - if it’s aggregated number , maybe Queue(s) ? > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14485242#comment-14485242 ] Varun Vasudev commented on YARN-3348: - The last line "Moved the cache to YarnClientImpl where the hashcode doesn't show up" should be "Moved the cache to YarnClientImpl where the hashcode issue doesn't show up" > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch, > apache-yarn-3348.2.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14484548#comment-14484548
]
Jian He commented on YARN-3348:
---
Thanks Varun, some comments:
- “Unable to fetach cluster metrics” - typo
- exceeding 80 Column limit,
{code}
opts
.addOption(
"types",
true,
"Comma separated list of types to
restrict applications, case sensitive(though the display is lower case)");
{code}
- the -rows, -cols options seems not having effect on my screen when I tried
it, could you double check ?
- the ‘yarn top’ output is repeatedly showing up on terminal every $delay
seconds. it’ll be better to only show that only once.
- Does the patch only show root queue info ? should we show all queues info ?
- “F + Enter : Select sort field” ; may be use ’S’ for sorting ?
- “Memory seconds(in GBseconds” - missing “)”
- It seems a bit odd to have this method in a public API record. Do you know
why hashcode is not correct without this method ? Or we can just type cast it
to GetApplicationsRequestPBImpl and use the method from there.
{code}
// need this otherwise the hashcode doesn't get generated correctly
request.initAllFields();
{code}
- for the caching in ClientRMService. Do you think we can do the cache on
client side ? that’ll save RPCs, especially if we have many top commands
running on client side.
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483429#comment-14483429
]
Allen Wittenauer commented on YARN-3348:
{code}
+doNotSetCols=0
+doNotSetRows=0
+for i in "$@"; do
+ if [[ $i == "-cols" ]]; then
+doNotSetCols=1
+ fi
+ if [[ $i == "-rows" ]]; then
+doNotSetRows=1
+ fi
+done
+if [[ $doNotSetCols == 0 ]]; then
+ cols=`tput cols`
+ args=( $@ )
+ args=("${args[@]}" "-cols" "$cols")
+ set -- "${args[@]}"
+fi
+if [[ $doNotSetRows == 0 ]]; then
+ rows=`tput lines`
+ args=( $@ )
+ args=("${args[@]}" "-rows" "$rows")
+ set -- "${args[@]}"
+fi
{code}
* Why are we doing this manipulation here and not in the Java code?
* backticks are antiquated in modern bash. Use {{$()}} construction
* What happens if tput gives you zero or an error because you are on a
non-addressable terminal? (You can generally simulate this by unset TERM or
equivalent env var)
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483424#comment-14483424
]
Hadoop QA commented on YARN-3348:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12723653/apache-yarn-3348.1.patch
against trunk revision 19a4fea.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:red}-1 eclipse:eclipse{color}. The patch failed to build with
eclipse:eclipse.
{color:green}+1 findbugs{color}. The patch does not introduce any new
Findbugs (version 2.0.3) warnings.
{color:green}+1 release audit{color}. The applied patch does not increase
the total number of release audit warnings.
{color:green}+1 core tests{color}. The patch passed unit tests in .
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/7240//testReport/
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7240//console
This message is automatically generated.
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483377#comment-14483377 ] Varun Vasudev commented on YARN-3348: - The attached patch applies only to trunk. Once I get a +1, I'll put a version that applies to branch-2. > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[ https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483373#comment-14483373 ] Varun Vasudev commented on YARN-3348: - Sorry, that last comment should have been "The findbugs warning is from some another patch - YARN-2901." > Add a 'yarn top' tool to help understand cluster usage > -- > > Key: YARN-3348 > URL: https://issues.apache.org/jira/browse/YARN-3348 > Project: Hadoop YARN > Issue Type: Improvement > Components: resourcemanager >Reporter: Varun Vasudev >Assignee: Varun Vasudev > Attachments: apache-yarn-3348.0.patch, apache-yarn-3348.1.patch > > > It would be helpful to have a 'yarn top' tool that would allow administrators > to understand which apps are consuming resources. > Ideally the tool would allow you to filter by queue, user, maybe labels, etc > and show you statistics on container allocation across the cluster to find > out which apps are consuming the most resources on the cluster. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (YARN-3348) Add a 'yarn top' tool to help understand cluster usage
[
https://issues.apache.org/jira/browse/YARN-3348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14483281#comment-14483281
]
Hadoop QA commented on YARN-3348:
-
{color:red}-1 overall{color}. Here are the results of testing the latest
attachment
http://issues.apache.org/jira/secure/attachment/12723624/apache-yarn-3348.0.patch
against trunk revision 75c5454.
{color:green}+1 @author{color}. The patch does not contain any @author
tags.
{color:green}+1 tests included{color}. The patch appears to include 4 new
or modified test files.
{color:green}+1 javac{color}. The applied patch does not increase the
total number of javac compiler warnings.
{color:green}+1 javadoc{color}. There were no new javadoc warning messages.
{color:green}+1 eclipse:eclipse{color}. The patch built with
eclipse:eclipse.
{color:red}-1 findbugs{color}. The patch appears to introduce 2 new
Findbugs (version 2.0.3) warnings.
{color:red}-1 release audit{color}. The applied patch generated 1
release audit warnings.
{color:red}-1 core tests{color}. The patch failed these unit tests in
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-api
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-client
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-common
hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager:
org.apache.hadoop.yarn.api.TestPBImplRecords
Test results:
https://builds.apache.org/job/PreCommit-YARN-Build/7235//testReport/
Release audit warnings:
https://builds.apache.org/job/PreCommit-YARN-Build/7235//artifact/patchprocess/patchReleaseAuditProblems.txt
Findbugs warnings:
https://builds.apache.org/job/PreCommit-YARN-Build/7235//artifact/patchprocess/newPatchFindbugsWarningshadoop-yarn-common.html
Console output: https://builds.apache.org/job/PreCommit-YARN-Build/7235//console
This message is automatically generated.
> Add a 'yarn top' tool to help understand cluster usage
> --
>
> Key: YARN-3348
> URL: https://issues.apache.org/jira/browse/YARN-3348
> Project: Hadoop YARN
> Issue Type: Improvement
> Components: resourcemanager
>Reporter: Varun Vasudev
>Assignee: Varun Vasudev
> Attachments: apache-yarn-3348.0.patch
>
>
> It would be helpful to have a 'yarn top' tool that would allow administrators
> to understand which apps are consuming resources.
> Ideally the tool would allow you to filter by queue, user, maybe labels, etc
> and show you statistics on container allocation across the cluster to find
> out which apps are consuming the most resources on the cluster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
