[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16148986#comment-16148986 ] Sunil G commented on YARN-7071: --- Looks fine for me. cc [~akhilpb] for a quick review. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: dropdown updated screenshot.png, Screen Shot 2017-08-29 > at 7.42.26 PM.png, YARN-7071.001.patch, YARN-7071.002.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16146473#comment-16146473 ] Sunil G commented on YARN-7071: --- Yes [~templedf] and [~leftnoteasy]. Definitely added metrics for containers are helpful clearly in some cases. So I am perfectly fine for this. Thanks for clearing my doubts. Also thanks [~ayousufi], latest changes seems fine. Positioning seems better. I will test and update my feedback, > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: dropdown updated screenshot.png, Screen Shot 2017-08-29 > at 7.42.26 PM.png, YARN-7071.001.patch, YARN-7071.002.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145973#comment-16145973 ] Hadoop QA commented on YARN-7071: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 14s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} trunk Compile Tests {color} || || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 26s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 0m 56s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Image:yetus/hadoop:14b5c93 | | JIRA Issue | YARN-7071 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12884322/YARN-7071.002.patch | | Optional Tests | asflicense | | uname | Linux dacb01d850eb 3.13.0-119-generic #166-Ubuntu SMP Wed May 3 12:18:55 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh | | git revision | trunk / 63fc1b0 | | modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/17186/console | | Powered by | Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org | This message was automatically generated. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: dropdown updated screenshot.png, Screen Shot 2017-08-29 > at 7.42.26 PM.png, YARN-7071.001.patch, YARN-7071.002.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145766#comment-16145766 ] Wangda Tan commented on YARN-7071: -- Thanks [~ayousufi] for working on this patch, it is super useful! Regarding to #containers, I'm agree with [~templedf] that adding this information doesn't hurt, it might be useful to users in some cases. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Sub-task > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: Screen Shot 2017-08-29 at 7.42.26 PM.png, > YARN-7071.001.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145728#comment-16145728 ] Daniel Templeton commented on YARN-7071: You are entirely correct, but what I've seen is that the vast majority of containers are the same: 1GB, 1 vcore. Even when they're not, it still doesn't hurt to have the information. Especially when the other two views show CPU and memory, so user's can get a more absolute picture. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: Screen Shot 2017-08-29 at 7.42.26 PM.png, > YARN-7071.001.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145724#comment-16145724 ] Sunil G commented on YARN-7071: --- Yes, I also have a secondary doubt. Usually we ll have heterogeneous load of containers with respect to resource . So one container in a node may be equal to many container in some other. In a cluster where all containers are similar, this will be really helpful. I think having this option to support this second scenario is also fine, but may not give a clear indication to node distribution in all cases. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: Screen Shot 2017-08-29 at 7.42.26 PM.png, > YARN-7071.001.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145653#comment-16145653 ] Daniel Templeton commented on YARN-7071: My use case is to know how evenly containers are distributed across the nodes. Especially with node labels that seems a useful thing to be able to examine. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: Screen Shot 2017-08-29 at 7.42.26 PM.png, > YARN-7071.001.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16145359#comment-16145359 ] Sunil G commented on YARN-7071: --- Few comments: # {{cpuLabel: "CPU"}} could be "VCores" # I am still not sure why no: of containers will help in terms of node heat. (Usually cost of resources indicate a better picture). Any specific reasons? # I think position of drop down is not very neat. Attaching screen shot. I think you can place this in same line as of the search box. And this drop down can have a bit more width, now it looks very packed. Other than this change looks fine to me. Attaching a screen shot as well. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: YARN-7071.001.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org
[jira] [Commented] (YARN-7071) Add vcores and number of containers in web UI v2 node heat map
[ https://issues.apache.org/jira/browse/YARN-7071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16144624#comment-16144624 ] Hadoop QA commented on YARN-7071: - | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote || Subsystem || Runtime || Comment || | {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m 21s{color} | {color:blue} Docker mode activated. {color} | || || || || {color:brown} Prechecks {color} || | {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} | || || || || {color:brown} trunk Compile Tests {color} || || || || || {color:brown} Patch Compile Tests {color} || | {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} | || || || || {color:brown} Other Tests {color} || | {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 18s{color} | {color:green} The patch does not generate ASF License warnings. {color} | | {color:black}{color} | {color:black} {color} | {color:black} 1m 0s{color} | {color:black} {color} | \\ \\ || Subsystem || Report/Notes || | Docker | Image:yetus/hadoop:14b5c93 | | JIRA Issue | YARN-7071 | | JIRA Patch URL | https://issues.apache.org/jira/secure/attachment/12884159/YARN-7071.001.patch | | Optional Tests | asflicense | | uname | Linux ca227e684984 3.13.0-116-generic #163-Ubuntu SMP Fri Mar 31 14:13:22 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh | | git revision | trunk / a1e3f84 | | modules | C: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui U: hadoop-yarn-project/hadoop-yarn/hadoop-yarn-ui | | Console output | https://builds.apache.org/job/PreCommit-YARN-Build/17171/console | | Powered by | Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org | This message was automatically generated. > Add vcores and number of containers in web UI v2 node heat map > -- > > Key: YARN-7071 > URL: https://issues.apache.org/jira/browse/YARN-7071 > Project: Hadoop YARN > Issue Type: Improvement > Components: yarn-ui-v2 >Affects Versions: 3.0.0-alpha4 >Reporter: Abdullah Yousufi >Assignee: Abdullah Yousufi > Attachments: YARN-7071.001.patch > > > Currently, the node heat map displays memory usage per node. This change > would add a dropdown to view cpu vcores or number of containers as well. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: yarn-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: yarn-issues-h...@hadoop.apache.org