[jira] [Commented] (YARN-314) Schedulers should allow resource requests of different sizes at the same priority and location

2015-03-10 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14356238#comment-14356238 ] Lei Guo commented on YARN-314: -- Anybody looking at this one? Maybe I can check this

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-03-10 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355891#comment-14355891 ] Lei Guo commented on YARN-3332: --- Any consideration to support plug-in for customized resource

[jira] [Commented] (YARN-3332) [Umbrella] Unified Resource Statistics Collection per node

2015-03-10 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14355923#comment-14355923 ] Lei Guo commented on YARN-3332: --- To support customized resources, a quick list about areas we

[jira] [Commented] (YARN-3482) Report NM available resources in heartbeat

2015-04-21 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14505440#comment-14505440 ] Lei Guo commented on YARN-3482: --- What's the relationship between this and 3332? They should

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-04-22 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14507332#comment-14507332 ] Lei Guo commented on YARN-1963: --- Agree with [~jlowe], integer is the base of priority, and

[jira] [Commented] (YARN-1488) Allow containers to delegate resources to another container

2015-06-23 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14597920#comment-14597920 ] Lei Guo commented on YARN-1488: --- Based on the information from [Stinger.next track |

[jira] [Commented] (YARN-3409) Add constraint node labels

2015-06-26 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14602942#comment-14602942 ] Lei Guo commented on YARN-3409: --- [~xinxianyin], topology related information could be another

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-17 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590472#comment-14590472 ] Lei Guo commented on YARN-3819: --- For multiple resource scheduling, we may have different

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-17 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14590600#comment-14590600 ] Lei Guo commented on YARN-3819: --- Thanks for the explanation. My concern is mainly about we

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605807#comment-14605807 ] Lei Guo commented on YARN-1197: --- [~mding], for the decrease flow via

[jira] [Commented] (YARN-3819) Collect network usage on the node

2015-06-29 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605953#comment-14605953 ] Lei Guo commented on YARN-3819: --- Moving the implementation into common, it may help to reduce

[jira] [Commented] (YARN-1197) Support changing resources of an allocated container

2015-06-29 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605997#comment-14605997 ] Lei Guo commented on YARN-1197: --- Agreed, this is similar to the other cases you mentioned, In

[jira] [Commented] (YARN-3881) Writing RM cluster-level metrics

2015-07-02 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14612432#comment-14612432 ] Lei Guo commented on YARN-3881: --- This is an interesting topic, assuming the timeline server

[jira] [Created] (YARN-3870) Providing raw container request information for fine scheduling

2015-06-30 Thread Lei Guo (JIRA)
Lei Guo created YARN-3870: - Summary: Providing raw container request information for fine scheduling Key: YARN-3870 URL: https://issues.apache.org/jira/browse/YARN-3870 Project: Hadoop YARN Issue

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

2015-06-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14608386#comment-14608386 ] Lei Guo commented on YARN-624: -- [~john.lil...@redpoint.net], with your use case, do you also

[jira] [Commented] (YARN-4001) normalizeHostName takes too much of execution time

2015-08-04 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14654144#comment-14654144 ] Lei Guo commented on YARN-4001: --- [~zhiguohong], can you share some number about the execution

[jira] [Commented] (YARN-1963) Support priorities across applications within the same queue

2015-07-22 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637303#comment-14637303 ] Lei Guo commented on YARN-1963: --- [~sunilg], YARN-2003 already committed, should we get the

[jira] [Commented] (YARN-3928) launch application master on specific host

2015-07-16 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14629750#comment-14629750 ] Lei Guo commented on YARN-3928: --- [~varun_saxena], I read this JIRA as a host preference

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-08 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618627#comment-14618627 ] Lei Guo commented on YARN-2915: --- Thanks [~subru] and [~curino], maybe we should also consider

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14616787#comment-14616787 ] Lei Guo commented on YARN-2915: --- Does this design also consider multiple data center case?

[jira] [Commented] (YARN-4370) Scheduler names should be case-sensitive when filtered on web page

2015-11-18 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15011238#comment-15011238 ] Lei Guo commented on YARN-4370: --- Chengbing, as you mentioned that the root cause is from bad queue name, then

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

2016-01-04 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081242#comment-15081242 ] Lei Guo commented on YARN-3870: --- I am not against to combine this JIRA and YARN-371, There is common ground

[jira] [Commented] (YARN-3870) Providing raw container request information for fine scheduling

2015-12-31 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15075991#comment-15075991 ] Lei Guo commented on YARN-3870: --- [~kasha], I am thinking whether we also need some update for the response

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2016-02-10 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15140910#comment-15140910 ] Lei Guo commented on YARN-1051: --- [~curino], for enterprise customer, the scheduling policy will be

[jira] [Commented] (YARN-4601) HA as a general YARN service to highlighted container by application.

2016-02-04 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15133145#comment-15133145 ] Lei Guo commented on YARN-4601: --- Should this be part of Slider? > HA as a general YARN service to

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-03-19 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15197925#comment-15197925 ] Lei Guo commented on YARN-3926: --- Another topic related to rm-nm protocol is constraint label. It's not a

[jira] [Commented] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-02-23 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15880655#comment-15880655 ] Lei Guo commented on YARN-6223: --- [~leftnoteasy], based on the description "YARN scheduler should account GPU

[jira] [Comment Edited] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-08-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449183#comment-15449183 ] Lei Guo edited comment on YARN-3926 at 8/30/16 2:37 PM: [~vvasudev], some thoughts

[jira] [Commented] (YARN-4793) [Umbrella] Simplified API layer for services and beyond

2016-08-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4793?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449102#comment-15449102 ] Lei Guo commented on YARN-4793: --- As this Jira targets to build a unified interface, I'd like to share some

[jira] [Commented] (YARN-3926) Extend the YARN resource model for easier resource-type management and profiles

2016-08-30 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15449183#comment-15449183 ] Lei Guo commented on YARN-3926: --- [~vvasudev], some thoughts I just commented in Yarn-4793. As this Jira

[jira] [Commented] (YARN-5683) Support specifying storage type for per-application local dirs

2016-09-28 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15529614#comment-15529614 ] Lei Guo commented on YARN-5683: --- This is related the constraint label YARN-3409, but different at detail

[jira] [Commented] (YARN-3409) Add constraint node labels

2016-12-09 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736246#comment-15736246 ] Lei Guo commented on YARN-3409: --- So far, can we all agree on the following? - Boolean type constraint is

[jira] [Commented] (YARN-5468) Scheduling of long-running applications

2017-03-16 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928256#comment-15928256 ] Lei Guo commented on YARN-5468: --- [~kkaranasos], do we have a design document? I'd like to get more details

[jira] [Commented] (YARN-6266) Extend the resource class to support ports management

2017-03-02 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15892438#comment-15892438 ] Lei Guo commented on YARN-6266: --- For this specific use case, it may more make sense to align with

[jira] [Commented] (YARN-3409) Add constraint node labels

2017-05-24 Thread Lei Guo (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023067#comment-16023067 ] Lei Guo commented on YARN-3409: --- [~templedf], we also came from HPC background, and had discussions on