[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198204#comment-15198204 ] Srikanth Kandula commented on YARN-2965: Go for it :-) We have some dummy code tha

[jira] [Commented] (YARN-3366) Outbound network bandwidth : classify/shape traffic originating from YARN containers

[ https://issues.apache.org/jira/browse/YARN-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14571821#comment-14571821 ] Srikanth Kandula commented on YARN-3366: 1) Does this also capture the network usag

[jira] [Commented] (YARN-3819) Collect network usage on the node

[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14590587#comment-14590587 ] Srikanth Kandula commented on YARN-3819: [~grey] The patch does have the generic co

[jira] [Commented] (YARN-3819) Collect network usage on the node

[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605861#comment-14605861 ] Srikanth Kandula commented on YARN-3819: [~aw] Allen- Could you expand a bit? Speci

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605862#comment-14605862 ] Srikanth Kandula commented on YARN-3820: Similar discussion ongoing at YARN-3819.

[jira] [Commented] (YARN-3819) Collect network usage on the node

[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605917#comment-14605917 ] Srikanth Kandula commented on YARN-3819: >From [~chris.douglas] "@Allen Wittenauer

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14605915#comment-14605915 ] Srikanth Kandula commented on YARN-3820: Copied [~chris.douglas] comment to 3820 as

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14606275#comment-14606275 ] Srikanth Kandula commented on YARN-3820: Quick profile: the call to read /proc take

[jira] [Created] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}

Srikanth Kandula created YARN-4056: -- Summary: Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities} Key: YARN-4056 URL: https://issues.apache.org/jira/browse/YARN-40

[jira] [Updated] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}

[ https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Kandula updated YARN-4056: --- Description: More than one container is allocated on many NM heartbeats. Yet, the current sche

[jira] [Updated] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}

[ https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Kandula updated YARN-4056: --- Attachment: bundling.docx > Bundling: Searching for multiple containers in a single pass over {

[jira] [Updated] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}

[ https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Kandula updated YARN-4056: --- Description: More than one container is allocated on many NM heartbeats. Yet, the current sche

[jira] [Commented] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}

[ https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698925#comment-14698925 ] Srikanth Kandula commented on YARN-4056: Will look. Possibly. However, this arch al

[jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class

[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14715991#comment-14715991 ] Srikanth Kandula commented on YARN-4081: Extending to multiple resources is great,

[jira] [Commented] (YARN-2745) Extend YARN to support multi-resource packing of tasks

[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716019#comment-14716019 ] Srikanth Kandula commented on YARN-2745: Just a brief update on this JIRA... 1) [

[jira] [Commented] (YARN-2745) Extend YARN to support multi-resource packing of tasks

[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716021#comment-14716021 ] Srikanth Kandula commented on YARN-2745: [~vinodkv] Thanks for the related. The eff

[jira] [Commented] (YARN-2745) Extend YARN to support multi-resource packing of tasks

[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716023#comment-14716023 ] Srikanth Kandula commented on YARN-2745: [~aw] Done by [~chris.douglas]! > Extend

[jira] [Commented] (YARN-1012) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716029#comment-14716029 ] Srikanth Kandula commented on YARN-1012: [~elgoiri], [~kasha] Could you comment on

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716031#comment-14716031 ] Srikanth Kandula commented on YARN-3534: [~elgoiri], [~kasha], could you comment on

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716032#comment-14716032 ] Srikanth Kandula commented on YARN-3980: +1 this would be very useful to have... Wi

[jira] [Commented] (YARN-1011) [Umbrella] RM should dynamically schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716034#comment-14716034 ] Srikanth Kandula commented on YARN-1011: This is a great idea. Is there an ETA for

[jira] [Created] (YARN-4088) RM should be able to process heartbeats from NM asynchronously

Srikanth Kandula created YARN-4088: -- Summary: RM should be able to process heartbeats from NM asynchronously Key: YARN-4088 URL: https://issues.apache.org/jira/browse/YARN-4088 Project: Hadoop YARN

[jira] [Commented] (YARN-1011) [Umbrella] RM should dynamically schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716062#comment-14716062 ] Srikanth Kandula commented on YARN-1011: +1 > [Umbrella] RM should dynamically sc

[jira] [Commented] (YARN-4056) Bundling: Searching for multiple containers in a single pass over {queues, applications, priorities}

[ https://issues.apache.org/jira/browse/YARN-4056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717267#comment-14717267 ] Srikanth Kandula commented on YARN-4056: I looked. Sort of similar but not really.

[jira] [Commented] (YARN-4081) Add support for multiple resource types in the Resource class

[ https://issues.apache.org/jira/browse/YARN-4081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717294#comment-14717294 ] Srikanth Kandula commented on YARN-4081: Ease of expression is a great thing to hav

[jira] [Commented] (YARN-1012) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717317#comment-14717317 ] Srikanth Kandula commented on YARN-1012: Ack. Will do. > Report NM aggregated cont

[jira] [Commented] (YARN-4088) RM should be able to process heartbeats from NM asynchronously

[ https://issues.apache.org/jira/browse/YARN-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717798#comment-14717798 ] Srikanth Kandula commented on YARN-4088: Yes, concurrently. Your suggestion is a

[jira] [Commented] (YARN-4088) RM should be able to process heartbeats from NM asynchronously

[ https://issues.apache.org/jira/browse/YARN-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14717887#comment-14717887 ] Srikanth Kandula commented on YARN-4088: See the problem with slower heartbeats is

[jira] [Commented] (YARN-4088) RM should be able to process heartbeats from NM asynchronously

[ https://issues.apache.org/jira/browse/YARN-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14727761#comment-14727761 ] Srikanth Kandula commented on YARN-4088: True. a) Not sure if this (out-of-band hea

[jira] [Updated] (YARN-4088) RM should be able to process heartbeats from NM concurrently

[ https://issues.apache.org/jira/browse/YARN-4088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Kandula updated YARN-4088: --- Summary: RM should be able to process heartbeats from NM concurrently (was: RM should be able

[jira] [Commented] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212586#comment-14212586 ] Srikanth Kandula commented on YARN-2745: Thanks Karthik, that is an interesting tho

[jira] [Commented] (YARN-2745) YARN new pluggable scheduler which does multi-resource packing

[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14215720#comment-14215720 ] Srikanth Kandula commented on YARN-2745: Thanks Wangda. Re: Yarn-314, that would b

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth Kandula updated YARN-2965: --- Summary: Enhance Node Managers to monitor and report the resource usage on machines (was: Enha

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248513#comment-14248513 ] Srikanth Kandula commented on YARN-2965: [~kasha]. Thanks. Yes re: config. Agree re

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248517#comment-14248517 ] Srikanth Kandula commented on YARN-2965: [~peng.zhang] Thanks. Yes, that would be q

[jira] [Commented] (YARN-2966) Extend ask request to include additional fields

[ https://issues.apache.org/jira/browse/YARN-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248524#comment-14248524 ] Srikanth Kandula commented on YARN-2966: Thanks [~kasha] [~varun_saxena], we do hav

[jira] [Commented] (YARN-2745) Extend YARN to support multi-resource packing of tasks

[ https://issues.apache.org/jira/browse/YARN-2745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14248528#comment-14248528 ] Srikanth Kandula commented on YARN-2745: Thanks [~jira.shegalov], do the proposed m

[jira] [Commented] (YARN-1434) Single Job can affect fairshare of others

[ https://issues.apache.org/jira/browse/YARN-1434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13830129#comment-13830129 ] Srikanth Kandula commented on YARN-1434: Sandy Ryza, I get it up to the "receive t