[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15317528#comment-15317528 ] Inigo Goiri commented on YARN-5171: --- Reuse the test for distributed scheduling. > Extend

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15314962#comment-15314962 ] Inigo Goiri commented on YARN-5171: --- Regarding the checkstyle, the only one that doesn't

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.005.patch Adding finish event when completing opportunistic containers. > Extend D

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.004.patch Tackling [~asuresh] and [~kkaranasos] comments plus some style checks. >

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.003.patch Rebasing and decreasing resources. > Extend DistributedSchedulerProtocol

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: (was: YARN-5171.003.patch) > Extend DistributedSchedulerProtocol to notify RM of containe

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.003.patch Fixing compilation issues and style. > Extend DistributedSchedulerProtoc

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.002.patch Tackling [~asuresh] comments and check style. > Extend DistributedSchedu

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.001.patch Gettin {{ExecutionType}} from {{Container}}. > Extend DistributedSchedul

[jira] [Commented] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15311486#comment-15311486 ] Inigo Goiri commented on YARN-5171: --- [~kasha], I added the {{ExecutionType}} to {{RMConta

[jira] [Updated] (YARN-5171) Extend DistributedSchedulerProtocol to notify RM of containers allocated by the Node

[ https://issues.apache.org/jira/browse/YARN-5171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5171: -- Attachment: YARN-5171.000.patch First proposal. > Extend DistributedSchedulerProtocol to notify RM of co

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15258364#comment-15258364 ] Inigo Goiri commented on YARN-4808: --- I like the idea of reusing the utilization data from

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15198111#comment-15198111 ] Inigo Goiri commented on YARN-2965: --- [~rgrandl], [~srikanthkandula], any objections? > E

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15192693#comment-15192693 ] Inigo Goiri commented on YARN-4808: --- I'd say is slightly cleaner using just {{RMNode}} to

[jira] [Assigned] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-4511: - Assignee: Karthik Kambatla (was: Inigo Goiri) > Common scheduler changes supporting scheduler-spe

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15171240#comment-15171240 ] Inigo Goiri commented on YARN-4718: --- Thanks [~kasha] for the review and the commit. Are y

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15170064#comment-15170064 ] Inigo Goiri commented on YARN-2965: --- YARN-3534 already collects the resource utilization

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15168548#comment-15168548 ] Inigo Goiri commented on YARN-4718: --- The latest errors seem consistent across runs. It se

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v004.patch Removing all changes in the user side. > Rename variables in SchedulerN

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v003.patch Fixed javadocs and checkstyles > Rename variables in SchedulerNode to r

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v002.patch Taking latest changes in trunk. > Rename variables in SchedulerNode to

[jira] [Commented] (YARN-4511) Create common scheduling policy for resource over-subscription

[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15159748#comment-15159748 ] Inigo Goiri commented on YARN-4511: --- Thanks [~leftnoteasy], adding dependency on YARN-471

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v001.patch Left external webapp side as it was. Cleaning up {{SchedulerNode}}: gene

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v000.patch Done 1 and 2 from [~kasha] proposal (I may have gone a little crazy with

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155829#comment-15155829 ] Inigo Goiri commented on YARN-1011: --- [~kasha}, I think those can apply easily to {{Capaci

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155822#comment-15155822 ] Inigo Goiri commented on YARN-1011: --- Could you clarify 2.2? What would trigger this if no

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124490#comment-15124490 ] Inigo Goiri commented on YARN-4512: --- Thanks [~kasha] for working on this! > Provide a kn

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124489#comment-15124489 ] Inigo Goiri commented on YARN-1011: --- The second scheduling loop makes sense. I'd like the

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15124238#comment-15124238 ] Inigo Goiri commented on YARN-4512: --- I think we can overlook the checkstyles issues. +1 o

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120076#comment-15120076 ] Inigo Goiri commented on YARN-4512: --- +1 on v4 > Provide a knob to turn on over-allocatio

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120067#comment-15120067 ] Inigo Goiri commented on YARN-4512: --- I guess we need [~leftnoteasy] or somebody else to p

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15120065#comment-15120065 ] Inigo Goiri commented on YARN-4512: --- Findbugs error. > Provide a knob to turn on over-al

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15115711#comment-15115711 ] Inigo Goiri commented on YARN-4512: --- I'm OK with not using the {{ResourceOption}} approac

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097781#comment-15097781 ] Inigo Goiri commented on YARN-4512: --- bq. I'm not very familiar with ResourceOption, is it

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15097009#comment-15097009 ] Inigo Goiri commented on YARN-1011: --- [~kasha] can you add some examples to the doc for cl

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15096891#comment-15096891 ] Inigo Goiri commented on YARN-4512: --- I think you both guys are saying the same: (1) the N

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15094493#comment-15094493 ] Inigo Goiri commented on YARN-4512: --- 003 looks good. I would like [~leftnoteasy] to take

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15091330#comment-15091330 ] Inigo Goiri commented on YARN-4512: --- Regarding the overallocation vs oversubscription, I'

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15091190#comment-15091190 ] Inigo Goiri commented on YARN-4512: --- A couple comments on the patch: # Some places (e.g.,

[jira] [Commented] (YARN-2402) NM restart: Container recovery for Windows

[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15089833#comment-15089833 ] Inigo Goiri commented on YARN-2402: --- I temporarily assigned the patch to me to trigger Je

[jira] [Assigned] (YARN-2402) NM restart: Container recovery for Windows

[ https://issues.apache.org/jira/browse/YARN-2402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-2402: - Assignee: Inigo Goiri > NM restart: Container recovery for Windows > -

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-subscription

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072245#comment-15072245 ] Inigo Goiri commented on YARN-4512: --- Per the discussion in YARN-1011, it makes sense to a

[jira] [Commented] (YARN-4330) MiniYARNCluster prints multiple Failed to instantiate default resource calculator warning messages

[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072148#comment-15072148 ] Inigo Goiri commented on YARN-4330: --- [~ste...@apache.org], is this good to go? > MiniYAR

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072107#comment-15072107 ] Inigo Goiri commented on YARN-1011: --- The doc looks good. I have a couple questions: # Wha

[jira] [Commented] (YARN-1013) CS should watch resource utilization of containers and allocate speculative containers if appropriate

[ https://issues.apache.org/jira/browse/YARN-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15072104#comment-15072104 ] Inigo Goiri commented on YARN-1013: --- I can take this one once YARN-1015 is done. > CS sh

[jira] [Updated] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2882: -- Attachment: YARN-2882.005.patch Missing ExecutionType. > Add ExecutionType to denote if a container exec

[jira] [Updated] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2882: -- Attachment: (was: YARN-2882.005.patch) > Add ExecutionType to denote if a container execution is GUAR

[jira] [Updated] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2882: -- Attachment: (was: YARN-2882-v5.patch) > Add ExecutionType to denote if a container execution is GUARA

[jira] [Updated] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2882: -- Attachment: YARN-2882.005.patch Fixing patch. > Add ExecutionType to denote if a container execution is

[jira] [Updated] (YARN-2882) Add ExecutionType to denote if a container execution is GUARANTEED or OPPORTUNISTIC

[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2882: -- Attachment: YARN-2882-v5.patch Tackling [~kasha] comments except rollingUpgrade. > Add ExecutionType to

[jira] [Commented] (YARN-3458) CPU resource monitoring in Windows

[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067745#comment-15067745 ] Inigo Goiri commented on YARN-3458: --- [~cnauroth], thank you very much for the review! >

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Attachment: YARN-3458-9.patch Rebased to trunk. > CPU resource monitoring in Windows > -

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025583#comment-15025583 ] Inigo Goiri commented on YARN-3980: --- Thank you for taking care of this! > Plumb resource

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021397#comment-15021397 ] Inigo Goiri commented on YARN-3980: --- It looks like v9 solves the issues. Let me know if y

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v9.patch Waiting for heartbeat to propagate based on the expected value. This appor

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15021201#comment-15021201 ] Inigo Goiri commented on YARN-3980: --- Any easy place to check in the RM for the heartbeats

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v8.patch Increasing timeout to 2 seconds again because unit tests fail. > Plumb re

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v8.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v8.patch Tackling Karthik's comments. > Plumb resource-utilization info in node he

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15020804#comment-15020804 ] Inigo Goiri commented on YARN-3980: --- I'll take care of those changes. The only one we nee

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012897#comment-15012897 ] Inigo Goiri commented on YARN-3980: --- As with the previous one, the checkstyles seem a lit

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012423#comment-15012423 ] Inigo Goiri commented on YARN-3980: --- I think this unit tests cover what we wanted to test

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15005097#comment-15005097 ] Inigo Goiri commented on YARN-3980: --- We are failing miserably with the mini cluster. Do y

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15004692#comment-15004692 ] Inigo Goiri commented on YARN-3980: --- Give us a couple hours. If it's not done by today we

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v6.patch Fixed javadoc style issue. The checkstyle errors look like pedantic mode t

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v5.patch Moved ContainersUitlization to AggregatedContainersUtilization. Made volat

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v5.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v5.patch Moved ContainersUitlization to AggregatedContainersUtilization. Made volat

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v5.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14995372#comment-14995372 ] Inigo Goiri commented on YARN-3980: --- I uploaded a patch with all the changes but I'm not

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v5.patch Moved ContainersUitlization to AggregatedContainersUtilization. Made volat

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994811#comment-14994811 ] Inigo Goiri commented on YARN-3980: --- OK, I'll try it for both. > Plumb resource-utilizat

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14994805#comment-14994805 ] Inigo Goiri commented on YARN-3980: --- How does the violate thing work? Do you have any exa

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14990284#comment-14990284 ] Inigo Goiri commented on YARN-3980: --- I added the info to the FIFO and Fair schedulers. I'

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v4.patch Adding utilizaiton to FIFO and Fair scheduler. > Plumb resource-utilizati

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v3.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v3.patch Missing key > Plumb resource-utilization info in node heartbeat through t

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v3.patch Merging to trunk > Plumb resource-utilization info in node heartbeat thro

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-313: - Attachment: YARN-313-v11.patch I forgot to add the RefreshNodesResources* files. > Add Admin API for suppor

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-313: - Attachment: (was: YARN-313-v11.patch) > Add Admin API for supporting node resource configuration in comm

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-313: - Attachment: YARN-313-v11.patch RefreshResource -> RefreshNodesResources > Add Admin API for supporting node

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-313: - Attachment: YARN-313-v10.patch Tackling [~djp] comments. > Add Admin API for supporting node resource confi

[jira] [Commented] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14740323#comment-14740323 ] Inigo Goiri commented on YARN-313: -- The patch I'm going to submit more or less fixes all of

[jira] [Updated] (YARN-313) Add Admin API for supporting node resource configuration in command line

[ https://issues.apache.org/jira/browse/YARN-313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-313: - Attachment: YARN-313-v9.patch Rebase to trunk. > Add Admin API for supporting node resource configuration i

[jira] [Commented] (YARN-1012) Report NM aggregated container resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-1012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14716178#comment-14716178 ] Inigo Goiri commented on YARN-1012: --- I think this is very YARN specific. It relies on the

[jira] [Updated] (YARN-3458) CPU resource monitoring in Windows

[ https://issues.apache.org/jira/browse/YARN-3458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3458: -- Attachment: YARN-3458-8.patch Rebase > CPU resource monitoring in Windows >

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v2.patch Packing elements of RMNodeStatusEvent into NodeStatus > Plumb resource-ut

[jira] [Commented] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699046#comment-14699046 ] Inigo Goiri commented on YARN-3980: --- It would change the previous code a lot but I think

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v1.patch Fixed SLS. > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v1.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: (was: YARN-3980-v1.patch) > Plumb resource-utilization info in node heartbeat through to

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v1.patch Whitespace fix. > Plumb resource-utilization info in node heartbeat throu

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v1.patch Fixing broken unit tests. > Plumb resource-utilization info in node heart

[jira] [Updated] (YARN-3980) Plumb resource-utilization info in node heartbeat through to the scheduler

[ https://issues.apache.org/jira/browse/YARN-3980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3980: -- Attachment: YARN-3980-v0.patch First version missing unit test based on MiniYARNCluster (WIP). > Plumb r

[jira] [Updated] (YARN-4055) Report node resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4055: -- Attachment: YARN-4055-v1.patch Changing type for node resource monitor in Node Manager. > Report node re

[jira] [Updated] (YARN-4055) Report node resource utilization in heartbeat

[ https://issues.apache.org/jira/browse/YARN-4055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4055: -- Attachment: YARN-4055-v0.patch First version for sending the node resource utilization in the heartbeat.

[jira] [Created] (YARN-4055) Report node resource utilization in heartbeat

Inigo Goiri created YARN-4055: - Summary: Report node resource utilization in heartbeat Key: YARN-4055 URL: https://issues.apache.org/jira/browse/YARN-4055 Project: Hadoop YARN Issue Type: Improve

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698806#comment-14698806 ] Inigo Goiri commented on YARN-3534: --- Thank you [~kasha] for taking care of the review and

[jira] [Commented] (YARN-3534) Collect memory/cpu usage on the node

[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698419#comment-14698419 ] Inigo Goiri commented on YARN-3534: --- I uploaded 17 twice instead of 18... sorry. > Colle

[jira] [Updated] (YARN-3534) Collect memory/cpu usage on the node

[ https://issues.apache.org/jira/browse/YARN-3534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-3534: -- Attachment: YARN-3534-18.patch Fixed xml defaults. > Collect memory/cpu usage on the node >

<    1   2   3   4   >