[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097009#comment-15097009 ] Inigo Goiri commented on YARN-1011: --- [~kasha] can you add some examples to the doc for clarification?

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15097781#comment-15097781 ] Inigo Goiri commented on YARN-4512: --- bq. I'm not very familiar with ResourceOption, is it only used by

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124489#comment-15124489 ] Inigo Goiri commented on YARN-1011: --- The second scheduling loop makes sense. I'd like the design doc to

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124490#comment-15124490 ] Inigo Goiri commented on YARN-4512: --- Thanks [~kasha] for working on this! > Provide a knob to turn on

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120065#comment-15120065 ] Inigo Goiri commented on YARN-4512: --- Findbugs error. > Provide a knob to turn on over-allocation >

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120076#comment-15120076 ] Inigo Goiri commented on YARN-4512: --- +1 on v4 > Provide a knob to turn on over-allocation >

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15120067#comment-15120067 ] Inigo Goiri commented on YARN-4512: --- I guess we need [~leftnoteasy] or somebody else to push that one

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15124238#comment-15124238 ] Inigo Goiri commented on YARN-4512: --- I think we can overlook the checkstyles issues. +1 on v5. > Provide

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v000.patch Done 1 and 2 from [~kasha] proposal (I may have gone a little crazy

[jira] [Commented] (YARN-4511) Create common scheduling policy for resource over-subscription

[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15159748#comment-15159748 ] Inigo Goiri commented on YARN-4511: --- Thanks [~leftnoteasy], adding dependency on YARN-4718 and once

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15168548#comment-15168548 ] Inigo Goiri commented on YARN-4718: --- The latest errors seem consistent across runs. It seems related to

[jira] [Commented] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15171240#comment-15171240 ] Inigo Goiri commented on YARN-4718: --- Thanks [~kasha] for the review and the commit. Are you moving going

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v003.patch Fixed javadocs and checkstyles > Rename variables in SchedulerNode to

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v002.patch Taking latest changes in trunk. > Rename variables in SchedulerNode to

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15170064#comment-15170064 ] Inigo Goiri commented on YARN-2965: --- YARN-3534 already collects the resource utilization in the NM and

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v001.patch Left external webapp side as it was. Cleaning up {{SchedulerNode}}:

[jira] [Updated] (YARN-4718) Rename variables in SchedulerNode to reduce ambiguity post YARN-1011

[ https://issues.apache.org/jira/browse/YARN-4718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-4718: -- Attachment: YARN-4718-v004.patch Removing all changes in the user side. > Rename variables in

[jira] [Commented] (YARN-4512) Provide a knob to turn on over-allocation

[ https://issues.apache.org/jira/browse/YARN-4512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15115711#comment-15115711 ] Inigo Goiri commented on YARN-4512: --- I'm OK with not using the {{ResourceOption}} approach itself. I'm

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155822#comment-15155822 ] Inigo Goiri commented on YARN-1011: --- Could you clarify 2.2? What would trigger this if not

[jira] [Commented] (YARN-1011) [Umbrella] Schedule containers based on utilization of currently allocated containers

[ https://issues.apache.org/jira/browse/YARN-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15155829#comment-15155829 ] Inigo Goiri commented on YARN-1011: --- [~kasha}, I think those can apply easily to {{CapacityScheduler}}.

[jira] [Assigned] (YARN-4511) Common scheduler changes supporting scheduler-specific implementations

[ https://issues.apache.org/jira/browse/YARN-4511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-4511: - Assignee: Karthik Kambatla (was: Inigo Goiri) > Common scheduler changes supporting

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15192693#comment-15192693 ] Inigo Goiri commented on YARN-4808: --- I'd say is slightly cleaner using just {{RMNode}} to hold

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15198111#comment-15198111 ] Inigo Goiri commented on YARN-2965: --- [~rgrandl], [~srikanthkandula], any objections? > Enhance Node

[jira] [Commented] (YARN-4808) SchedulerNode can use a few more cosmetic changes

[ https://issues.apache.org/jira/browse/YARN-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15258364#comment-15258364 ] Inigo Goiri commented on YARN-4808: --- I like the idea of reusing the utilization data from {{RMNode}}; I

[jira] [Commented] (YARN-5356) ResourceUtilization should also include resource availability

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373830#comment-15373830 ] Inigo Goiri commented on YARN-5356: --- It looks like there is some work we may want to leverage in

[jira] [Commented] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15378465#comment-15378465 ] Inigo Goiri commented on YARN-2965: --- The failed unit test seems unrelated and the checkstyle issues are

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2664: -- Attachment: YARN-2664.14.patch Jenkins fixes. > Improve RM webapp to expose info about reservations. >

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2664: -- Attachment: YARN-2664.17.patch Fixed unit test. > Improve RM webapp to expose info about reservations.

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15390204#comment-15390204 ] Inigo Goiri commented on YARN-2664: --- Other than the javadoc issue which I'm not sure how to fix and the

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2664: -- Attachment: YARN-2664.15.patch Went too crazy with the finals. > Improve RM webapp to expose info about

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2664: -- Attachment: YARN-2664.16.patch Fixing findbugs. I don't think I can solve the rest. > Improve RM

[jira] [Created] (YARN-5473) Expose over-allocation in the Resource Manager UI

Inigo Goiri created YARN-5473: - Summary: Expose over-allocation in the Resource Manager UI Key: YARN-5473 URL: https://issues.apache.org/jira/browse/YARN-5473 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-5356) ResourceUtilization should also include resource availability

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.000.patch First proposal for sending physical resources in the node to the RM. >

[jira] [Assigned] (YARN-5356) ResourceUtilization should also include resource availability

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-5356: - Assignee: Inigo Goiri > ResourceUtilization should also include resource availability >

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.002.patch Fixed compilation issue and checkstyle. > NodeManager should

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2664: -- Attachment: YARN-2664.13.patch Fixing checkstyles and jenkins errors. > Improve RM webapp to expose

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.001.patch Renaming to physical resources and adding to RMNode. > NodeManager

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15383189#comment-15383189 ] Inigo Goiri commented on YARN-5356: --- I agree on getting more people to check this approach, [~kasha],

[jira] [Commented] (YARN-5356) ResourceUtilization should also include resource availability

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15373186#comment-15373186 ] Inigo Goiri commented on YARN-5356: --- [~nroberts], I think that changing machine resources it's not that

[jira] [Comment Edited] (YARN-5356) ResourceUtilization should also include resource availability

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371947#comment-15371947 ] Inigo Goiri edited comment on YARN-5356 at 7/12/16 12:15 AM: - In general, we

[jira] [Commented] (YARN-5356) ResourceUtilization should also include resource availability

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371947#comment-15371947 ] Inigo Goiri commented on YARN-5356: --- In general, we have 3 values: * Actual resources of the full

[jira] [Commented] (YARN-5179) Issue of CPU usage of containers

[ https://issues.apache.org/jira/browse/YARN-5179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15371957#comment-15371957 ] Inigo Goiri commented on YARN-5179: --- [~asuresh], given that YARN-5117 acknowledges that there is a

[jira] [Assigned] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-2965: - Assignee: Inigo Goiri (was: Robert Grandl) > Enhance Node Managers to monitor and report the

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2965: -- Attachment: YARN-2965.000.patch First proposal to report disk and network utilizations to the RM.

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365259#comment-15365259 ] Inigo Goiri commented on YARN-5215: --- In our internal deployment, we always reserve a buffer for the

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15365512#comment-15365512 ] Inigo Goiri commented on YARN-5215: --- [~kasha], for the node utilization, in Windows it's pretty fast and

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2965: -- Attachment: YARN-2965.002.patch Fixed checkstyle and unit tests. > Enhance Node Managers to monitor and

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2965: -- Attachment: (was: YARN-2965.002.patch) > Enhance Node Managers to monitor and report the resource

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2965: -- Attachment: YARN-2965.002.patch Compilation issue. > Enhance Node Managers to monitor and report the

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2965: -- Attachment: YARN-2965.001.patch Fixing Jenkins issues and adding ResourceTimeTracker for resources. >

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2664: -- Attachment: YARN-2664.12.patch Rebased patch. > Improve RM webapp to expose info about reservations. >

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.004.patch Fixing compilation. > NodeManager should communicate physical resource

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505089#comment-15505089 ] Inigo Goiri commented on YARN-5356: --- True, this is not done properly. I need to add a unit test for the

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.002.patch Fixing NPE in PB for physical resources. > NodeManager should

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.003.patch Fixing NPE in PB. > NodeManager should communicate physical resource

[jira] [Updated] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5548: -- Labels: oct16-easy (was: ) > Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart >

[jira] [Updated] (YARN-5428) Allow for specifying the docker client configuration directory

[ https://issues.apache.org/jira/browse/YARN-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5428: -- Labels: oct16-medium (was: ) > Allow for specifying the docker client configuration directory >

[jira] [Updated] (YARN-5215) Scheduling containers based on external load in the servers

[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5215: -- Attachment: YARN-5215.002.patch Rebased to trunk. > Scheduling containers based on external load in the

[jira] [Commented] (YARN-5268) DShell AM fails java.lang.InterruptedException

[ https://issues.apache.org/jira/browse/YARN-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612754#comment-15612754 ] Inigo Goiri commented on YARN-5268: --- I would make the comment in {{shouldExit()}} as a javadoc for the

[jira] [Commented] (YARN-5548) Random test failure TestRMRestart#testFinishedAppRemovalAfterRMRestart

[ https://issues.apache.org/jira/browse/YARN-5548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612878#comment-15612878 ] Inigo Goiri commented on YARN-5548: --- It may solve this issue. > Random test failure

[jira] [Updated] (YARN-2965) Enhance Node Managers to monitor and report the resource usage on machines

[ https://issues.apache.org/jira/browse/YARN-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-2965: -- Attachment: YARN-2965.003.patch Rebasing to latest trunk. > Enhance Node Managers to monitor and report

[jira] [Updated] (YARN-5366) Add support for toggling the removal of completed and failed docker containers

[ https://issues.apache.org/jira/browse/YARN-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5366: -- Labels: oct16-medium (was: ) > Add support for toggling the removal of completed and failed docker

[jira] [Updated] (YARN-5268) DShell AM fails java.lang.InterruptedException

[ https://issues.apache.org/jira/browse/YARN-5268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5268: -- Labels: oct16-easy (was: ) > DShell AM fails java.lang.InterruptedException >

[jira] [Assigned] (YARN-5215) Scheduling containers based on external load in the servers

[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri reassigned YARN-5215: - Assignee: Inigo Goiri > Scheduling containers based on external load in the servers >

[jira] [Commented] (YARN-5259) Add two metrics at FSOpDurations for doing container assign and completed Performance statistical analysis

[ https://issues.apache.org/jira/browse/YARN-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613115#comment-15613115 ] Inigo Goiri commented on YARN-5259: --- If you want to push it today, I can rebase and fix the typo in the

[jira] [Commented] (YARN-5259) Add two metrics at FSOpDurations for doing container assign and completed Performance statistical analysis

[ https://issues.apache.org/jira/browse/YARN-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613521#comment-15613521 ] Inigo Goiri commented on YARN-5259: --- [~chenfolin], I'm rebasing this and fixing the {{monotonicNow()}}.

[jira] [Updated] (YARN-5259) Add two metrics at FSOpDurations for doing container assign and completed Performance statistical analysis

[ https://issues.apache.org/jira/browse/YARN-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5259: -- Attachment: YARN-5259-004.patch Rebased to trunk and minor fixes. > Add two metrics at FSOpDurations

[jira] [Commented] (YARN-5259) Add two metrics at FSOpDurations for doing container assign and completed Performance statistical analysis

[ https://issues.apache.org/jira/browse/YARN-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613649#comment-15613649 ] Inigo Goiri commented on YARN-5259: --- [~templedf], I checked and there are no other unit tests for related

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.011.patch Fixing ResourceCalculatorPlugin configs. > NodeManager should

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592467#comment-15592467 ] Inigo Goiri commented on YARN-5356: --- Makes sense. Not sure what to do in this case though: # Leave

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15592776#comment-15592776 ] Inigo Goiri commented on YARN-5356: --- OK, that makes sense too. Let me switch to that. > NodeManager

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.006.patch Using configured capacity when physical is not available. > NodeManager

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.005.patch Fixing NullPointerException when resource calculator not available. >

[jira] [Commented] (YARN-4330) MiniYARNCluster is showing multiple Failed to instantiate default resource calculator warning messages.

[ https://issues.apache.org/jira/browse/YARN-4330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15664824#comment-15664824 ] Inigo Goiri commented on YARN-4330: --- After YARN-5356, I think that {{NodeManagerHardwareUtils}} should

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15632983#comment-15632983 ] Inigo Goiri commented on YARN-5356: --- Thanks [~jlowe] for the review. Regarding the

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.008.patch Setting ResourceCalculatorPlugin consistently for the NM and removing

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.008.patch > NodeManager should communicate physical resource capability to

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: (was: YARN-5356.008.patch) > NodeManager should communicate physical resource capability

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.009.patch > NodeManager should communicate physical resource capability to

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.010.patch Missing import. > NodeManager should communicate physical resource

[jira] [Commented] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15637216#comment-15637216 ] Inigo Goiri commented on YARN-5356: --- The failed unit test doesn't seem related to the patch. >

[jira] [Updated] (YARN-5356) NodeManager should communicate physical resource capability to ResourceManager

[ https://issues.apache.org/jira/browse/YARN-5356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-5356: -- Attachment: YARN-5356.007.patch Fixing rounding issue. > NodeManager should communicate physical

[jira] [Commented] (YARN-6840) Implement zookeeper based store for scheduler configuration updates

[ https://issues.apache.org/jira/browse/YARN-6840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111717#comment-16111717 ] Inigo Goiri commented on YARN-6840: --- [~wangda], we are already using curator for HDFS-10631 and

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-002.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: (was: YARN-6900-002.patch) > ZooKeeper based implementation of the FederationStateStore

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: (was: YARN-6900-002.patch) > ZooKeeper based implementation of the FederationStateStore

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-002.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-002.patch * Rebase to trunk * Refactored ZK utils > ZooKeeper based

[jira] [Commented] (YARN-5396) YARN large file broadcast service

[ https://issues.apache.org/jira/browse/YARN-5396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078617#comment-16078617 ] Inigo Goiri commented on YARN-5396: --- We are also interested on this and we may be able to add resources

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-YARN-2915-000.patch Proposal using curator. > ZooKeeper based implementation of

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-YARN-2915-001.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: (was: YARN-6900-YARN-2915-001.patch) > ZooKeeper based implementation of the

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-YARN-2915-001.patch > ZooKeeper based implementation of the FederationStateStore >

[jira] [Updated] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6900: -- Attachment: YARN-6900-003.patch Created {{ZKManager}}. Let me know what are the thought on the

[jira] [Updated] (YARN-6633) Backport YARN-4167 to branch 2.7

[ https://issues.apache.org/jira/browse/YARN-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6633: -- Attachment: YARN-4167-branch-2.7.patch > Backport YARN-4167 to branch 2.7 >

[jira] [Created] (YARN-6633) Backport YARN-4167 to branch 2.7

Inigo Goiri created YARN-6633: - Summary: Backport YARN-4167 to branch 2.7 Key: YARN-6633 URL: https://issues.apache.org/jira/browse/YARN-6633 Project: Hadoop YARN Issue Type: Task

[jira] [Updated] (YARN-6632) Backport YARN-3425 to branch 2.7

[ https://issues.apache.org/jira/browse/YARN-6632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Inigo Goiri updated YARN-6632: -- Attachment: YARN-3425-branch-2.7.patch > Backport YARN-3425 to branch 2.7 >

[jira] [Created] (YARN-6632) Backport YARN-3425 to branch 2.7

Inigo Goiri created YARN-6632: - Summary: Backport YARN-3425 to branch 2.7 Key: YARN-6632 URL: https://issues.apache.org/jira/browse/YARN-6632 Project: Hadoop YARN Issue Type: Task

<    1   2   3