[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.3.patch CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.4.patch Rebase after YARN-635, YARN-735, YARN-748, YARN-749. Fixed findbugs

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.6.patch CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13682571#comment-13682571 ] Chris Douglas commented on YARN-569: Thanks for the feedback; we revised the patch. We

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.8.patch CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13687515#comment-13687515 ] Chris Douglas commented on YARN-569: Updated patch, rebased on YARN-117, etc. On

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.9.patch bq. One other thing to check would be if the preemption policy will use

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.10.patch CapacityScheduler: support for preemption (using a capacity

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13692572#comment-13692572 ] Chris Douglas commented on YARN-569: {{TestAMAuthorization}} also fails on trunk,

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.11.patch Rebase. CapacityScheduler: support for preemption

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Fix Version/s: 2.1.0-beta CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Commented] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13769067#comment-13769067 ] Chris Douglas commented on YARN-1184: - I committed this. Thanks Bikas for the review.

[jira] [Updated] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1184: Attachment: Y1184-1.patch ClassCastException is thrown during preemption When a huge job is

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063086#comment-14063086 ] Chris Douglas commented on YARN-2297: - Are there realistic configurations where this

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063115#comment-14063115 ] Chris Douglas commented on YARN-2297: - I'll try asking the question differently. Does

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14063232#comment-14063232 ] Chris Douglas commented on YARN-2297: - The parameter defining the deadzone around the

[jira] [Updated] (YARN-2297) Preemption can hang when configured ridiculously

[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2297: Summary: Preemption can hang when configured ridiculously (was: Preemption can hang in corner case

[jira] [Updated] (YARN-2297) Preemption can prevent progress in small queues

[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2297: Summary: Preemption can prevent progress in small queues (was: Preemption can hang when configured

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2424: Attachment: Y2424-1.patch Added a version with a log statement that warns on startup. [~tucu00], is

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2424: Assignee: Allen Wittenauer (was: Chris Douglas) LCE should support non-cgroups, non-secure mode

[jira] [Commented] (YARN-2470) A high value for yarn.nodemanager.delete.debug-delay-sec causes Nodemanager to crash. Slider needs this value to be high. Setting a very high value throws an exception a

[ https://issues.apache.org/jira/browse/YARN-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14115581#comment-14115581 ] Chris Douglas commented on YARN-2470: - Failing to start is the correct behavior; that

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14123885#comment-14123885 ] Chris Douglas commented on YARN-1709: - Overall, the patch lgtm. Just a few minor

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129038#comment-14129038 ] Chris Douglas commented on YARN-1710: - {{GreedyReservationAgent}} * Consider {{@link}}

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14129041#comment-14129041 ] Chris Douglas commented on YARN-2475: - {{SimpleCapacityReplanner}} * The Clock can be

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131700#comment-14131700 ] Chris Douglas commented on YARN-1710: - bq. I am not memoizing findEarliestTime, as it

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131713#comment-14131713 ] Chris Douglas commented on YARN-2475: - +1, other than a couple very minor nits: * the

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14131727#comment-14131727 ] Chris Douglas commented on YARN-1709: - Thanks for the updates. Just a few minor tweaks,

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132210#comment-14132210 ] Chris Douglas commented on YARN-2475: - Yes, that makes sense. Just curious about the

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14132466#comment-14132466 ] Chris Douglas commented on YARN-1710: - +1 lgtm. Thanks [~curino] for all the iterations

[jira] [Commented] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

[ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14133406#comment-14133406 ] Chris Douglas commented on YARN-1711: - General - The public classes should be annotated

[jira] [Commented] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

[ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14134718#comment-14134718 ] Chris Douglas commented on YARN-1711: - +1 Thanks for addressing the feedback on the

[jira] [Updated] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1051: Fix Version/s: (was: 3.0.0) 2.6.0 YARN Admission Control/Planner: enhancing

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13630893#comment-13630893 ] Chris Douglas commented on YARN-45: --- [~sandyr]: Yes, but the correct format/semantics for

[jira] [Commented] (YARN-573) Shared data structures in Public Localizer and Private Localizer are not Thread safe.

[ https://issues.apache.org/jira/browse/YARN-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13631268#comment-13631268 ] Chris Douglas commented on YARN-573: Pardon? Shared data structures in

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13632630#comment-13632630 ] Chris Douglas commented on YARN-45: --- bq. ResourceRequest is not actionable in the sense

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13642163#comment-13642163 ] Chris Douglas commented on YARN-45: --- If everyone's OK with the current patch as a base,

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644626#comment-13644626 ] Chris Douglas commented on YARN-45: --- I'm also a fan of {{ResourceRequest}}, but we're not

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13644675#comment-13644675 ] Chris Douglas commented on YARN-45: --- bq. we could express the ResourceRequest as a multiple

[jira] [Comment Edited] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13650527#comment-13650527 ] Chris Douglas edited comment on YARN-45 at 5/7/13 6:20 AM: --- bq.

[jira] [Created] (YARN-650) User guide for preemption

Chris Douglas created YARN-650: -- Summary: User guide for preemption Key: YARN-650 URL: https://issues.apache.org/jira/browse/YARN-650 Project: Hadoop YARN Issue Type: Task Components:

[jira] [Updated] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-567: --- Attachment: (was: YARN-567-1.patch) RM changes to support preemption for FairScheduler and

[jira] [Updated] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-567: --- Attachment: YARN-567-1.patch RM changes to support preemption for FairScheduler and

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-568: --- Attachment: YARN-568-1.patch FairScheduler: support for work-preserving preemption

[jira] [Updated] (YARN-650) User guide for preemption

[ https://issues.apache.org/jira/browse/YARN-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-650: --- Attachment: Y650-0.patch User guide for preemption -

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13653234#comment-13653234 ] Chris Douglas commented on YARN-568: +1 I committed this. Thanks Carlo and Sandy

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13661793#comment-13661793 ] Chris Douglas commented on YARN-568: bq. From the code in generatePreemptionMessage()

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918548#comment-13918548 ] Chris Douglas commented on YARN-1771: - The simpler check doesn't seem to have any

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13918625#comment-13918625 ] Chris Douglas commented on YARN-1771: - bq. Orthogonal to this we have been discussing

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932203#comment-13932203 ] Chris Douglas commented on YARN-1771: - I just skimmed the patch, but it lgtm. The

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13932651#comment-13932651 ] Chris Douglas commented on YARN-1771: - bq. I'm also going to make changes to memoize

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1771: Issue Type: Improvement (was: Bug) many getFileStatus calls made from node manager for localizing

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1771: Fix Version/s: 2.5.0 many getFileStatus calls made from node manager for localizing a public

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13935310#comment-13935310 ] Chris Douglas commented on YARN-1771: - bq. It would be great if you could commit this

[jira] [Commented] (YARN-1927) Preemption message shouldn’t be created multiple times for same container-id in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967685#comment-13967685 ] Chris Douglas commented on YARN-1927: - The decision to preempt a container may be

[jira] [Commented] (YARN-1957) ProportionalCapacitPreemptionPolicy handling of corner cases...

[ https://issues.apache.org/jira/browse/YARN-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983978#comment-13983978 ] Chris Douglas commented on YARN-1957: - +1 Enforcing {{maxCapacity}} in the calculation

[jira] [Updated] (YARN-1957) ProportionalCapacitPreemptionPolicy handling of corner cases...

[ https://issues.apache.org/jira/browse/YARN-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1957: Fix Version/s: 3.0.0 2.5.0 ProportionalCapacitPreemptionPolicy handling of

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025401#comment-14025401 ] Chris Douglas commented on YARN-1709: - First pass: {{RLE::addInterval/removeInterval}}

[jira] [Commented] (YARN-1374) Resource Manager fails to start due to ConcurrentModificationException

[ https://issues.apache.org/jira/browse/YARN-1374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809874#comment-13809874 ] Chris Douglas commented on YARN-1374: - +1 lgtm Resource Manager fails to start due to

[jira] [Commented] (YARN-1324) NodeManager potentially causes unnecessary operations on all its disks

[ https://issues.apache.org/jira/browse/YARN-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13809885#comment-13809885 ] Chris Douglas commented on YARN-1324: - bq. When does MR use multiple disks in the same

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1471: Attachment: (was: YARN-1471.patch.2) The SLS simulator is not running the preemption policy

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1471: Attachment: YARN-1471.patch The SLS simulator is not running the preemption policy for

[jira] [Updated] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1471: Attachment: YARN-1471.2.patch The SLS simulator is not running the preemption policy for

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13852373#comment-13852373 ] Chris Douglas commented on YARN-1471: - I committed this. Thanks Carlo The SLS

[jira] [Created] (YARN-1518) Ensure CapacityScheduler remains compatible with SLS simulator

Chris Douglas created YARN-1518: --- Summary: Ensure CapacityScheduler remains compatible with SLS simulator Key: YARN-1518 URL: https://issues.apache.org/jira/browse/YARN-1518 Project: Hadoop YARN

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2664: Assignee: Matteo Mazzucchelli Improve RM webapp to expose info about reservations.

[jira] [Issue Comment Deleted] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Comment: was deleted (was: (ignore that comment, was for YARN-2875)) Extend YARN to support

[jira] [Issue Comment Deleted] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Comment: was deleted (was: Linking to HADOOP-11317 to cover project-wide use. I don't think

[jira] [Updated] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Assignee: Konstantinos Karanasos Extend YARN to support distributed scheduling

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14292258#comment-14292258 ] Chris Douglas commented on YARN-2718: - I share Allen's skepticism. Adding this to the

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306738#comment-14306738 ] Chris Douglas commented on YARN-3100: - Motivation for the conversion from {{QueueACL}}

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306177#comment-14306177 ] Chris Douglas commented on YARN-3100: - [~aw], have you read through the patch? What it

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308559#comment-14308559 ] Chris Douglas commented on YARN-3100: - bq. I agree with you that if construction of Q'

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14309909#comment-14309909 ] Chris Douglas commented on YARN-3100: - Agreed; definitely a separate JIRA. As state is

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308126#comment-14308126 ] Chris Douglas commented on YARN-3100: - bq. The reinitializeQueues looks to be

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14306937#comment-14306937 ] Chris Douglas commented on YARN-3100: - bq. I'm not sure if I get your point, the

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14308987#comment-14308987 ] Chris Douglas commented on YARN-3100: - Looking through {{AbstractCSQueue}} and

[jira] [Commented] (YARN-3074) Nodemanager dies when localizer runner tries to write to a full disk

[ https://issues.apache.org/jira/browse/YARN-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14284587#comment-14284587 ] Chris Douglas commented on YARN-3074: - bq. catch FSError since it will be a common and

[jira] [Commented] (YARN-3177) Fix the order of the parameters in YarnConfiguration

[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14318874#comment-14318874 ] Chris Douglas commented on YARN-3177: - [~brahmareddy] moving code for readability is

[jira] [Resolved] (YARN-3192) Empty handler for exception: java.lang.InterruptedException #WebAppProxy.java and #/ResourceManager.java

[ https://issues.apache.org/jira/browse/YARN-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved YARN-3192. - Resolution: Not a Problem Calling {{System.exit(-1)}} is not an acceptable way to shut down the

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294529#comment-14294529 ] Chris Douglas commented on YARN-1039: - Requiring accurate estimates is not realistic,

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14300975#comment-14300975 ] Chris Douglas commented on YARN-1983: - As in YARN-2718: can't this be implemented as a

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14294613#comment-14294613 ] Chris Douglas commented on YARN-1039: - [~cwelch] YARN shouldn't understand the

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313843#comment-14313843 ] Chris Douglas commented on YARN-3100: - Sorry, I didn't get to the patch over the

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14313831#comment-14313831 ] Chris Douglas commented on YARN-1983: - bq. We still need a way to demux the executor to

[jira] [Commented] (YARN-3192) Empty handler for exception: java.lang.InterruptedException #WebAppProxy.java and #/ResourceManager.java

[ https://issues.apache.org/jira/browse/YARN-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14320645#comment-14320645 ] Chris Douglas commented on YARN-3192: - bq. w.r.t the WebAppProxy path; we could change

[jira] [Updated] (YARN-3369) Missing NullPointer check in AppSchedulingInfo causes RM to die

[ https://issues.apache.org/jira/browse/YARN-3369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-3369: Description: In AppSchedulingInfo.java the method checkForDeactivation() has these 2 consecutive

[jira] [Commented] (YARN-3338) Exclude jline dependency from YARN

[ https://issues.apache.org/jira/browse/YARN-3338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14358963#comment-14358963 ] Chris Douglas commented on YARN-3338: - +1 lgtm Exclude jline dependency from YARN

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14298135#comment-14298135 ] Chris Douglas commented on YARN-1039: - bq. That's not necessarily so, there are some

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate long lived

[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14549505#comment-14549505 ] Chris Douglas commented on YARN-1039: - The semantics of a boolean flag are opaque. The

[jira] [Commented] (YARN-3806) Proposal of Generic Scheduling Framework for YARN

[ https://issues.apache.org/jira/browse/YARN-3806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598163#comment-14598163 ] Chris Douglas commented on YARN-3806: - [~wshao] Please don't delete obsoleted versions

[jira] [Commented] (YARN-3119) Memory limit check need not be enforced unless aggregate usage of all containers is near limit

[ https://issues.apache.org/jira/browse/YARN-3119?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14588429#comment-14588429 ] Chris Douglas commented on YARN-3119: - Systems that embrace more forgiving resource

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14584272#comment-14584272 ] Chris Douglas commented on YARN-1983: - (sorry for the delayed reply; missed this) bq.

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605889#comment-14605889 ] Chris Douglas commented on YARN-3820: - [~aw] Is there a corresponding part of the

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14605891#comment-14605891 ] Chris Douglas commented on YARN-3820: - Oh, didn't see YARN-3819. Will continue there.

[jira] [Commented] (YARN-3819) Collect network usage on the node

[ https://issues.apache.org/jira/browse/YARN-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606014#comment-14606014 ] Chris Douglas commented on YARN-3819: - bq. I think that if we decide to move this to

[jira] [Commented] (YARN-3820) Collect disks usages on the node

[ https://issues.apache.org/jira/browse/YARN-3820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606047#comment-14606047 ] Chris Douglas commented on YARN-3820: - I understand its function, I'm curious why it

[jira] [Commented] (YARN-3784) Indicate preemption timout along with the list of containers to AM (preemption message)

[ https://issues.apache.org/jira/browse/YARN-3784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14606205#comment-14606205 ] Chris Douglas commented on YARN-3784: - Minor: - Docs for timeout don't include units -

[jira] [Commented] (YARN-3877) YarnClientImpl.submitApplication swallows exceptions

[ https://issues.apache.org/jira/browse/YARN-3877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14627026#comment-14627026 ] Chris Douglas commented on YARN-3877: - * Not sure I understand this change: {noformat}

[jira] [Commented] (YARN-3612) Resource calculation in child tasks is CPU-heavy

[ https://issues.apache.org/jira/browse/YARN-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617391#comment-14617391 ] Chris Douglas commented on YARN-3612: - bq. Moreover, I have not added the config as I

[jira] [Updated] (YARN-666) [Umbrella] Support rolling upgrades in YARN

[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-666: --- Assignee: (was: Brook Zhou) > [Umbrella] Support rolling upgrades in YARN >

  1   2   3   >