[jira] [Updated] (YARN-6451) Add RM monitor validating metrics invariants

2017-04-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-6451: Summary: Add RM monitor validating metrics invariants (was: Create a monitor to check whether we mai

[jira] [Updated] (YARN-6451) Add RM monitor validating metrics invariants

2017-04-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-6451: Issue Type: New Feature (was: Bug) > Add RM monitor validating metrics invariants >

[jira] [Updated] (YARN-4476) Matcher for complex node label expresions

2017-05-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-4476: Attachment: YARN-4476.004.patch > Matcher for complex node label expresions > ---

[jira] [Updated] (YARN-6577) Remove unused ContainerLocalization classes

2017-05-17 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-6577: Summary: Remove unused ContainerLocalization classes (was: Useless interface and implementation clas

[jira] [Updated] (YARN-4476) Matcher for complex node label expresions

2017-05-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-4476: Attachment: YARN-4476.005.patch > Matcher for complex node label expresions > ---

[jira] [Updated] (YARN-4476) Matcher for complex node label expresions

2017-05-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-4476: Attachment: YARN-4476.005.patch > Matcher for complex node label expresions > ---

[jira] [Updated] (YARN-4476) Matcher for complex node label expresions

2017-05-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-4476: Attachment: (was: YARN-4476.005.patch) > Matcher for complex node label expresions >

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-05-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16017799#comment-16017799 ] Chris Douglas commented on YARN-6622: - Including an explanation of the risks and/or poi

[jira] [Commented] (YARN-1471) The SLS simulator is not running the preemption policy for CapacityScheduler

2017-05-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16023876#comment-16023876 ] Chris Douglas commented on YARN-1471: - [~curino] is this contained in YARN-6608? If so,

[jira] [Commented] (YARN-6698) Backport YARN-5121 to branch-2.7

2017-06-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16043467#comment-16043467 ] Chris Douglas commented on YARN-6698: - I just skimmed the backport and compared with YA

[jira] [Resolved] (YARN-650) User guide for preemption

2017-06-08 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved YARN-650. Resolution: Won't Fix Documentation was added in YARN-4492 > User guide for preemption >

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16161795#comment-16161795 ] Chris Douglas commented on YARN-6622: - bq. docker container is alpha feature which is g

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162090#comment-16162090 ] Chris Douglas commented on YARN-6622: - Then let's backport YARN-5258. Enabling docker s

[jira] [Commented] (YARN-6622) Document Docker work as experimental

2017-09-11 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16162173#comment-16162173 ] Chris Douglas commented on YARN-6622: - Sure, it's better than nothing. Thanks, [~temple

[jira] [Commented] (YARN-7221) Add security check for privileged docker container

2017-09-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7221?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16173864#comment-16173864 ] Chris Douglas commented on YARN-7221: - Is this a duplicate of YARN-6623? Or is it an ex

[jira] [Commented] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

2014-09-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14133406#comment-14133406 ] Chris Douglas commented on YARN-1711: - General - The public classes should be annotated

[jira] [Commented] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

2014-09-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14134718#comment-14134718 ] Chris Douglas commented on YARN-1711: - +1 Thanks for addressing the feedback on the pat

[jira] [Updated] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2014-10-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1051: Fix Version/s: (was: 3.0.0) 2.6.0 > YARN Admission Control/Planner: enhancing

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

2014-11-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2664: Assignee: Matteo Mazzucchelli > Improve RM webapp to expose info about reservations. > --

[jira] [Issue Comment Deleted] (YARN-2877) Extend YARN to support distributed scheduling

2014-11-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Comment: was deleted (was: (ignore that comment, was for YARN-2875)) > Extend YARN to support distri

[jira] [Issue Comment Deleted] (YARN-2877) Extend YARN to support distributed scheduling

2014-11-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Comment: was deleted (was: Linking to HADOOP-11317 to cover project-wide use. I don't think yarn-com

[jira] [Comment Edited] (YARN-45) Scheduler feedback to AM to release containers

2013-05-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650527#comment-13650527 ] Chris Douglas edited comment on YARN-45 at 5/7/13 6:20 AM: --- bq. Wou

[jira] [Created] (YARN-650) User guide for preemption

2013-05-06 Thread Chris Douglas (JIRA)
Chris Douglas created YARN-650: -- Summary: User guide for preemption Key: YARN-650 URL: https://issues.apache.org/jira/browse/YARN-650 Project: Hadoop YARN Issue Type: Task Components:

[jira] [Updated] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

2013-05-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-567: --- Attachment: (was: YARN-567-1.patch) > RM changes to support preemption for FairScheduler and Ca

[jira] [Updated] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

2013-05-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-567: --- Attachment: YARN-567-1.patch > RM changes to support preemption for FairScheduler and CapacitySched

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

2013-05-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-568: --- Attachment: YARN-568-1.patch > FairScheduler: support for work-preserving preemption > ---

[jira] [Updated] (YARN-650) User guide for preemption

2013-05-07 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-650: --- Attachment: Y650-0.patch > User guide for preemption > - > >

[jira] [Updated] (YARN-568) FairScheduler: support for work-preserving preemption

2013-05-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-568: --- Issue Type: Improvement (was: Sub-task) Parent: (was: YARN-397) > FairScheduler: suppo

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

2013-05-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13653234#comment-13653234 ] Chris Douglas commented on YARN-568: +1 I committed this. Thanks Carlo and Sandy

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

2013-05-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661793#comment-13661793 ] Chris Douglas commented on YARN-568: bq. From the code in generatePreemptionMessage() th

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-05-31 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.3.patch > CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.4.patch Rebase after YARN-635, YARN-735, YARN-748, YARN-749. Fixed findbugs warnin

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.5.patch > CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.6.patch > CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13682571#comment-13682571 ] Chris Douglas commented on YARN-569: Thanks for the feedback; we revised the patch. We c

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13687035#comment-13687035 ] Chris Douglas commented on YARN-569: bq. Though we will probably may end up needing orde

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.8.patch > CapacityScheduler: support for preemption (using a capacity monitor)

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-18 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13687515#comment-13687515 ] Chris Douglas commented on YARN-569: Updated patch, rebased on YARN-117, etc. On configu

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.9.patch bq. One other thing to check would be if the preemption policy will use r

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.10.patch > CapacityScheduler: support for preemption (using a capacity monitor

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-06-24 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13692572#comment-13692572 ] Chris Douglas commented on YARN-569: {{TestAMAuthorization}} also fails on trunk, YARN-8

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-07-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Attachment: YARN-569.11.patch Rebase. > CapacityScheduler: support for preemption (usi

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

2013-07-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-569: --- Fix Version/s: 2.1.0-beta > CapacityScheduler: support for preemption (using a capacity monitor) >

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2014-06-09 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025401#comment-14025401 ] Chris Douglas commented on YARN-1709: - First pass: {{RLE::addInterval/removeInterval}}

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063086#comment-14063086 ] Chris Douglas commented on YARN-2297: - Are there realistic configurations where this cr

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063115#comment-14063115 ] Chris Douglas commented on YARN-2297: - I'll try asking the question differently. Does t

[jira] [Commented] (YARN-2297) Preemption can hang in corner case by not allowing any task container to proceed.

2014-07-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14063232#comment-14063232 ] Chris Douglas commented on YARN-2297: - The parameter defining the deadzone around the c

[jira] [Updated] (YARN-2297) Preemption can hang when configured ridiculously

2014-07-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2297: Summary: Preemption can hang when configured ridiculously (was: Preemption can hang in corner case

[jira] [Updated] (YARN-2297) Preemption can prevent progress in small queues

2014-07-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2297: Summary: Preemption can prevent progress in small queues (was: Preemption can hang when configured

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2424: Attachment: Y2424-1.patch Added a version with a log statement that warns on startup. [~tucu00], is

[jira] [Updated] (YARN-2424) LCE should support non-cgroups, non-secure mode

2014-08-21 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2424: Assignee: Allen Wittenauer (was: Chris Douglas) > LCE should support non-cgroups, non-secure mode >

[jira] [Commented] (YARN-2470) A high value for yarn.nodemanager.delete.debug-delay-sec causes Nodemanager to crash. Slider needs this value to be high. Setting a very high value throws an exception a

2014-08-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14115581#comment-14115581 ] Chris Douglas commented on YARN-2470: - Failing to start is the correct behavior; that t

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2014-09-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14123885#comment-14123885 ] Chris Douglas commented on YARN-1709: - Overall, the patch lgtm. Just a few minor tweaks

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

2014-09-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129038#comment-14129038 ] Chris Douglas commented on YARN-1710: - {{GreedyReservationAgent}} * Consider {{@link}}

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

2014-09-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14129041#comment-14129041 ] Chris Douglas commented on YARN-2475: - {{SimpleCapacityReplanner}} * The Clock can be i

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

2014-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131700#comment-14131700 ] Chris Douglas commented on YARN-1710: - bq. I am not memoizing findEarliestTime, as it w

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

2014-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131713#comment-14131713 ] Chris Douglas commented on YARN-2475: - +1, other than a couple very minor nits: * the n

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2014-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14131727#comment-14131727 ] Chris Douglas commented on YARN-1709: - Thanks for the updates. Just a few minor tweaks,

[jira] [Commented] (YARN-2475) ReservationSystem: replan upon capacity reduction

2014-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132210#comment-14132210 ] Chris Douglas commented on YARN-2475: - Yes, that makes sense. Just curious about the co

[jira] [Commented] (YARN-1710) Admission Control: agents to allocate reservation

2014-09-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14132466#comment-14132466 ] Chris Douglas commented on YARN-1710: - +1 lgtm. Thanks [~curino] for all the iterations

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13630893#comment-13630893 ] Chris Douglas commented on YARN-45: --- [~sandyr]: Yes, but the correct format/semantics for t

[jira] [Commented] (YARN-573) Shared data structures in Public Localizer and Private Localizer are not Thread safe.

2013-04-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13631268#comment-13631268 ] Chris Douglas commented on YARN-573: Pardon? > Shared data structures i

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-15 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13632630#comment-13632630 ] Chris Douglas commented on YARN-45: --- bq. ResourceRequest is not actionable in the sense tha

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-25 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13642163#comment-13642163 ] Chris Douglas commented on YARN-45: --- If everyone's OK with the current patch as a base, I'l

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13644626#comment-13644626 ] Chris Douglas commented on YARN-45: --- I'm also a fan of {{ResourceRequest}}, but we're not r

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

2013-04-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13644675#comment-13644675 ] Chris Douglas commented on YARN-45: --- bq. we could express the ResourceRequest as a multiple

[jira] [Updated] (YARN-2877) Extend YARN to support distributed scheduling

2014-12-19 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-2877: Assignee: Konstantinos Karanasos > Extend YARN to support distributed scheduling > --

[jira] [Commented] (YARN-3074) Nodemanager dies when localizer runner tries to write to a full disk

2015-01-20 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14284587#comment-14284587 ] Chris Douglas commented on YARN-3074: - bq. catch FSError since it will be a common and

[jira] [Commented] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14292258#comment-14292258 ] Chris Douglas commented on YARN-2718: - I share Allen's skepticism. Adding this to the C

[jira] [Resolved] (YARN-2718) Create a CompositeConatainerExecutor that combines DockerContainerExecutor and DefaultContainerExecutor

2015-01-26 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved YARN-2718. - Resolution: Duplicate Patch posted to YARN-1983; closing this > Create a CompositeConatainerExecut

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate "long lived"

2015-01-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294529#comment-14294529 ] Chris Douglas commented on YARN-1039: - Requiring accurate estimates is not realistic, b

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate "long lived"

2015-01-27 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14294613#comment-14294613 ] Chris Douglas commented on YARN-1039: - [~cwelch] YARN shouldn't understand the lifecycl

[jira] [Commented] (YARN-1039) Add parameter for YARN resource requests to indicate "long lived"

2015-01-29 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14298135#comment-14298135 ] Chris Douglas commented on YARN-1039: - bq. That's not necessarily so, there are some ca

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-02-01 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14300975#comment-14300975 ] Chris Douglas commented on YARN-1983: - As in YARN-2718: can't this be implemented as a

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306177#comment-14306177 ] Chris Douglas commented on YARN-3100: - [~aw], have you read through the patch? What it

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-04 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306738#comment-14306738 ] Chris Douglas commented on YARN-3100: - Motivation for the conversion from {{QueueACL}}

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306937#comment-14306937 ] Chris Douglas commented on YARN-3100: - bq. I'm not sure if I get your point, the Defaul

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308126#comment-14308126 ] Chris Douglas commented on YARN-3100: - bq. The reinitializeQueues looks to be transact

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-05 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308559#comment-14308559 ] Chris Douglas commented on YARN-3100: - bq. I agree with you that if construction of Q'

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14308987#comment-14308987 ] Chris Douglas commented on YARN-3100: - Looking through {{AbstractCSQueue}} and {{CSQueu

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-06 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14309909#comment-14309909 ] Chris Douglas commented on YARN-3100: - Agreed; definitely a separate JIRA. As state is

[jira] [Commented] (YARN-1983) Support heterogeneous container types at runtime on YARN

2015-02-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313831#comment-14313831 ] Chris Douglas commented on YARN-1983: - bq. We still need a way to demux the executor to

[jira] [Commented] (YARN-3100) Make YARN authorization pluggable

2015-02-10 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313843#comment-14313843 ] Chris Douglas commented on YARN-3100: - Sorry, I didn't get to the patch over the weeken

[jira] [Commented] (YARN-3177) Fix the order of the parameters in YarnConfiguration

2015-02-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318874#comment-14318874 ] Chris Douglas commented on YARN-3177: - [~brahmareddy] moving code for readability is co

[jira] [Resolved] (YARN-3192) Empty handler for exception: java.lang.InterruptedException #WebAppProxy.java and #/ResourceManager.java

2015-02-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas resolved YARN-3192. - Resolution: Not a Problem Calling {{System.exit(-1)}} is not an acceptable way to shut down the RM.

[jira] [Commented] (YARN-3192) Empty handler for exception: java.lang.InterruptedException #WebAppProxy.java and #/ResourceManager.java

2015-02-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320645#comment-14320645 ] Chris Douglas commented on YARN-3192: - bq. w.r.t the WebAppProxy path; we could change

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918548#comment-13918548 ] Chris Douglas commented on YARN-1771: - The simpler check doesn't seem to have any pract

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-03 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918625#comment-13918625 ] Chris Douglas commented on YARN-1771: - bq. Orthogonal to this we have been discussing a

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932203#comment-13932203 ] Chris Douglas commented on YARN-1771: - I just skimmed the patch, but it lgtm. The Loadi

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13932651#comment-13932651 ] Chris Douglas commented on YARN-1771: - bq. I'm also going to make changes to memoize fa

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1771: Issue Type: Improvement (was: Bug) > many getFileStatus calls made from node manager for localizing

[jira] [Updated] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1771: Fix Version/s: 2.5.0 > many getFileStatus calls made from node manager for localizing a public > di

[jira] [Commented] (YARN-1771) many getFileStatus calls made from node manager for localizing a public distributed cache resource

2014-03-14 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935310#comment-13935310 ] Chris Douglas commented on YARN-1771: - bq. It would be great if you could commit this t

[jira] [Commented] (YARN-1927) Preemption message shouldn’t be created multiple times for same container-id in ProportionalCapacityPreemptionPolicy

2014-04-12 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13967685#comment-13967685 ] Chris Douglas commented on YARN-1927: - The decision to preempt a container may be rever

[jira] [Commented] (YARN-1957) ProportionalCapacitPreemptionPolicy handling of corner cases...

2014-04-28 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13983978#comment-13983978 ] Chris Douglas commented on YARN-1957: - +1 Enforcing {{maxCapacity}} in the calculation

[jira] [Updated] (YARN-1957) ProportionalCapacitPreemptionPolicy handling of corner cases...

2014-05-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1957: Fix Version/s: 3.0.0 2.5.0 > ProportionalCapacitPreemptionPolicy handling of corn

[jira] [Updated] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1184: Attachment: Y1184-0.patch We failed to retest what looked like a harmless change YARN-569. While re

[jira] [Commented] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-13 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13767345#comment-13767345 ] Chris Douglas commented on YARN-1184: - Unless someone objects, I'll commit this sometim

[jira] [Commented] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13769067#comment-13769067 ] Chris Douglas commented on YARN-1184: - I committed this. Thanks Bikas for the review.

[jira] [Updated] (YARN-1184) ClassCastException is thrown during preemption When a huge job is submitted to a queue B whose resources is used by a job in queueA

2013-09-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated YARN-1184: Attachment: Y1184-1.patch > ClassCastException is thrown during preemption When a huge job is su

<    1   2   3   >