[jira] [Updated] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

[ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1711: --- Attachment: YARN-1711.4.patch > CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1

[jira] [Updated] (YARN-1711) CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1709

[ https://issues.apache.org/jira/browse/YARN-1711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1711: --- Attachment: YARN-1711.5.patch > CapacityOverTimePolicy: a policy to enforce quotas over time for YARN-1

[jira] [Commented] (YARN-2592) Preemption can kill containers to fulfil need of already over-capacity queue.

[ https://issues.apache.org/jira/browse/YARN-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146728#comment-14146728 ] Carlo Curino commented on YARN-2592: Preemption is trying to enforce the scheduler inva

[jira] [Commented] (YARN-2592) Preemption can kill containers to fulfil need of already over-capacity queue.

[ https://issues.apache.org/jira/browse/YARN-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14146790#comment-14146790 ] Carlo Curino commented on YARN-2592: I hear you, and I agree we will need to cope with

[jira] [Commented] (YARN-2576) Prepare yarn-1051 branch for merging with trunk

[ https://issues.apache.org/jira/browse/YARN-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147105#comment-14147105 ] Carlo Curino commented on YARN-2576: Subru's comment refers to YARN-1051 branch... >

[jira] [Commented] (YARN-2576) Prepare yarn-1051 branch for merging with trunk

[ https://issues.apache.org/jira/browse/YARN-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14147118#comment-14147118 ] Carlo Curino commented on YARN-2576: +1 The patch looks ok... It fixes many syntactic

[jira] [Created] (YARN-2609) Example of use for the ReservationSystem

Carlo Curino created YARN-2609: -- Summary: Example of use for the ReservationSystem Key: YARN-2609 URL: https://issues.apache.org/jira/browse/YARN-2609 Project: Hadoop YARN Issue Type: Improvemen

[jira] [Commented] (YARN-2611) Fix jenkins findbugs warning and test case failures for trunk merge patch

[ https://issues.apache.org/jira/browse/YARN-2611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14149672#comment-14149672 ] Carlo Curino commented on YARN-2611: Minor: the equals() method for ReservationInter

[jira] [Updated] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-1051: --- Attachment: socc14-paper15.pdf Pre-camera ready version of SoCC paper. > YARN Admission Control/Planne

[jira] [Updated] (YARN-2609) Example of use for the ReservationSystem

[ https://issues.apache.org/jira/browse/YARN-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2609: --- Attachment: YARN-2609.patch > Example of use for the ReservationSystem > --

[jira] [Updated] (YARN-2609) Example of use for the ReservationSystem

[ https://issues.apache.org/jira/browse/YARN-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2609: --- Attachment: YARN-2609.docx > Example of use for the ReservationSystem > ---

[jira] [Commented] (YARN-2609) Example of use for the ReservationSystem

[ https://issues.apache.org/jira/browse/YARN-2609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14150285#comment-14150285 ] Carlo Curino commented on YARN-2609: Per [~kasha] request we provide a simple way to se

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14159040#comment-14159040 ] Carlo Curino commented on YARN-1051: Thanks Chris for committing, and most importantly

[jira] [Created] (YARN-2664) Improve RM webapp to expose info about reservations.

Carlo Curino created YARN-2664: -- Summary: Improve RM webapp to expose info about reservations. Key: YARN-2664 URL: https://issues.apache.org/jira/browse/YARN-2664 Project: Hadoop YARN Issue Type

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Attachment: YARN-2664.patch > Improve RM webapp to expose info about reservations. > --

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14164550#comment-14164550 ] Carlo Curino commented on YARN-2664: This is an "idea" of possible improvement of the

[jira] [Created] (YARN-2672) Improve Gridmix (synthetic generator + reservation support)

Carlo Curino created YARN-2672: -- Summary: Improve Gridmix (synthetic generator + reservation support) Key: YARN-2672 URL: https://issues.apache.org/jira/browse/YARN-2672 Project: Hadoop YARN Is

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Attachment: PlannerPage_screenshot.pdf > Improve RM webapp to expose info about reservations. > ---

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166000#comment-14166000 ] Carlo Curino commented on YARN-2664: Attached screenshot of first-cut visualization of

[jira] [Updated] (YARN-2672) Improve Gridmix (synthetic generator + reservation support)

[ https://issues.apache.org/jira/browse/YARN-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2672: --- Attachment: YARN-2672.patch > Improve Gridmix (synthetic generator + reservation support) > ---

[jira] [Commented] (YARN-2672) Improve Gridmix (synthetic generator + reservation support)

[ https://issues.apache.org/jira/browse/YARN-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166032#comment-14166032 ] Carlo Curino commented on YARN-2672: The patch contains: * a simple synthetic genera

[jira] [Commented] (YARN-2672) Improve Gridmix (synthetic generator + reservation support)

[ https://issues.apache.org/jira/browse/YARN-2672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166055#comment-14166055 ] Carlo Curino commented on YARN-2672: Quick how to use: I usually run it with something

[jira] [Assigned] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-2664: -- Assignee: Carlo Curino > Improve RM webapp to expose info about reservations. >

[jira] [Commented] (YARN-1990) Track time-to-allocation for different size containers

[ https://issues.apache.org/jira/browse/YARN-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166099#comment-14166099 ] Carlo Curino commented on YARN-1990: YARN-1051 is committed. If someone tries it and fi

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Assignee: (was: Carlo Curino) > Improve RM webapp to expose info about reservations. >

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Assignee: Carlo Curino > Improve RM webapp to expose info about reservations. > ---

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Assignee: (was: Carlo Curino) > Improve RM webapp to expose info about reservations. >

[jira] [Created] (YARN-2731) RegisterApplicationMasterResponsePBImpl: not properly initialized builder

Carlo Curino created YARN-2731: -- Summary: RegisterApplicationMasterResponsePBImpl: not properly initialized builder Key: YARN-2731 URL: https://issues.apache.org/jira/browse/YARN-2731 Project: Hadoop YAR

[jira] [Updated] (YARN-2731) RegisterApplicationMasterResponsePBImpl: not properly initialized builder

[ https://issues.apache.org/jira/browse/YARN-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2731: --- Attachment: YARN-2731.patch > RegisterApplicationMasterResponsePBImpl: not properly initialized builder

[jira] [Assigned] (YARN-2731) RegisterApplicationMasterResponsePBImpl: not properly initialized builder

[ https://issues.apache.org/jira/browse/YARN-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-2731: -- Assignee: Carlo Curino > RegisterApplicationMasterResponsePBImpl: not properly initialized build

[jira] [Commented] (YARN-2731) RegisterApplicationMasterResponsePBImpl: not properly initialized builder

[ https://issues.apache.org/jira/browse/YARN-2731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14180837#comment-14180837 ] Carlo Curino commented on YARN-2731: Simple fix, invoking maybeInitBuilder() in setNMTo

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14182205#comment-14182205 ] Carlo Curino commented on YARN-2664: Matteo, first of all, thanks for looking into this

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202473#comment-14202473 ] Carlo Curino commented on YARN-2664: Matteo, thanks for picking this up. I tried your

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207194#comment-14207194 ] Carlo Curino commented on YARN-2009: Sunil, A thing to keep in mind is that any preemp

[jira] [Commented] (YARN-2009) Priority support for preemption in ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14211358#comment-14211358 ] Carlo Curino commented on YARN-2009: I agree with your observation... the set of invari

[jira] [Assigned] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-2877: -- Assignee: Carlo Curino > Extend YARN to support distributed scheduling > ---

[jira] [Updated] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2877: --- Assignee: (was: Carlo Curino) > Extend YARN to support distributed scheduling > ---

[jira] [Commented] (YARN-2882) Introducing container types

[ https://issues.apache.org/jira/browse/YARN-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219763#comment-14219763 ] Carlo Curino commented on YARN-2882: To help understand this notion, think of container

[jira] [Created] (YARN-2884) Proxying all AM-RM communications

Carlo Curino created YARN-2884: -- Summary: Proxying all AM-RM communications Key: YARN-2884 URL: https://issues.apache.org/jira/browse/YARN-2884 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219871#comment-14219871 ] Carlo Curino commented on YARN-2877: Karthik, you are correct... Karthik, glad you li

[jira] [Commented] (YARN-2884) Proxying all AM-RM communications

[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14219881#comment-14219881 ] Carlo Curino commented on YARN-2884: I agree we should give it another name... but the

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Attachment: YARN-2664.4.patch simply adding a new-line at the end to get patch to apply > Improve RM w

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220395#comment-14220395 ] Carlo Curino commented on YARN-2664: I tried to test this, but: # the patch was missi

[jira] [Commented] (YARN-2877) Extend YARN to support distributed scheduling

[ https://issues.apache.org/jira/browse/YARN-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223197#comment-14223197 ] Carlo Curino commented on YARN-2877: I am going to echo [~kkaranasos] regarding "malici

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14232144#comment-14232144 ] Carlo Curino commented on YARN-2915: A couple of design principles at play: # We are

[jira] [Commented] (YARN-1547) Prevent DoS of ApplicationMasterProtocol by putting in limits

[ https://issues.apache.org/jira/browse/YARN-1547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14232326#comment-14232326 ] Carlo Curino commented on YARN-1547: This is related to YARN-2884, which give us a stru

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233630#comment-14233630 ] Carlo Curino commented on YARN-2664: [~mazzu] thanks for the update. Regarding the rele

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Attachment: legal.patch > Improve RM webapp to expose info about reservations. > --

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233658#comment-14233658 ] Carlo Curino commented on YARN-2664: [~mazzu], the patch looks good, I will give you a

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233660#comment-14233660 ] Carlo Curino commented on YARN-2664: Cool. Please include the changes I have in the leg

[jira] [Updated] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2664: --- Attachment: screenshot_reservation_UI.pdf > Improve RM webapp to expose info about reservations. >

[jira] [Commented] (YARN-2664) Improve RM webapp to expose info about reservations.

[ https://issues.apache.org/jira/browse/YARN-2664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233690#comment-14233690 ] Carlo Curino commented on YARN-2664: I am running this on a 35 machine cluster, with a

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13648985#comment-13648985 ] Carlo Curino commented on YARN-568: --- Hi Sandy, thanks for the feedback! I think that if

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13648986#comment-13648986 ] Carlo Curino commented on YARN-45: -- Based on all the feedback here, including discussions wi

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: YARN-45.patch > Scheduler feedback to AM to release containers > ---

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649126#comment-13649126 ] Carlo Curino commented on YARN-568: --- Sandy, I agree with your summary of the FS mechanics,

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649235#comment-13649235 ] Carlo Curino commented on YARN-569: --- Thank Bikas, we will look into it, and see whether we

[jira] [Commented] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650527#comment-13650527 ] Carlo Curino commented on YARN-45: -- bq. Would be great if you could add a version number to

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: YARN-45.patch > Scheduler feedback to AM to release containers > ---

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: (was: YARN-45.patch) > Scheduler feedback to AM to release containers >

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: YARN-45.1.patch > Scheduler feedback to AM to release containers > -

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: (was: YARN-45.1.patch) > Scheduler feedback to AM to release containers > --

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: YARN-45.1.patch > Scheduler feedback to AM to release containers > -

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13650541#comment-13650541 ] Carlo Curino commented on YARN-569: --- Hi Bikas, I noticed that your patch and ours share a

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651304#comment-13651304 ] Carlo Curino commented on YARN-568: --- Following a conversation with Sandy, we post a new ve

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: (was: YARN-45_summary_of_alternatives.pdf) > Scheduler feedback to AM to release contain

[jira] [Updated] (YARN-45) Scheduler feedback to AM to release containers

[ https://issues.apache.org/jira/browse/YARN-45?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-45: - Attachment: YARN-45_design_thoughts.pdf > Scheduler feedback to AM to release containers > -

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651550#comment-13651550 ] Carlo Curino commented on YARN-568: --- Sandy, I ran, in a small 10 machines cluster, the FS

[jira] [Commented] (YARN-656) In scheduler UI, "Memory Total" should not include reserved memory.

[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13651981#comment-13651981 ] Carlo Curino commented on YARN-656: --- Sandy, I am not sure about this one. I would expect m

[jira] [Commented] (YARN-656) In scheduler UI, "Memory Total" should not include reserved memory.

[ https://issues.apache.org/jira/browse/YARN-656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13652360#comment-13652360 ] Carlo Curino commented on YARN-656: --- I haven't seen this problem happening with the Capaci

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13652548#comment-13652548 ] Carlo Curino commented on YARN-568: --- [~kkambatl] This code was originally in YARN-567 whic

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-569: -- Attachment: YARN-569.1.patch > CapacityScheduler: support for preemption (using a capacity monitor) >

[jira] [Commented] (YARN-568) FairScheduler: support for work-preserving preemption

[ https://issues.apache.org/jira/browse/YARN-568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13652598#comment-13652598 ] Carlo Curino commented on YARN-568: --- Updated [patch for YARN-569 | https://issues.apache.

[jira] [Resolved] (YARN-567) RM changes to support preemption for FairScheduler and CapacityScheduler

[ https://issues.apache.org/jira/browse/YARN-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino resolved YARN-567. --- Resolution: Fixed Fix Version/s: 2.0.5-beta Fixed as part of YARN-568 > RM chan

[jira] [Commented] (YARN-666) [Umbrella] Support rolling upgrades in YARN

[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13657337#comment-13657337 ] Carlo Curino commented on YARN-666: --- This seems a very important problem (and a very hard

[jira] [Commented] (YARN-666) [Umbrella] Support rolling upgrades in YARN

[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659024#comment-13659024 ] Carlo Curino commented on YARN-666: --- Hi Vinod, I will give you some numbers but bare in mi

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13659091#comment-13659091 ] Carlo Curino commented on YARN-624: --- Alejandro, I completely agree gang scheduling is an i

[jira] [Commented] (YARN-666) [Umbrella] Support rolling upgrades in YARN

[ https://issues.apache.org/jira/browse/YARN-666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13660040#comment-13660040 ] Carlo Curino commented on YARN-666: --- Vinod, I completely agree YARN/MR separation makes ha

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661175#comment-13661175 ] Carlo Curino commented on YARN-569: --- We post an improved version of the patch, that reflec

[jira] [Updated] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-569: -- Attachment: YARN-569.2.patch > CapacityScheduler: support for preemption (using a capacity monitor) >

[jira] [Commented] (YARN-569) CapacityScheduler: support for preemption (using a capacity monitor)

[ https://issues.apache.org/jira/browse/YARN-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13661410#comment-13661410 ] Carlo Curino commented on YARN-569: --- The findbugs warnings are on accesses of a ResourceCa

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13663125#comment-13663125 ] Carlo Curino commented on YARN-624: --- I have two level of comments, the first is to clarify

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13699204#comment-13699204 ] Carlo Curino commented on YARN-897: --- The childQueues of a ParentQueue are stored in a Tree

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706152#comment-13706152 ] Carlo Curino commented on YARN-897: --- I agree this need fixing soon. We have a first draft

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13706327#comment-13706327 ] Carlo Curino commented on YARN-897: --- Omkar, thanks for the quick feedback... bq. any rea

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13713417#comment-13713417 ] Carlo Curino commented on YARN-897: --- [~acmurthy] what's your preference? Keep what we prop

[jira] [Commented] (YARN-897) CapacityScheduler wrongly sorted queues

[ https://issues.apache.org/jira/browse/YARN-897?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13714559#comment-13714559 ] Carlo Curino commented on YARN-897: --- Thanks [~acmurthy] for the prompt review!

[jira] [Commented] (YARN-59) "Text File Busy" errors launching MR tasks

[ https://issues.apache.org/jira/browse/YARN-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13716597#comment-13716597 ] Carlo Curino commented on YARN-59: -- I believe we are hitting this (or something similar) in

[jira] [Created] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

Carlo Curino created YARN-1051: -- Summary: YARN Admission Control/Planner: enhancing the resource allocation model with time. Key: YARN-1051 URL: https://issues.apache.org/jira/browse/YARN-1051 Project: H

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13734973#comment-13734973 ] Carlo Curino commented on YARN-1051: This umbrella JIRA proposes an extension of the YA

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13735967#comment-13735967 ] Carlo Curino commented on YARN-624: --- Related to this is work we just proposed in YARN-1051

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13736067#comment-13736067 ] Carlo Curino commented on YARN-624: --- I do refer to that. The argument is that provided the

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13736970#comment-13736970 ] Carlo Curino commented on YARN-624: --- Robert, you are right, and provide a compelling examp

[jira] [Commented] (YARN-624) Support gang scheduling in the AM RM protocol

[ https://issues.apache.org/jira/browse/YARN-624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737631#comment-13737631 ] Carlo Curino commented on YARN-624: --- Robert, That makes sense. I think we should have som

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737636#comment-13737636 ] Carlo Curino commented on YARN-1021: We were working on a similar simulator effort. Ple

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13744493#comment-13744493 ] Carlo Curino commented on YARN-1021: Sorry for the delay. I went over the patch today t

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13745482#comment-13745482 ] Carlo Curino commented on YARN-1021: I might have missed this, but can you check whethe

[jira] [Commented] (YARN-1021) Yarn Scheduler Load Simulator

[ https://issues.apache.org/jira/browse/YARN-1021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=1374#comment-1374 ] Carlo Curino commented on YARN-1021: The key idea behind the discrete event simulation

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14016151#comment-14016151 ] Carlo Curino commented on YARN-2022: Hi Sunil, I read the doc with [~chris.douglas] and

[jira] [Commented] (YARN-2022) Preempting an Application Master container can be kept as least priority when multiple applications are marked for preemption by ProportionalCapacityPreemptionPolicy

[ https://issues.apache.org/jira/browse/YARN-2022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14025879#comment-14025879 ] Carlo Curino commented on YARN-2022: Mayank, I completely agree with you and vinod, hen

<    4   5   6   7   8   9   10   11   >