[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007603#comment-15007603 ] Carlo Curino commented on YARN-3454: We also removed the minAlloc input parameter that was unused (and

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.patch > RLESparseResourceAllocation does not handle removal of partial intervals

[jira] [Created] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4358: -- Summary: Improve relationship between SharingPolicy and ReservationAgent Key: YARN-4358 URL: https://issues.apache.org/jira/browse/YARN-4358 Project: Hadoop YARN

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.1.patch Updating including missing class > RLESparseResourceAllocation does not

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007657#comment-15007657 ] Carlo Curino commented on YARN-4358: In this patch, we propose to change the relationship between

[jira] [Created] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-16 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4360: -- Summary: Improve GreedyReservationAgent to support "early" allocations, and performance improvements Key: YARN-4360 URL: https://issues.apache.org/jira/browse/YARN-4360

[jira] [Created] (YARN-4359) Update LowCost agents logic to take advantage of YARN-4358

2015-11-16 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4359: -- Summary: Update LowCost agents logic to take advantage of YARN-4358 Key: YARN-4359 URL: https://issues.apache.org/jira/browse/YARN-4359 Project: Hadoop YARN

[jira] [Updated] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4358: --- Attachment: YARN-4358.patch This patch is marked-as-ready, but depends on YARN-3454 to apply

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007882#comment-15007882 ] Carlo Curino commented on YARN-4358: As side effects, this patch also: * introduces tracking of

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15007896#comment-15007896 ] Carlo Curino commented on YARN-4358: This patch fixes the behavior for the GreedyReservationAgent.

[jira] [Assigned] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4360: -- Assignee: Carlo Curino > Improve GreedyReservationAgent to support "early" allocations, and >

[jira] [Updated] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4360: --- Attachment: YARN-4360.patch Initial patch... > Improve GreedyReservationAgent to support "early"

[jira] [Commented] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009226#comment-15009226 ] Carlo Curino commented on YARN-4360: This patch depends on YARN-4358. > Improve GreedyReservationAgent

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-10-15 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14959393#comment-14959393 ] Carlo Curino commented on YARN-4248: I will address the QA issues next, but I have a question for the

[jira] [Created] (YARN-4248) REST API for submit/update/delete Reservations

2015-10-09 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4248: -- Summary: REST API for submit/update/delete Reservations Key: YARN-4248 URL: https://issues.apache.org/jira/browse/YARN-4248 Project: Hadoop YARN Issue Type:

[jira] [Updated] (YARN-4248) REST API for submit/update/delete Reservations

2015-10-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4248: --- Attachment: YARN-4248.patch First cut of patch... > REST API for submit/update/delete Reservations >

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618894#comment-14618894 ] Carlo Curino commented on YARN-2915: Lei, first let me make sure we are on the same

[jira] [Commented] (YARN-3658) Federation Capacity Allocation across sub-cluster

2015-07-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14618902#comment-14618902 ] Carlo Curino commented on YARN-3658: See the presentation attached to the umbrella jira

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617628#comment-14617628 ] Carlo Curino commented on YARN-2915: I created a branch: YARN-2915 which we will use

[jira] [Updated] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-2915: --- Attachment: FEDERATION_CAPACITY_ALLOCATION_JIRA.pdf Enable YARN RM scale out via federation using

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617570#comment-14617570 ] Carlo Curino commented on YARN-2915: [~grey] that is a good questions. We are not

[jira] [Commented] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2015-07-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14617707#comment-14617707 ] Carlo Curino commented on YARN-2915: {color:red} *ENFORCING GLOBAL INVARIANT* {color}

[jira] [Commented] (YARN-3800) Simplify inmemory state for ReservationAllocation

2015-07-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14619550#comment-14619550 ] Carlo Curino commented on YARN-3800: Patch generally looks good, and I spoke with

[jira] [Updated] (YARN-3800) Reduce storage footprint for ReservationAllocation

2015-07-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3800: --- Summary: Reduce storage footprint for ReservationAllocation (was: Simplify inmemory state for

[jira] [Created] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-09-20 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4195: -- Summary: Support of node-labels in the ReservationSystem "Plan" Key: YARN-4195 URL: https://issues.apache.org/jira/browse/YARN-4195 Project: Hadoop YARN Issue

[jira] [Created] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-09-20 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4196: -- Summary: Enhance ReservationAgent(s) to support node-label Key: YARN-4196 URL: https://issues.apache.org/jira/browse/YARN-4196 Project: Hadoop YARN Issue Type:

[jira] [Created] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support not labels

2015-09-20 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4194: -- Summary: Extend Reservation Definition Langauge (RDL) extensions to support not labels Key: YARN-4194 URL: https://issues.apache.org/jira/browse/YARN-4194 Project:

[jira] [Created] (YARN-4193) Support heterogeneity (node-labels) in the YARN ReservationSystem

2015-09-20 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4193: -- Summary: Support heterogeneity (node-labels) in the YARN ReservationSystem Key: YARN-4193 URL: https://issues.apache.org/jira/browse/YARN-4193 Project: Hadoop YARN

[jira] [Updated] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-09-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4195: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4193 > Support of node-labels in the

[jira] [Updated] (YARN-4198) CapacityScheduler locking / synchronization improvements

2015-09-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4198: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4193 > CapacityScheduler locking /

[jira] [Updated] (YARN-4197) Modify PlanFollower to handle reservation with node-labels

2015-09-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4197: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4193 > Modify PlanFollower to handle

[jira] [Updated] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-09-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4196: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4193 > Enhance ReservationAgent(s) to

[jira] [Created] (YARN-4198) CapacityScheduler locking / synchronization improvements

2015-09-20 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4198: -- Summary: CapacityScheduler locking / synchronization improvements Key: YARN-4198 URL: https://issues.apache.org/jira/browse/YARN-4198 Project: Hadoop YARN Issue

[jira] [Updated] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support not labels

2015-09-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4194: --- Issue Type: Sub-task (was: Improvement) Parent: YARN-4193 > Extend Reservation Definition

[jira] [Assigned] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-09-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4195: -- Assignee: Carlo Curino > Support of node-labels in the ReservationSystem "Plan" >

[jira] [Commented] (YARN-4198) CapacityScheduler locking / synchronization improvements

2015-09-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14908355#comment-14908355 ] Carlo Curino commented on YARN-4198: [~kshukla], I am happy to collaborate, but we have a patch in the

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047378#comment-15047378 ] Carlo Curino commented on YARN-4248: Chris, I am happy to fix it, but if I am not mistaken json doesn't

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15047396#comment-15047396 ] Carlo Curino commented on YARN-4248: Thanks for spotting this and to [~chris.douglas] for the

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15032561#comment-15032561 ] Carlo Curino commented on YARN-4358: Thanks [~asuresh], I just uploading a version of the patch that

[jira] [Updated] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-30 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4358: --- Attachment: YARN-4358.3.patch > Improve relationship between SharingPolicy and ReservationAgent >

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-01 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15035000#comment-15035000 ] Carlo Curino commented on YARN-4248: [~chris.douglas] thanks for the review. I addressed your comments

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-12-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15043708#comment-15043708 ] Carlo Curino commented on YARN-4358: Thanks [~asuresh] for the help reviewing and committing. >

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-12-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15048444#comment-15048444 ] Carlo Curino commented on YARN-4358: Thanks [~ajisakaa], we will get to this tomorrow. > Improve

[jira] [Updated] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4248: --- Attachment: YARN-4248.5.patch > REST API for submit/update/delete Reservations >

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15042153#comment-15042153 ] Carlo Curino commented on YARN-4248: I added a few null checks which return more clear error messages

[jira] [Updated] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-12-05 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4358: --- Attachment: YARN-4358.4.patch Addressed more checkstyle/eol... what is left I think is ok/better as

[jira] [Updated] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4248: --- Attachment: YARN-4248.6.patch Fixing (most) checkstyles and EOL errors... I am not addressing the

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-12-07 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15045828#comment-15045828 ] Carlo Curino commented on YARN-4248: Committed this to trunk/branch-2/branch-2.8. I will update the

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-12-09 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15049328#comment-15049328 ] Carlo Curino commented on YARN-4358: [~asuresh] just uploaded a fix, and he will commit it after QA

[jira] [Commented] (YARN-4108) CapacityScheduler: Improve preemption to preempt only those containers that would satisfy the incoming request

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060543#comment-15060543 ] Carlo Curino commented on YARN-4108: [~leftnoteasy] thanks for explaining us what you are working on.

[jira] [Commented] (YARN-4198) CapacityScheduler locking / synchronization improvements

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15060459#comment-15060459 ] Carlo Curino commented on YARN-4198: [~xinxianyin] the way we got to this was by running a "busy"

[jira] [Updated] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4003: --- Issue Type: Sub-task (was: Bug) Parent: YARN-4193 > ReservationQueue inherit

[jira] [Updated] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4195: --- Attachment: YARN-4195.patch > Support of node-labels in the ReservationSystem "Plan" >

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061563#comment-15061563 ] Carlo Curino commented on YARN-4003: [~Sunil G], I think your understanding is correct. The point is

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061562#comment-15061562 ] Carlo Curino commented on YARN-4195: Regarding clean-up: [~subru], I will need some help to make the

[jira] [Updated] (YARN-4197) Modify PlanFollower to handle reservation with node-labels

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4197: --- Assignee: Alexey Tumanov > Modify PlanFollower to handle reservation with node-labels >

[jira] [Updated] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4196: --- Assignee: Ishai Menache (was: Carlo Curino) > Enhance ReservationAgent(s) to support node-label >

[jira] [Assigned] (YARN-4196) Enhance ReservationAgent(s) to support node-label

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4196: -- Assignee: Carlo Curino > Enhance ReservationAgent(s) to support node-label >

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-16 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15061560#comment-15061560 ] Carlo Curino commented on YARN-4195: The posted patch is a rebase of our working branch. It is useful

[jira] [Created] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2015-12-17 Thread Carlo Curino (JIRA)
Carlo Curino created YARN-4468: -- Summary: Document the general ReservationSystem functionality, and the REST API Key: YARN-4468 URL: https://issues.apache.org/jira/browse/YARN-4468 Project: Hadoop YARN

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2015-12-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062692#comment-15062692 ] Carlo Curino commented on YARN-1051: [~lars_francke], you can refer to the general tech-report for more

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2015-12-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15062697#comment-15062697 ] Carlo Curino commented on YARN-1051: YARN-2609 also provides an example of how to invoke this from the

[jira] [Commented] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-12-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056432#comment-15056432 ] Carlo Curino commented on YARN-4360: Rebasing after YARN-4358 got committed. Note: [~imenache] is

[jira] [Commented] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2015-12-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15056449#comment-15056449 ] Carlo Curino commented on YARN-4194: [~atumanov] thanks for contributing this. In general, the patch

[jira] [Updated] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-12-14 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4360: --- Attachment: YARN-4360.3.patch > Improve GreedyReservationAgent to support "early" allocations, and >

[jira] [Assigned] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2016-01-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino reassigned YARN-4468: -- Assignee: Carlo Curino > Document the general ReservationSystem functionality, and the REST API

[jira] [Updated] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2016-01-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4360: --- Attachment: YARN-4360.5.patch > Improve GreedyReservationAgent to support "early" allocations, and >

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2016-01-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081353#comment-15081353 ] Carlo Curino commented on YARN-4195: [~subru] thanks for the review. I agree with most of what you say.

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2016-01-04 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15081374#comment-15081374 ] Carlo Curino commented on YARN-4003: The way I think about {{RM scheduling bandwidth}} is like yet

[jira] [Updated] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2015-12-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4468: --- Attachment: YARN-4468.1.patch > Document the general ReservationSystem functionality, and the REST API

[jira] [Commented] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2015-12-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15066955#comment-15066955 ] Carlo Curino commented on YARN-4468: Second attachment, includes a new ReservationSystem.md

[jira] [Commented] (YARN-4003) ReservationQueue inherit getAMResourceLimit() from LeafQueue, but behavior is not consistent

2015-12-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067269#comment-15067269 ] Carlo Curino commented on YARN-4003: [~sunilg], I think what you propose make is possible, but the

[jira] [Commented] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2015-12-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067275#comment-15067275 ] Carlo Curino commented on YARN-4194: It was supposed to read {{+1}} from me. > Extend Reservation

[jira] [Commented] (YARN-4194) Extend Reservation Definition Langauge (RDL) extensions to support node labels

2015-12-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067274#comment-15067274 ] Carlo Curino commented on YARN-4194: [~atumanov], makes sense. If I read you right, you mean that the

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15064956#comment-15064956 ] Carlo Curino commented on YARN-4195: [~leftnoteasy], I think you are guessing right (with a wrong

[jira] [Commented] (YARN-4195) Support of node-labels in the ReservationSystem "Plan"

2015-12-21 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15067503#comment-15067503 ] Carlo Curino commented on YARN-4195: [~leftnoteasy], good questions: # We can honor the request in

[jira] [Updated] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2015-12-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4468: --- Attachment: YARN-4468.rest-only.patch > Document the general ReservationSystem functionality, and the

[jira] [Commented] (YARN-4468) Document the general ReservationSystem functionality, and the REST API

2015-12-17 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15063268#comment-15063268 ] Carlo Curino commented on YARN-4468: The attached patch adds documentation for the REST API of

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022842#comment-15022842 ] Carlo Curino commented on YARN-4358: (1)/(2) done (3) as discussed above... agreed to circle back

[jira] [Updated] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4358: --- Attachment: YARN-4358.2.patch > Improve relationship between SharingPolicy and ReservationAgent >

[jira] [Commented] (YARN-4358) Improve relationship between SharingPolicy and ReservationAgent

2015-11-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022698#comment-15022698 ] Carlo Curino commented on YARN-4358: [~asuresh] thanks for the comments. I agree with them. In

[jira] [Commented] (YARN-3454) Add efficient merge operation to RLESparseResourceAllocation

2015-11-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15022688#comment-15022688 ] Carlo Curino commented on YARN-3454: [~asuresh] Thank you so much for the thoughtful review and commit.

[jira] [Commented] (YARN-4390) Consider container request size during CS preemption

2015-11-25 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027380#comment-15027380 ] Carlo Curino commented on YARN-4390: [~bikassaha] if the containers to be preempted (remember we

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-11-24 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15025863#comment-15025863 ] Carlo Curino commented on YARN-4248: [~chris.douglas] thanks for the review. I will address your

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.3.patch > RLESparseResourceAllocation does not handle removal of partial

[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012498#comment-15012498 ] Carlo Curino commented on YARN-3454: V3 addresses a couple more details that [~asuresh] has kindly

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.2.patch > RLESparseResourceAllocation does not handle removal of partial

[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15012364#comment-15012364 ] Carlo Curino commented on YARN-3454: [~asuresh] thanks for the prompt and thoughtful review. I agree

[jira] [Updated] (YARN-4248) REST API for submit/update/delete Reservations

2015-11-18 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4248: --- Attachment: YARN-4248.2.patch > REST API for submit/update/delete Reservations >

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-20 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.5.patch > RLESparseResourceAllocation does not handle removal of partial

[jira] [Commented] (YARN-4248) REST API for submit/update/delete Reservations

2015-11-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014092#comment-15014092 ] Carlo Curino commented on YARN-4248: Updated patch: * Fixed 2/5 of the asflicense issues (the last 3

[jira] [Commented] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15014118#comment-15014118 ] Carlo Curino commented on YARN-3454: updated patch fixes checkstyle/whitespace/javadoc... unit test

[jira] [Updated] (YARN-3454) RLESparseResourceAllocation does not handle removal of partial intervals (+ introducing support for efficient "merge" operations)

2015-11-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-3454: --- Attachment: YARN-3454.4.patch > RLESparseResourceAllocation does not handle removal of partial

[jira] [Updated] (YARN-4248) REST API for submit/update/delete Reservations

2015-11-19 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4248: --- Attachment: YARN-4248.3.patch > REST API for submit/update/delete Reservations >

[jira] [Updated] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carlo Curino updated YARN-4360: --- Attachment: YARN-4360.2.patch > Improve GreedyReservationAgent to support "early" allocations, and >

[jira] [Commented] (YARN-4360) Improve GreedyReservationAgent to support "early" allocations, and performance improvements

2015-11-23 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15023143#comment-15023143 ] Carlo Curino commented on YARN-4360: Rebasing after YARN-3454 got committed. A point of discussion: The

[jira] [Commented] (YARN-5215) Scheduling containers based on load in the servers

2016-06-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321091#comment-15321091 ] Carlo Curino commented on YARN-5215: This sounds a generally good idea (patch obviously need work). It

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-06-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321562#comment-15321562 ] Carlo Curino commented on YARN-5215: Bar proper synching with YARN-1011 and YARN-5202 efforts and

[jira] [Commented] (YARN-5215) Scheduling containers based on external load in the servers

2016-06-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321696#comment-15321696 ] Carlo Curino commented on YARN-5215: [~jlowe] thanks for the comment, very useful for context, and you

[jira] [Commented] (YARN-5124) Modify AMRMClient to set the ExecutionType in the ResourceRequest

2016-06-08 Thread Carlo Curino (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15321713#comment-15321713 ] Carlo Curino commented on YARN-5124: [~asuresh] this seems better, however you still have the typedefs

<    1   2   3   4   5   6   7   8   9   10   >