[jira] [Updated] (YARN-6511) Federation: transparent spanning application across multiple sub-clusters

2017-06-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6511: - Summary: Federation: transparent spanning application across multiple sub-clusters (was:

[jira] [Commented] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16040001#comment-16040001 ] Subru Krishnan commented on YARN-6511: -- Thanks [~botong] for addressing my comments, the latest patch

[jira] [Commented] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16037799#comment-16037799 ] Subru Krishnan commented on YARN-6687: -- The test case failure is unrelated and tracked by YARN-5548.

[jira] [Created] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-06-05 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6691: Summary: Update YARN daemon startup/shutdown scripts to include Router service Key: YARN-6691 URL: https://issues.apache.org/jira/browse/YARN-6691 Project: Hadoop

[jira] [Updated] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6687: - Attachment: YARN-6687-v1.patch Attaching patch that validates that the duration of the periodic

[jira] [Created] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-02 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6687: Summary: Validate that the duration of the periodic reservation is less than the periodicity Key: YARN-6687 URL: https://issues.apache.org/jira/browse/YARN-6687

[jira] [Commented] (YARN-6511) Federation Intercepting and propagating AM-RM communications (part two: secondary subclusters added)

2017-06-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16035370#comment-16035370 ] Subru Krishnan commented on YARN-6511: -- Thanks [~botong] for the patch. I looked at it & please find

[jira] [Comment Edited] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-05-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032053#comment-16032053 ] Subru Krishnan edited comment on YARN-6634 at 5/31/17 9:55 PM: ---

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-05-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16032053#comment-16032053 ] Subru Krishnan commented on YARN-6634: -- [~giovanni.fumarola], I know it's a nit but you can try

[jira] [Updated] (YARN-3666) Federation Intercepting and propagating AM- home RM communications

2017-05-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-3666: - Summary: Federation Intercepting and propagating AM- home RM communications (was: Federation

[jira] [Commented] (YARN-6484) [Documentation] Documenting the YARN Federation feature

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030377#comment-16030377 ] Subru Krishnan commented on YARN-6484: -- Thanks [~curino] for fixing the patch and addressing my

[jira] [Commented] (YARN-6484) [Documentation] Documenting the YARN Federation feature

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030351#comment-16030351 ] Subru Krishnan commented on YARN-6484: -- [~curino], the patch seems to be missing the binaries (png

[jira] [Comment Edited] (YARN-3666) Federation Intercepting and propagating AM-RM communications (part one: home RM only)

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030001#comment-16030001 ] Subru Krishnan edited comment on YARN-3666 at 5/30/17 8:58 PM: --- Thanks

[jira] [Updated] (YARN-6666) Fix unit test failure in TestRouterClientRMService

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-: - Summary: Fix unit test failure in TestRouterClientRMService (was: Fix unit test in

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications (part one: home RM only)

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16030001#comment-16030001 ] Subru Krishnan commented on YARN-3666: -- Thanks [~botong] for the updated patch. It's pretty close,

[jira] [Commented] (YARN-6666) Fix unit test in TestRouterClientRMService

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029991#comment-16029991 ] Subru Krishnan commented on YARN-: -- Thanks [~botong] for the clarification. Overall I am not a fan

[jira] [Resolved] (YARN-6485) [Regression] TestFederationRMStateStoreService is failing with null pointer exception

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-6485. -- Resolution: Works for Me Fix Version/s: YARN-2915 I am closing this as I ran

[jira] [Commented] (YARN-6666) Fix unit test in TestRouterClientRMService

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16029927#comment-16029927 ] Subru Krishnan commented on YARN-: -- [~botong], one quick question on the patch - why are you not

[jira] [Updated] (YARN-6666) Fix unit test in TestRouterClientRMService

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-: - Issue Type: Sub-task (was: Bug) Parent: YARN-2915 > Fix unit test in

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-05-26 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16026976#comment-16026976 ] Subru Krishnan commented on YARN-5531: -- Thanks [~botong] for addressing the feedback. I have one minor

[jira] [Commented] (YARN-6484) [Documentation] Documenting the YARN Federation feature

2017-05-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16025456#comment-16025456 ] Subru Krishnan commented on YARN-6484: -- Thanks [~curino] for the solid documentation. I have a few

[jira] [Updated] (YARN-6648) Add FederationStateStore interfaces for Global Policy Generator

2017-05-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6648: - Issue Type: Sub-task (was: Task) Parent: YARN-5597 > Add FederationStateStore interfaces

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-05-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023920#comment-16023920 ] Subru Krishnan commented on YARN-5531: -- Thanks [~kasha] for your thoughtful comments. I walked through

[jira] [Commented] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-05-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16023657#comment-16023657 ] Subru Krishnan commented on YARN-6634: -- [~giovanni.fumarola], your patch itself looks fine but can you

[jira] [Created] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-05-22 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6634: Summary: [API] Define an API for ResourceManager WebServices Key: YARN-6634 URL: https://issues.apache.org/jira/browse/YARN-6634 Project: Hadoop YARN Issue

[jira] [Assigned] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-05-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-6634: Assignee: Giovanni Matteo Fumarola > [API] Define an API for ResourceManager WebServices >

[jira] [Updated] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-05-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5328: - Attachment: YARN-5328-v2.patch Thanks [~curino] for the review. Attaching updated patch (v2) that

[jira] [Updated] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-05-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5328: - Attachment: YARN-5328-v1.patch Attaching first attempt of the patch > InMemoryPlan enhancements

[jira] [Commented] (YARN-6473) Create ReservationInvariantChecker to validate ReservationSystem + Scheduler operations

2017-05-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16005467#comment-16005467 ] Subru Krishnan commented on YARN-6473: -- Thanks [~curino] for the patch, this is a nice start. +1 my

[jira] [Commented] (YARN-5413) Create a proxy chain for ResourceManager Admin API in the Router

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001943#comment-16001943 ] Subru Krishnan commented on YARN-5413: -- Thanks [~giovanni.fumarola] for the quick turnaround. The

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001910#comment-16001910 ] Subru Krishnan commented on YARN-5531: -- Thanks [~botong] for the quick turnaround. Can you add a

[jira] [Commented] (YARN-6281) Cleanup when AMRMProxy fails to initialize a new interceptor chain

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001862#comment-16001862 ] Subru Krishnan commented on YARN-6281: -- I cherry-picked to trunk/branch-2 as this is a fix in main

[jira] [Updated] (YARN-6281) Cleanup when AMRMProxy fails to initialize a new interceptor chain

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6281: - Fix Version/s: (was: YARN-2915) 3.0.0-alpha3 2.9.0 >

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001790#comment-16001790 ] Subru Krishnan commented on YARN-5531: -- Thanks [~botong] for addressing my feedback. The latest patch

[jira] [Commented] (YARN-5413) Create a proxy chain for ResourceManager Admin API in the Router

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16001543#comment-16001543 ] Subru Krishnan commented on YARN-5413: -- Thanks [~giovanni.fumarola] for the patch. I looked at it and

[jira] [Reopened] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-05-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reopened YARN-6234: -- reopening to trigger Yetus on trunk > Support multiple attempts on the node when AMRMProxy is

[jira] [Commented] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-05-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999152#comment-15999152 ] Subru Krishnan commented on YARN-6234: -- Thanks [~giovanni.fumarola] and [~curino] for working on this.

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-05-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999045#comment-15999045 ] Subru Krishnan commented on YARN-5531: -- Thanks [~botong] for addressing my comments. I looked at the

[jira] [Commented] (YARN-6565) Fix memory leak and finish app trigger in AMRMProxy

2017-05-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15998981#comment-15998981 ] Subru Krishnan commented on YARN-6565: -- [~botong], good catch! The patch LGTM, can you fix the minor

[jira] [Updated] (YARN-6565) Fix memory leak and finish app trigger in AMRMProxy

2017-05-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6565: - Issue Type: Sub-task (was: Bug) Parent: YARN-2915 > Fix memory leak and finish app

[jira] [Assigned] (YARN-5597) YARN Federation phase 2

2017-05-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5597: Assignee: Subru Krishnan > YARN Federation phase 2 > --- > >

[jira] [Updated] (YARN-6553) Replace MockResourceManagerFacade with MockRM for AMRMProxy/Router tests

2017-05-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6553: - Description: Currently the AMRMProxy and Router tests use the {{MockResourceManagerFacade}}. This

[jira] [Updated] (YARN-6553) Replace MockResourceManagerFacade with MockRM for AMRMProxy/Router tests

2017-05-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6553: - Summary: Replace MockResourceManagerFacade with MockRM for AMRMProxy/Router tests (was: Remove

[jira] [Comment Edited] (YARN-5411) Create a proxy chain for ApplicationClientProtocol in the Router

2017-05-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995281#comment-15995281 ] Subru Krishnan edited comment on YARN-5411 at 5/3/17 6:13 PM: -- Thanks

[jira] [Commented] (YARN-5411) Create a proxy chain for ApplicationClientProtocol in the Router

2017-05-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15995281#comment-15995281 ] Subru Krishnan commented on YARN-5411: -- Thanks [~giovanni.fumarola] for addressing my comments. I have

[jira] [Updated] (YARN-6542) Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent

2017-05-01 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6542: - Attachment: YARN-6542-v1.patch Adding trivial patch that switches the logger to slf4j > Fix the

[jira] [Created] (YARN-6542) Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent

2017-05-01 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6542: Summary: Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent Key: YARN-6542 URL: https://issues.apache.org/jira/browse/YARN-6542 Project: Hadoop YARN

[jira] [Created] (YARN-6541) Optimize {{PeriodicRLESparseResourceAllocation}} by auto-expanding it's time period

2017-05-01 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6541: Summary: Optimize {{PeriodicRLESparseResourceAllocation}} by auto-expanding it's time period Key: YARN-6541 URL: https://issues.apache.org/jira/browse/YARN-6541

[jira] [Updated] (YARN-6541) Optimize PeriodicRLESparseResourceAllocation by auto-expanding it's time period

2017-05-01 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6541: - Summary: Optimize PeriodicRLESparseResourceAllocation by auto-expanding it's time period (was:

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications (part one: home RM only)

2017-04-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987942#comment-15987942 ] Subru Krishnan commented on YARN-3666: -- [~botong], the patch looks mostly good to me, just have few

[jira] [Commented] (YARN-5411) Create a proxy chain for ApplicationClientProtocol in the Router

2017-04-26 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15985613#comment-15985613 ] Subru Krishnan commented on YARN-5411: -- Thanks [~giovanni.fumarola] for the patch. I looked at it &

[jira] [Commented] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-04-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15983669#comment-15983669 ] Subru Krishnan commented on YARN-5531: -- Thanks [~botong] for the patch. I went through it, please find

[jira] [Commented] (YARN-5331) Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem

2017-04-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15981760#comment-15981760 ] Subru Krishnan commented on YARN-5331: -- Thanks [~ajsangeetha] for working on this. I looked at the

[jira] [Assigned] (YARN-6127) Add support for work preserving NM restart when AMRMProxy is enabled

2017-04-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-6127: Assignee: Botong Huang (was: Subru Krishnan) > Add support for work preserving NM restart

[jira] [Commented] (YARN-3666) Federation Intercepting and propagating AM-RM communications

2017-04-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969407#comment-15969407 ] Subru Krishnan commented on YARN-3666: -- Thanks [~botong] for reporting the test failure. I have

[jira] [Created] (YARN-6485) [Regression] TestFederationRMStateStoreService is failing with null pointer exception

2017-04-14 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6485: Summary: [Regression] TestFederationRMStateStoreService is failing with null pointer exception Key: YARN-6485 URL: https://issues.apache.org/jira/browse/YARN-6485

[jira] [Created] (YARN-6484) [Documentation] Documenting the YARN Federation feature

2017-04-14 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6484: Summary: [Documentation] Documenting the YARN Federation feature Key: YARN-6484 URL: https://issues.apache.org/jira/browse/YARN-6484 Project: Hadoop YARN

[jira] [Commented] (YARN-6203) Occasional test failure in TestWeightedRandomRouterPolicy

2017-04-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966689#comment-15966689 ] Subru Krishnan commented on YARN-6203: -- Thanks [~curino], the fix LGTM. > Occasional test failure in

[jira] [Assigned] (YARN-5330) SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem

2017-04-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5330: Assignee: Carlo Curino > SharingPolicy enhancements required to support recurring

[jira] [Assigned] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2017-04-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5329: Assignee: Carlo Curino > ReservationAgent enhancements required to support recurring

[jira] [Assigned] (YARN-5326) Support for recurring reservations in the YARN ReservationSystem

2017-04-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5326: Assignee: Carlo Curino > Support for recurring reservations in the YARN ReservationSystem >

[jira] [Commented] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-04-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15966547#comment-15966547 ] Subru Krishnan commented on YARN-6234: -- Thanks for your response [~botong]. Essentially there are 2

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

2017-04-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15957540#comment-15957540 ] Subru Krishnan commented on YARN-5602: -- Thanks [~giovanni.fumarola] for addressing my comments. +1 on

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-04-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15954141#comment-15954141 ] Subru Krishnan commented on YARN-6109: -- Thanks [~xgong] for considering my feedback. I am OK with

[jira] [Commented] (YARN-6363) Extending SLS: Synthetic Load Generator

2017-03-29 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948016#comment-15948016 ] Subru Krishnan commented on YARN-6363: -- Thanks [~curino] for working on this really useful extension

[jira] [Updated] (YARN-6355) Interceptor framework for the YARN ApplicationMasterService

2017-03-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6355: - Labels: amrmproxy resourcemanager (was: ) > Interceptor framework for the YARN

[jira] [Commented] (YARN-6355) Interceptor framework for the YARN ApplicationMasterService

2017-03-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930569#comment-15930569 ] Subru Krishnan commented on YARN-6355: -- [~asuresh], it should be fairly straightforward to refactor

[jira] [Updated] (YARN-6355) Interceptor framework for the YARN ApplicationMasterService

2017-03-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6355: - Issue Type: Sub-task (was: Improvement) Parent: YARN-5468 > Interceptor framework for the

[jira] [Commented] (YARN-6345) Add container tags to resource requests

2017-03-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15928896#comment-15928896 ] Subru Krishnan commented on YARN-6345: -- [~miklos.szeg...@cloudera.com], we are currently thinking of

[jira] [Commented] (YARN-6281) Cleanup when AMRMProxy fails to initialize a new interceptor chain

2017-03-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900116#comment-15900116 ] Subru Krishnan commented on YARN-6281: -- +1 on the latest patch. Thanks [~botong]. I'll be committing

[jira] [Commented] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-03-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15900109#comment-15900109 ] Subru Krishnan commented on YARN-6234: -- [~giovanni.fumarola], I think we should reattach the new

[jira] [Updated] (YARN-6247) Share a single instance of SubClusterResolver instead of instantiating one per AM

2017-03-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6247: - Summary: Share a single instance of SubClusterResolver instead of instantiating one per AM (was:

[jira] [Assigned] (YARN-5330) SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5330: Assignee: (was: Subru Krishnan) > SharingPolicy enhancements required to support

[jira] [Assigned] (YARN-5330) SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5330: Assignee: Subru Krishnan (was: Sangeetha Abdu Jyothi) > SharingPolicy enhancements

[jira] [Assigned] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5329: Assignee: (was: Sangeetha Abdu Jyothi) > ReservationAgent enhancements required to

[jira] [Assigned] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5328?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5328: Assignee: Subru Krishnan (was: Sangeetha Abdu Jyothi) > InMemoryPlan enhancements required

[jira] [Assigned] (YARN-5516) Add REST API for periodicity

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5516: Assignee: Subru Krishnan (was: Sangeetha Abdu Jyothi) > Add REST API for periodicity >

[jira] [Comment Edited] (YARN-6247) Add SubClusterResolver into FederationStateStoreFacade

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888728#comment-15888728 ] Subru Krishnan edited comment on YARN-6247 at 2/28/17 7:33 PM: --- Thanks

[jira] [Commented] (YARN-6247) Add SubClusterResolver into FederationStateStoreFacade

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15888728#comment-15888728 ] Subru Krishnan commented on YARN-6247: -- Thanks [~botong] for the patch. It looks fairly

[jira] [Updated] (YARN-6247) Add SubClusterResolver into FederationStateStoreFacade

2017-02-28 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6247: - Issue Type: Sub-task (was: Task) Parent: YARN-2915 > Add SubClusterResolver into

[jira] [Commented] (YARN-5602) Utils for Federation State and Policy Store

2017-02-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15883817#comment-15883817 ] Subru Krishnan commented on YARN-5602: -- [~giovanni.fumarola], thanks for the patch. I looked at it and

[jira] [Created] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-02-24 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6234: Summary: Support multiple attempts on the node when AMRMProxy is enabled Key: YARN-6234 URL: https://issues.apache.org/jira/browse/YARN-6234 Project: Hadoop YARN

[jira] [Updated] (YARN-6016) Fix minor bugs in handling of local AMRMToken in AMRMProxy

2017-02-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6016: - Issue Type: Sub-task (was: Bug) Parent: YARN-2915 > Fix minor bugs in handling of local

[jira] [Updated] (YARN-5410) Bootstrap Router server module

2017-02-24 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5410: - Summary: Bootstrap Router server module (was: Bootstrap Router module) > Bootstrap Router server

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-02-23 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882003#comment-15882003 ] Subru Krishnan commented on YARN-6109: -- [~leftnoteasy], I think it should be fairly straightforward to

[jira] [Commented] (YARN-5410) Bootstrap Router module

2017-02-23 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15882000#comment-15882000 ] Subru Krishnan commented on YARN-5410: -- Thanks [~leftnoteasy] for your feedback. bq. I think I

[jira] [Commented] (YARN-6223) [Umbrella] Natively support GPU configuration/discovery/scheduling/isolation on YARN

2017-02-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879794#comment-15879794 ] Subru Krishnan commented on YARN-6223: -- Thanks [~leftnoteasy] for initiating this. I had a

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-02-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879791#comment-15879791 ] Subru Krishnan commented on YARN-6109: -- I looked at this and YARN-5556 and unfortunately both have

[jira] [Updated] (YARN-6093) Minor bugs with AMRMtoken renewal and state store availability when using FederationRMFailoverProxyProvider during RM failover

2017-02-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6093: - Summary: Minor bugs with AMRMtoken renewal and state store availability when using

[jira] [Commented] (YARN-6109) Add an ability to convert ChildQueue to ParentQueue

2017-02-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15879148#comment-15879148 ] Subru Krishnan commented on YARN-6109: -- Thanks [~leftnoteasy] and [~xgong]. I'll try to take a quick

[jira] [Updated] (YARN-6190) Bug in LocalityMulticastAMRMProxyPolicy argument validation

2017-02-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6190: - Summary: Bug in LocalityMulticastAMRMProxyPolicy argument validation (was: Bug fixes in

[jira] [Updated] (YARN-6203) Occasional test failure in TestWeightedRandomRouterPolicy

2017-02-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6203: - Issue Type: Sub-task (was: Bug) Parent: YARN-2915 > Occasional test failure in

[jira] [Commented] (YARN-3659) Federation Router (hiding multiple RMs for ApplicationClientProtocol)

2017-02-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868774#comment-15868774 ] Subru Krishnan commented on YARN-3659: -- Thanks [~luhuichun] for offering to help! We have a prototype

[jira] [Commented] (YARN-6093) Invalid AMRM token exception when using FederationRMFailoverProxyProvider at AMRMtoken renewal during a RM failover

2017-02-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867101#comment-15867101 ] Subru Krishnan commented on YARN-6093: -- [~botong], can you open a JIRA to track the test failure as we

[jira] [Commented] (YARN-6180) Clean unused SchedulerRequestKeys once ExecutionType updates are completed

2017-02-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867100#comment-15867100 ] Subru Krishnan commented on YARN-6180: -- [~asuresh], IIUC this is valid for all key attributes and not

[jira] [Updated] (YARN-6190) Bug fixes in federation polices

2017-02-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6190: - Issue Type: Sub-task (was: Bug) Parent: YARN-2915 > Bug fixes in federation polices >

[jira] [Assigned] (YARN-3666) Federation Intercepting and propagating AM-RM communications

2017-02-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-3666: Assignee: Botong Huang (was: Kishore Chaliparambil) > Federation Intercepting and

[jira] [Assigned] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2017-02-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-5531: Assignee: Botong Huang (was: Sarvesh Sakalanaga) > UnmanagedAM pool manager for federating

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-01-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6128: - Parent Issue: YARN-5597 (was: YARN-2915) > Add support for AMRMProxy HA >

[jira] [Updated] (YARN-6128) Add support for AMRMProxy HA

2017-01-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6128: - Description: YARN-556 added the ability for RM failover without loosing any running applications.

<    1   2   3   4   5   6   7   8   9   10   >