[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687190#comment-16687190 ] Subru Krishnan commented on YARN-8898: -- {quote}Unfortunately we didn't write

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16686009#comment-16686009 ] Subru Krishnan commented on YARN-8898: -- Thanks [~bibinchundatt] for the detailed clarification. +1 on

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684634#comment-16684634 ] Subru Krishnan commented on YARN-8898: -- Thanks [~bibinchundatt] and [~botong] for providing context.

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan edited comment on YARN-8898 at 11/7/18 1:31 AM: ---

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan edited comment on YARN-8898 at 11/7/18 1:30 AM: ---

[jira] [Comment Edited] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan edited comment on YARN-8898 at 11/7/18 1:30 AM: ---

[jira] [Commented] (YARN-8898) Fix FederationInterceptor#allocate to set application priority in allocateResponse

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677499#comment-16677499 ] Subru Krishnan commented on YARN-8898: -- [~bibinchundatt]/[~botong], thanks for working on this. I am

[jira] [Commented] (YARN-8979) Spark on yarn job failed with yarn federation enabled

2018-11-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16677493#comment-16677493 ] Subru Krishnan commented on YARN-8979: -- [~shenyinjie], thanks for reporting this. This is a known

[jira] [Commented] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673832#comment-16673832 ] Subru Krishnan commented on YARN-7592: -- Thanks [~rahulanand90] for the clarification. Can you update

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2018-11-02 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16673830#comment-16673830 ] Subru Krishnan commented on YARN-6900: -- [~rahulanand90], I agree with you the parameters are tricky

[jira] [Commented] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2018-10-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16654036#comment-16654036 ] Subru Krishnan commented on YARN-6900: -- Thanks [~rahulanand90] and [~elgoiri] for raising this. I

[jira] [Commented] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-10-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16643949#comment-16643949 ] Subru Krishnan commented on YARN-7592: -- I want to make sure I fully understand the proposal - we will

[jira] [Commented] (YARN-8637) [GPG] Add FederationStateStore getAppInfo API for GlobalPolicyGenerator

2018-09-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16615397#comment-16615397 ] Subru Krishnan commented on YARN-8637: -- +1 on your proposal [~botong] from my side as I feel we

[jira] [Commented] (YARN-8755) Add clean up for FederationStore apps

2018-09-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614158#comment-16614158 ] Subru Krishnan commented on YARN-8755: -- Thanks [~bibinchundatt]! I see that [~botong] is working on

[jira] [Commented] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-09-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16614143#comment-16614143 ] Subru Krishnan commented on YARN-7592: -- Thanks [~jira.shegalov] for raising this and [~bibinchundatt]

[jira] [Resolved] (YARN-8755) Add clean up for FederationStore apps

2018-09-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-8755. -- Resolution: Duplicate [~bibinchundatt], this should be addressed by YARN-6648 & YARN-7599. Your

[jira] [Commented] (YARN-5597) YARN Federation improvements

2018-09-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605094#comment-16605094 ] Subru Krishnan commented on YARN-5597: -- [~bibinchundatt], we use a RDBMS (SQL) for the Federation

[jira] [Commented] (YARN-7592) yarn.federation.failover.enabled missing in yarn-default.xml

2018-09-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16605092#comment-16605092 ] Subru Krishnan commented on YARN-7592: -- [~bibinchundatt]/[~jira.shegalov], I have tested multiple

[jira] [Commented] (YARN-8637) [GPG] Add FederationStateStore getAppInfo API for GlobalPolicyGenerator

2018-08-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16574087#comment-16574087 ] Subru Krishnan commented on YARN-8637: -- Thanks [~botong] for the patch. lt looks mostly good, have a

[jira] [Commented] (YARN-8626) Create HomePolicyManager that sends all the requests to the home subcluster

2018-08-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570999#comment-16570999 ] Subru Krishnan commented on YARN-8626: -- Thanks [~elgoiri] for addressing my comments, +1 on the

[jira] [Commented] (YARN-8626) Create LocalPolicyManager that sends all the requests to the home subcluster

2018-08-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570604#comment-16570604 ] Subru Krishnan commented on YARN-8626: -- Thanks [~elgoiri] for the patch. I looked at it, please find

[jira] [Commented] (YARN-7833) [PERF/TEST] Extend SLS to support simulation of a Federated Environment

2018-08-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16568597#comment-16568597 ] Subru Krishnan commented on YARN-7833: -- [~tanujnay], thanks for the contribution as it's extremely

[jira] [Commented] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16542264#comment-16542264 ] Subru Krishnan commented on YARN-8434: -- Thanks [~elgoiri] for your feedback. I agree that both the

[jira] [Commented] (YARN-8434) Update federation documentation of Nodemanager configurations

2018-07-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540428#comment-16540428 ] Subru Krishnan commented on YARN-8434: -- Thanks [~bibinchundatt] for understanding/verifying! +1 from

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

2018-07-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539415#comment-16539415 ] Subru Krishnan commented on YARN-8434: -- Thanks [~bibinchundatt] for the clarification, I understand

[jira] [Commented] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537794#comment-16537794 ] Subru Krishnan commented on YARN-8484: -- Thanks [~giovanni.fumarola] for the clarification, +1 from my

[jira] [Commented] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537437#comment-16537437 ] Subru Krishnan commented on YARN-7953: -- Thanks [~abmodi] for working on this and [~botong] for the

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

2018-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537402#comment-16537402 ] Subru Krishnan commented on YARN-8434: -- Thanks [~bibinchundatt] for the patch. In our deployment, we

[jira] [Commented] (YARN-8484) Fix NPE during ServiceStop in Router classes

2018-07-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16537385#comment-16537385 ] Subru Krishnan commented on YARN-8484: -- Thanks [~giovanni.fumarola] for the quick fix. How did you

[jira] [Commented] (YARN-8434) Nodemanager not registering to active RM in federation

2018-06-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8434?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520852#comment-16520852 ] Subru Krishnan commented on YARN-8434: -- [~bibinchundatt], thanks for reporting this. I would like to

[jira] [Assigned] (YARN-7953) [GQ] Data structures for federation global queues calculations

2018-05-29 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-7953: Assignee: Abhishek Modi (was: Carlo Curino) > [GQ] Data structures for federation global

[jira] [Assigned] (YARN-7405) [GQ] Bias container allocations based on global view

2018-05-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-7405: Assignee: Abhishek Modi (was: Arun Suresh) > [GQ] Bias container allocations based on

[jira] [Assigned] (YARN-7404) [GQ] propagate to GPG queue-level utilization/pending information

2018-05-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-7404: Assignee: Abhishek Modi (was: Jose Miguel Arreola) > [GQ] propagate to GPG queue-level

[jira] [Commented] (YARN-7900) [AMRMProxy] AMRMClientRelayer for stateful FederationInterceptor

2018-05-18 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7900?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16481046#comment-16481046 ] Subru Krishnan commented on YARN-7900: -- [~botong]/[~asuresh], don't we need this in branch-2 as well?

[jira] [Updated] (YARN-8110) AMRMProxy recover should catch for all throwable to avoid premature exit

2018-04-06 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-8110: - Summary: AMRMProxy recover should catch for all throwable to avoid premature exit (was: AMRMProxy

[jira] [Commented] (YARN-8010) Add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16416529#comment-16416529 ] Subru Krishnan commented on YARN-8010: -- Thanks [~botong] for the contribution and [~giovanni.fumarola]

[jira] [Updated] (YARN-8010) Add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-8010: - Summary: Add config in FederationRMFailoverProxy to not bypass facade cache when failing over

[jira] [Commented] (YARN-8010) add config in FederationRMFailoverProxy to not bypass facade cache when failing over

2018-03-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399177#comment-16399177 ] Subru Krishnan commented on YARN-8010: -- Thanks [~botong] for the patch and [~giovanni.fumarola] for

[jira] [Assigned] (YARN-7405) [GQ] Bias container allocations based on global view

2018-03-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reassigned YARN-7405: Assignee: Arun Suresh (was: Subru Krishnan) > [GQ] Bias container allocations based on

[jira] [Commented] (YARN-7945) Java Doc error in UnmanagedAMPoolManager for branch-2

2018-02-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370770#comment-16370770 ] Subru Krishnan commented on YARN-7945: -- [~rohithsharma]/[~jlowe], thanks for bringing it to my

[jira] [Comment Edited] (YARN-7945) Java Doc error in UnmanagedAMPoolManager for branch-2

2018-02-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16370770#comment-16370770 ] Subru Krishnan edited comment on YARN-7945 at 2/21/18 12:02 AM:

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-16 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16368055#comment-16368055 ] Subru Krishnan commented on YARN-7934: -- Thanks [~curino] for updating the patch, the latest rev (v4)

[jira] [Commented] (YARN-7934) [GQ] Refactor preemption calculators to allow overriding for Federation Global Algos

2018-02-15 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16366351#comment-16366351 ] Subru Krishnan commented on YARN-7934: -- Thanks [~curino] for the patch, it looks fairly

[jira] [Updated] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode

2018-01-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7508: - Target Version/s: (was: 3.1.0, 2.9.1) > NPE in FiCaSchedulerApp when debug log enabled in

[jira] [Updated] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode

2018-01-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7508: - Fix Version/s: 2.9.1 > NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode >

[jira] [Commented] (YARN-1709) Admission Control: Reservation subsystem

2017-12-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302037#comment-16302037 ] Subru Krishnan commented on YARN-1709: -- [~xingbao], thanks for your interest. I have responded to you

[jira] [Comment Edited] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2017-12-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302033#comment-16302033 ] Subru Krishnan edited comment on YARN-1051 at 12/22/17 10:42 PM: -

[jira] [Commented] (YARN-1051) YARN Admission Control/Planner: enhancing the resource allocation model with time.

2017-12-22 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-1051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16302033#comment-16302033 ] Subru Krishnan commented on YARN-1051: -- [~xingbao], the behavior depends on whether there's any job

[jira] [Updated] (YARN-7630) Fix AMRMToken rollover handling in AMRMProxy

2017-12-14 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7630: - Summary: Fix AMRMToken rollover handling in AMRMProxy (was: Fix AMRMToken handling in AMRMProxy)

[jira] [Updated] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2017-12-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7652: - Description: We (cc [~goiri]/[~botong]) observed that the {{FederationInterceptor}} in

[jira] [Updated] (YARN-7642) Container execution type is not updated after promotion/demotion in NMContext

2017-12-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7642: - Target Version/s: 2.9.1, 3.0.1 > Container execution type is not updated after promotion/demotion

[jira] [Updated] (YARN-7649) RMContainer state transition exception after container update

2017-12-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7649: - Target Version/s: 2.9.1, 3.0.1 > RMContainer state transition exception after container update >

[jira] [Created] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2017-12-13 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7652: Summary: Handle AM register requests asynchronously in FederationInterceptor Key: YARN-7652 URL: https://issues.apache.org/jira/browse/YARN-7652 Project: Hadoop YARN

[jira] [Updated] (YARN-7511) NPE in ContainerLocalizer when localization failed for running container

2017-12-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7511: - Target Version/s: 3.1.0, 2.9.1 > NPE in ContainerLocalizer when localization failed for running

[jira] [Updated] (YARN-7508) NPE in FiCaSchedulerApp when debug log enabled in async-scheduling mode

2017-12-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7508: - Target Version/s: 3.1.0, 2.9.1 > NPE in FiCaSchedulerApp when debug log enabled in

[jira] [Commented] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16284441#comment-16284441 ] Subru Krishnan commented on YARN-7591: -- Thanks [~Tao Yang] for the contribution and [~leftnoteasy] for

[jira] [Updated] (YARN-6704) Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService

2017-12-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6704: - Target Version/s: (was: 3.1.0, 2.9.1) > Add support for work preserving NM restart when

[jira] [Updated] (YARN-6704) Add support for work preserving NM restart when FederationInterceptor is enabled in AMRMProxyService

2017-12-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6704: - Summary: Add support for work preserving NM restart when FederationInterceptor is enabled in

[jira] [Updated] (YARN-5871) Add support for reservation-based routing.

2017-12-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5871: - Parent Issue: YARN-7402 (was: YARN-5597) > Add support for reservation-based routing. >

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-12-05 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16279354#comment-16279354 ] Subru Krishnan commented on YARN-6704: -- Thanks [~botong] for updating the patch and for the

[jira] [Updated] (YARN-7591) NPE in async-scheduling mode of CapacityScheduler

2017-12-01 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7591: - Target Version/s: 2.9.1 > NPE in async-scheduling mode of CapacityScheduler >

[jira] [Commented] (YARN-7509) AsyncScheduleThread and ResourceCommitterService are still running after RM is transitioned to standby

2017-11-27 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16267425#comment-16267425 ] Subru Krishnan commented on YARN-7509: -- [~leftnoteasy], the fix version says 2.9.1 but it has not been

[jira] [Commented] (YARN-7548) TestCapacityOverTimePolicy.testAllocation is flaky

2017-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261646#comment-16261646 ] Subru Krishnan commented on YARN-7548: -- Thanks [~haibo.chen] for reporting this. Adding [~curino] as

[jira] [Commented] (YARN-7551) yarn.resourcemanager.reservation-system.max-periodicity is not in yarn-default.xml

2017-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261641#comment-16261641 ] Subru Krishnan commented on YARN-7551: -- Generally, we have been following the practice of exposing

[jira] [Commented] (YARN-6704) Add Federation Interceptor restart when work preserving NM is enabled

2017-11-21 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16261588#comment-16261588 ] Subru Krishnan commented on YARN-6704: -- Thanks [~botong] for updating the patch. I went through it and

[jira] [Commented] (YARN-7390) All reservation related test cases failed when TestYarnClient runs against Fair Scheduler.

2017-11-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16259991#comment-16259991 ] Subru Krishnan commented on YARN-7390: -- [~yufeigu]/[~haibo.chen], thanks for fixing this. Shouldn't it

[jira] [Updated] (YARN-6645) Bug fix in ContainerImpl when calling the symLink of LinuxContainerExecutor

2017-11-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6645: - Fix Version/s: (was: 2.9.0) 2.9.1 > Bug fix in ContainerImpl when calling

[jira] [Updated] (YARN-7278) LinuxContainer in docker mode will be failed when nodemanager restart, because timeout for docker is too slow.

2017-11-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7278: - Fix Version/s: (was: 2.9.0) 2.9.1 > LinuxContainer in docker mode will be

[jira] [Updated] (YARN-6606) The implementation of LocalizationStatus in ContainerStatusProto

2017-11-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6606: - Fix Version/s: (was: 2.9.0) 2.9.1 > The implementation of

[jira] [Updated] (YARN-6661) Too much CLEANUP event hang ApplicationMasterLauncher thread pool

2017-11-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6661: - Fix Version/s: (was: 2.9.0) 2.9.1 > Too much CLEANUP event hang

[jira] [Updated] (YARN-7190) Ensure only NM classpath in 2.x gets TSv2 related hbase jars, not the user classpath

2017-11-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7190: - Fix Version/s: (was: 2.9.0) 2.9.1 > Ensure only NM classpath in 2.x gets

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-17 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16257858#comment-16257858 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong]. I have committed to trunk but couldn't

[jira] [Updated] (YARN-5075) Fix findbugs warning in hadoop-yarn-common module

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5075: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Fix findbugs warning in

[jira] [Updated] (YARN-5049) Extend NMStateStore to save queued container information

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5049: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Extend NMStateStore to save

[jira] [Updated] (YARN-5073) Refactor startContainerInternal() in ContainerManager to remove unused parameter

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-5073: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Refactor

[jira] [Updated] (YARN-4412) Create ClusterMonitor to compute ordered list of preferred NMs for OPPORTUNITIC containers

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4412: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Create ClusterMonitor to compute

[jira] [Updated] (YARN-4738) Notify the RM about the status of OPPORTUNISTIC containers

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4738: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Notify the RM about the status

[jira] [Updated] (YARN-4991) Fix ContainerRequest Constructor to set nodelabelExpression correctly

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4991: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Fix ContainerRequest Constructor

[jira] [Updated] (YARN-2995) Enhance UI to show cluster resource utilization of various container Execution types

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2995: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha2 > Enhance UI to show cluster

[jira] [Updated] (YARN-4335) Allow ResourceRequests to specify ExecutionType of a request ask

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-4335: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Allow ResourceRequests to

[jira] [Updated] (YARN-2888) Corrective mechanisms for rebalancing NM container queues

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2888: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Corrective mechanisms for

[jira] [Updated] (YARN-2885) Create AMRMProxy request interceptor for distributed scheduling decisions for queueable containers

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2885: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Create AMRMProxy request

[jira] [Updated] (YARN-2883) Queuing of container requests in the NM

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2883: - Fix Version/s: (was: 3.0.0) 3.0.0-alpha1 > Queuing of container requests in

[jira] [Updated] (YARN-2884) Proxying all AM-RM communications

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-2884: - Fix Version/s: (was: 3.0.0) 2.8.0 3.0.0-alpha1 >

[jira] [Comment Edited] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249897#comment-16249897 ] Subru Krishnan edited comment on YARN-6918 at 11/13/17 6:04 PM: Thanks

[jira] [Updated] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6918: - Target Version/s: 2.9.1 > Remove acls after queue delete to avoid memory leak >

[jira] [Commented] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16249897#comment-16249897 ] Subru Krishnan commented on YARN-6918: -- Thanks [~bibinchundatt] for raising this and [~sunilg] for

[jira] [Updated] (YARN-6918) Remove acls after queue delete to avoid memory leak

2017-11-13 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6918: - Priority: Major (was: Critical) > Remove acls after queue delete to avoid memory leak >

[jira] [Resolved] (YARN-7478) TEST-cetest fails in branch-2

2017-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-7478. -- Resolution: Implemented Fix Version/s: 2.9.0 Thanks [~varun_saxena] for bringing this up

[jira] [Comment Edited] (YARN-7476) Fix miscellaneous issues in ATSv2 after merge to branch-2

2017-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248932#comment-16248932 ] Subru Krishnan edited comment on YARN-7476 at 11/12/17 6:03 PM: Thanks

[jira] [Commented] (YARN-7478) TEST-cetest fails in branch-2

2017-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248923#comment-16248923 ] Subru Krishnan commented on YARN-7478: -- Refer to Yetus report in YARN-7476/YARN-5049 etc. >

[jira] [Updated] (YARN-7475) Fix Container log link in new YARN UI

2017-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-7475: - Summary: Fix Container log link in new YARN UI (was: container log link is not working in new

[jira] [Commented] (YARN-5049) Extend NMStateStore to save queued container information

2017-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248919#comment-16248919 ] Subru Krishnan commented on YARN-5049: -- +1 to the addendum patch. Thanks [~varun_saxena] for reporting

[jira] [Created] (YARN-7478) TEST-cetest fails in branch-2

2017-11-12 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7478: Summary: TEST-cetest fails in branch-2 Key: YARN-7478 URL: https://issues.apache.org/jira/browse/YARN-7478 Project: Hadoop YARN Issue Type: Bug

[jira] [Comment Edited] (YARN-7476) Fix miscellaneous issues in ATSv2 after merge to branch-2

2017-11-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248715#comment-16248715 ] Subru Krishnan edited comment on YARN-7476 at 11/11/17 11:07 PM: - Thanks

[jira] [Commented] (YARN-7476) Fix miscellaneous issues in ATSv2 after merge to branch-2

2017-11-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16248715#comment-16248715 ] Subru Krishnan commented on YARN-7476: -- Thanks [~varun_saxena] for the thorough investigation to dig

[jira] [Updated] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan updated YARN-6102: - Attachment: YARN-6102-branch-2.003-addendum.patch > RMActiveService context to be updated with new

[jira] [Reopened] (YARN-6102) RMActiveService context to be updated with new RMContext on failover

2017-11-10 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan reopened YARN-6102: -- Reopening as [~rohithsharma] has another addendum patch due to ATSv2 merge to branch-2. >

[jira] [Commented] (YARN-7466) ResourceRequest has a different default for allocationRequestId than Container

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7466?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246522#comment-16246522 ] Subru Krishnan commented on YARN-7466: -- FWIW, +1 from my side too. Thanks [~csingh]/[~jianhe]. >

[jira] [Commented] (YARN-6128) Add support for AMRMProxy HA

2017-11-09 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16246410#comment-16246410 ] Subru Krishnan commented on YARN-6128: -- Thanks [~botong] for addressing my comments, the latest patch

  1   2   3   4   5   6   7   8   9   10   >