Re: [VOTE] Moving Ozone to a separated Apache project

2020-09-29 Thread Subru Krishnan
+1 Thanks, Subru On Mon, Sep 28, 2020 at 6:49 AM Adam Antal wrote: > +1 > > Thanks, > Adam Antal > > On Mon, Sep 28, 2020 at 2:19 PM 孙立晟 wrote: > > > +1 > > > > Thanks, > > Lisheng Sun > > > > Masatake Iwasaki 于2020年9月28日周一 下午7:19写道: > > > > > +1 > > > > > > Thanks, > > > Masatake Iwasaki >

Re: [DISCUSS] making Ozone a separate Apache project

2020-05-15 Thread Subru Krishnan
+1. Thanks, Subru On Thu, May 14, 2020 at 10:00 PM Akira Ajisaka wrote: > +1 > > -Akira > > On Wed, May 13, 2020 at 4:53 PM Elek, Marton wrote: > > > > > > > I would like to start a discussion to make a separate Apache project for > > Ozone > > > > > > > > ### HISTORY [1] > > > > * Apache

Re: [VOTE] EOL Hadoop branch-2.8

2020-03-03 Thread Subru Krishnan
+1 On Tue, Mar 3, 2020 at 11:43 AM Wangda Tan wrote: > +1 > > On Mon, Mar 2, 2020 at 8:50 PM Akira Ajisaka wrote: > > > +1 > > > > -Akira > > > > On Tue, Mar 3, 2020 at 4:55 AM Ayush Saxena wrote: > > > > > +1 for marking 2.8 EOL > > > > > > -Ayush > > > > > > > On 03-Mar-2020, at 12:18 AM,

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

2019-10-24 Thread Subru Krishnan
+1. Thanks, Subru On Thu, Oct 24, 2019 at 12:51 AM 张铎(Duo Zhang) wrote: > +1 > > Akira Ajisaka 于2019年10月24日周四 下午3:21写道: > > > Hi folks, > > > > Both Ozone and Apache Submarine have separate repositories. > > Can we remove these modules from hadoop-trunk? > > > > Regards, > > Akira > > >

Re: [DISCUSS] Separate Hadoop Core trunk and Hadoop Ozone trunk source tree

2019-09-17 Thread Subru Krishnan
+1 (binding). IIUC, there will not be an Ozone module in trunk anymore as that was my only concern from the original discussion thread? IMHO, this should be the default approach for new modules. On Tue, Sep 17, 2019 at 9:58 AM Salvatore LaMendola (BLOOMBERG/ 731 LEX) < slamendo...@bloomberg.net>

Re: [VOTE] Mark 2.6, 2.7, 3.0 release lines EOL

2019-08-21 Thread Subru Krishnan
+1 On Wed, Aug 21, 2019 at 8:52 AM Kihwal Lee wrote: > +1 > > Kihwal > > On Tue, Aug 20, 2019 at 10:03 PM Wangda Tan wrote: > > > Hi all, > > > > This is a vote thread to mark any versions smaller than 2.7 (inclusive), > > and 3.0 EOL. This is based on discussions of [1] > > > > This

Re: [DISCUSS] Move to gitbox

2018-12-11 Thread Subru Krishnan
+1. On Tue, Dec 11, 2018 at 12:10 AM Mukul Kumar Singh wrote: > +1 > -Mukul > > On 12/11/18, 9:56 AM, "Weiwei Yang" wrote: > > +1 > > On Tue, Dec 11, 2018 at 10:51 AM Anu Engineer < > aengin...@hortonworks.com> > wrote: > > > +1 > > --Anu > > > > > > On

New committer: Botong Huang

2018-11-21 Thread Subru Krishnan
The Project Management Committee (PMC) for Apache Hadoophas invited Botong Huang to become a committer and we are pleased to announce that he has accepted. Being a committer enables easier contribution to theproject since there is no need to go via the patchsubmission process. This should enable

[jira] [Resolved] (YARN-8755) Add clean up for FederationStore apps

2018-09-07 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-8755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-8755. -- Resolution: Duplicate [~bibinchundatt], this should be addressed by YARN-6648 & YARN-7599.

Re: Hadoop 3.2 Release Plan proposal

2018-07-19 Thread Subru Krishnan
Thanks Sunil for volunteering to lead the release effort. I am generally supportive of a release but -1 on a 3.2 (prefer a 3.1.x) as feel we already have too many branches to be maintained. I already see many commits are in different branches with no apparent rationale, for e.g: 3.1 has commits

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-06 Thread Subru Krishnan
ugly for two commits and we can live with it. > > > > > > The revert restored the branch to Giovanni's intent. i.e. only > > > > YARN-8435 is applied. Verified there is no delta between hashes > 0d9804d and > > 39ad989 (HEAD). >

Re: [VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-05 Thread Subru Krishnan
: > >> +1 >> >> On 5 July 2018 at 14:37, Subru Krishnan wrote: >> >> > Folks, >> > >> > There was a merge commit accidentally pushed to trunk, you can find the >> > details in the mail thread [1]. >> > >> > I have raised a

[VOTE] reset/force push to clean up inadvertent merge commit pushed to trunk

2018-07-05 Thread Subru Krishnan
Folks, There was a merge commit accidentally pushed to trunk, you can find the details in the mail thread [1]. I have raised an INFRA ticket [2] to reset/force push to clean up trunk. Can we have a quick vote for INFRA sign-off to proceed as this is blocking all commits? Thanks, Subru [1]

Re: Merge branch commit in trunk by mistake

2018-07-05 Thread Subru Krishnan
Looking at the merge commit, I feel it's better to reset/force push especially since this is still the latest commit on trunk. I have raised an INFRA ticket requesting the same: https://issues.apache.org/jira/browse/INFRA-16727 -S On Thu, Jul 5, 2018 at 11:45 AM, Sean Busbey wrote: > FYI, no

[DISCUSS] 2.9+ stabilization branch

2018-02-26 Thread Subru Krishnan
Folks, We (i.e. Microsoft) have started stabilization of 2.9 for our production deployment. During planning, we realized that we need to backport 3.x features to support GPUs (and more resource types like network IO) natively as part of the upgrade. We'd like to share that work with the

[jira] [Created] (YARN-7652) Handle AM register requests asynchronously in FederationInterceptor

2017-12-13 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7652: Summary: Handle AM register requests asynchronously in FederationInterceptor Key: YARN-7652 URL: https://issues.apache.org/jira/browse/YARN-7652 Project: Hadoop YARN

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC3)

2017-11-17 Thread Subru Krishnan
Wrapping up the vote with my +1. Deployed RC3 on a federated YARN cluster with 6 sub-clusters: - ran multiple sample jobs - enabled opportunistic containers and submitted more samples - configured HDFS federation and reran jobs. With 13 binding +1s and 7 non-binding +1s and no +/-1s, pleased to

[VOTE] Release Apache Hadoop 2.9.0 (RC2)

2017-11-12 Thread Subru Krishnan
Hi Folks, Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the starting release for Apache Hadoop 2.9.x line - it includes 30 New Features with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since 2.8.2. More information about the 2.9.0 release plan can be

[jira] [Resolved] (YARN-7478) TEST-cetest fails in branch-2

2017-11-12 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-7478. -- Resolution: Implemented Fix Version/s: 2.9.0 Thanks [~varun_saxena] for bringing this up

[jira] [Created] (YARN-7478) TEST-cetest fails in branch-2

2017-11-12 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7478: Summary: TEST-cetest fails in branch-2 Key: YARN-7478 URL: https://issues.apache.org/jira/browse/YARN-7478 Project: Hadoop YARN Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC1)

2017-11-10 Thread Subru Krishnan
sic DFS operations. > > Thanks, > Mukul > > > > > > > On 10/11/17, 7:09 AM, "Subru Krishnan" <su...@apache.org> wrote: > > >Hi Folks, > > > >Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be > the > &g

[VOTE] Release Apache Hadoop 2.9.0 (RC1)

2017-11-09 Thread Subru Krishnan
Hi Folks, Apache Hadoop 2.9.0 is the first release of Hadoop 2.9 line and will be the starting release for Apache Hadoop 2.9.x line - it includes 30 New Features with 500+ subtasks, 407 Improvements, 790 Bug fixes new fixed issues since 2.8.2 . More information about the 2.9.0 release plan can

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-09 Thread Subru Krishnan
ust add to your voting thread and release notes > that 2.9.0 still needs to be tested downstream and so users may want to > wait for subsequent point releases. > > Thanks > +Vinod > > > On Nov 8, 2017, at 12:43 AM, Subru Krishnan <su...@apache.org> wrote: > > >

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC0)

2017-11-08 Thread Subru Krishnan
We are canceling the RC due to the issue that Rohith/Sunil identified. The issue was difficult to track down as it only happens when you use IP for ZK (works fine with host names) and moreover if ZK and RM are co-located on same machine. We are hopeful to get the fix in tomorrow and roll out RC1.

Re: Cutting branch-2.9

2017-11-03 Thread Subru Krishnan
rated thread. > >> > >> Thanks, > >> > >> Junping > >> > >> 2017-10-31 13:44 GMT-07:00 Arun Suresh <asur...@apache.org>: > >> > >>> Hello folks > >>> > >>> We just cut branch-2.9 since all the cri

[jira] [Created] (YARN-7434) Router getApps REST invocation fails with multiple RMs

2017-11-02 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7434: Summary: Router getApps REST invocation fails with multiple RMs Key: YARN-7434 URL: https://issues.apache.org/jira/browse/YARN-7434 Project: Hadoop YARN

Re: Cutting branch-2.9

2017-10-31 Thread Subru Krishnan
@Junping, lets move the jdiff conversation to separate thread. >> >> Cheers >> -Arun/Subru >> >> On Mon, Oct 30, 2017 at 12:39 PM, Subru Krishnan <su...@apache.org> >> wrote: >> >> > We want to give heads up that we are going to cut branch-2.9 t

Cutting branch-2.9

2017-10-30 Thread Subru Krishnan
We want to give heads up that we are going to cut branch-2.9 tomorrow morning. We are down to 3 blockers and they all are close to being committed (thanks everyone): https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.9+Release There are 4 other non-blocker JIRAs that are targeted for

[jira] [Resolved] (YARN-5326) Support for recurring reservations in the YARN ReservationSystem

2017-10-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-5326. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.1.0

[jira] [Created] (YARN-7398) LICENSE.txt is broken in branch-2 by YARN-4849

2017-10-25 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-7398: Summary: LICENSE.txt is broken in branch-2 by YARN-4849 Key: YARN-7398 URL: https://issues.apache.org/jira/browse/YARN-7398 Project: Hadoop YARN Issue Type

2.9.0 status update (10/20/2017)

2017-10-20 Thread Subru Krishnan
Today was the feature freeze date and we are glad to inform that all the major planned features are merged in branch-2: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-Plannedfeatures : Kudos to everyone who pulled through multiple blockers and made this happen. Special

[jira] [Resolved] (YARN-4879) Enhance Allocate Protocol to Identify Requests Explicitly

2017-10-03 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-4879. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

2.9.0 Status Update [09/2017]

2017-09-29 Thread Subru Krishnan
Folks, Quick update on 2.9.0 release. Looks like we are looking at around a week of delay in the feature freeze: https://cwiki.apache.org/confluence/display/HADOOP/Roadmap For feature owners, where the status is: 1. Green - no action required at this point. 2. Orange - revert with

[jira] [Resolved] (YARN-2915) Enable YARN RM scale out via federation using multiple RM's

2017-09-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-2915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-2915. -- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-beta1

[HEADS-UP] Merge Federation (YARN-2915) into branch-2

2017-09-15 Thread Subru Krishnan
Folks, We are almost done with the UI patch and so will be merging Federation (YARN-2915) from trunk to branch-2 in the next week or so. Just want to give a heads-up to avoid any awkward surprises, though unlikely :). Cheers, Subru

[jira] [Resolved] (YARN-7097) Federation: routing ClientRM invocations transparently to multiple RMs (part 5 - getNode/getNodes/getMetrics)

2017-08-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-7097. -- Resolution: Duplicate Fix Version/s: 3.0.0-beta1 > Federation: routing Clien

[jira] [Resolved] (YARN-7096) Federation: routing ClientRM invocations transparently to multiple RMs (part 2 - getApps)

2017-08-31 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-7096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-7096. -- Resolution: Implemented > Federation: routing ClientRM invocations transparently to multiple

Re: [Vote] merge feature branch YARN-2915 (Federation) to trunk

2017-08-01 Thread Subru Krishnan
:22 PM, varunsax...@apache.org < varun.saxena.apa...@gmail.com> wrote: > +1. > Looking forward to it. > > Regards, > Varun Saxena. > > On Wed, Jul 26, 2017 at 8:54 AM, Subru Krishnan <su...@apache.org> wrote: > > > Hi all, > > > > Per earlier

Re: [Vote] merge feature branch YARN-2915 (Federation) to trunk

2017-08-01 Thread Subru Krishnan
it work? > > Daniel > > On 7/25/17 8:24 PM, Subru Krishnan wrote: > >> Hi all, >> >> Per earlier discussion [9], I'd like to start a formal vote to merge >> feature YARN Federation (YARN-2915) [1] to trunk. The vote will run for 7 >> days, and will e

Re: [Vote] merge feature branch YARN-2915 (Federation) to trunk

2017-07-31 Thread Subru Krishnan
re. Hoping to see it 2.9 too. > > > > On Tue, Aug 1, 2017 at 1:31 AM, Jason Lowe <jl...@yahoo-inc.com.invalid> > > wrote: > > > > > +1 > > > Jason > > > > > > > > > On Tuesday, July 25, 2017 10:24 PM, Subru Krishnan < >

[jira] [Created] (YARN-6900) ZooKeeper based implementation of the FederationStateStore

2017-07-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6900: Summary: ZooKeeper based implementation of the FederationStateStore Key: YARN-6900 URL: https://issues.apache.org/jira/browse/YARN-6900 Project: Hadoop YARN

[Vote] merge feature branch YARN-2915 (Federation) to trunk

2017-07-25 Thread Subru Krishnan
Hi all, Per earlier discussion [9], I'd like to start a formal vote to merge feature YARN Federation (YARN-2915) [1] to trunk. The vote will run for 7 days, and will end Aug 1 7PM PDT. We have been developing the feature in a branch (YARN-2915 [2]) for a while, and we are reasonably confident

[jira] [Created] (YARN-6866) Minor clean-up and fixes in anticipation of merge with trunk

2017-07-24 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6866: Summary: Minor clean-up and fixes in anticipation of merge with trunk Key: YARN-6866 URL: https://issues.apache.org/jira/browse/YARN-6866 Project: Hadoop YARN

[DISCUSS] Looking to a 2.9.0 release

2017-07-24 Thread Subru Krishnan
Folks, With the release for 2.8, we would like to look ahead to 2.9 release as there are many features/improvements in branch-2 (about 1062 commits), that are in need of a release vechile. Here's our first cut of the proposal from the YARN side: 1. Scheduler improvements (decoupling

[jira] [Created] (YARN-6821) Move FederationStateStore SQL DDL files from test to main

2017-07-13 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6821: Summary: Move FederationStateStore SQL DDL files from test to main Key: YARN-6821 URL: https://issues.apache.org/jira/browse/YARN-6821 Project: Hadoop YARN

[jira] [Created] (YARN-6815) [Bug] FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not

2017-07-12 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6815: Summary: [Bug] FederationStateStoreFacade return behavior should be consistent irrespective of whether caching is enabled or not Key: YARN-6815 URL: https://issues.apache.org

[jira] [Created] (YARN-6807) Adding required missing configs to Federation configuration guide based on e2e testing

2017-07-11 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6807: Summary: Adding required missing configs to Federation configuration guide based on e2e testing Key: YARN-6807 URL: https://issues.apache.org/jira/browse/YARN-6807

Re: [DISCUSS] merging YARN-2915 (Federation) to trunk

2017-06-27 Thread Subru Krishnan
ication Subru. I am in favor of moving forward. >> >> >> Sangjin >> >> On Thu, Jun 22, 2017 at 6:21 PM, Karthik Shashank Kambatla < >> ka...@cloudera.com> wrote: >> >> > Given RTC and the amount of production testing this feature has >> r

Re: [DISCUSS] merging YARN-2915 (Federation) to trunk

2017-06-22 Thread Subru Krishnan
Carlo et al. >> I think we should proceed with a merge vote. >> >> Cheers >> -Arun >> >> On Tue, Jun 20, 2017 at 4:28 PM, Subru Krishnan <su...@apache.org> wrote: >> >> > Hi all, >> > >> > We would like to open a d

[DISCUSS] merging YARN-2915 (Federation) to trunk

2017-06-20 Thread Subru Krishnan
Hi all, We would like to open a discussion on merging the YARN Federation (YARN-2915) [1] feature to trunk. We have been developing the feature in a feature branch (YARN-2915 [2]) for a while, and we are reasonably confident that the state of the feature meets the criteria to be merged onto

[jira] [Created] (YARN-6724) Add ability to blacklist sub-clusters when invoking Routing policies

2017-06-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6724: Summary: Add ability to blacklist sub-clusters when invoking Routing policies Key: YARN-6724 URL: https://issues.apache.org/jira/browse/YARN-6724 Project: Hadoop

[jira] [Created] (YARN-6691) Update YARN daemon startup/shutdown scripts to include Router service

2017-06-05 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6691: Summary: Update YARN daemon startup/shutdown scripts to include Router service Key: YARN-6691 URL: https://issues.apache.org/jira/browse/YARN-6691 Project: Hadoop

[jira] [Created] (YARN-6687) Validate that the duration of the periodic reservation is less than the periodicity

2017-06-02 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6687: Summary: Validate that the duration of the periodic reservation is less than the periodicity Key: YARN-6687 URL: https://issues.apache.org/jira/browse/YARN-6687

[jira] [Resolved] (YARN-6485) [Regression] TestFederationRMStateStoreService is failing with null pointer exception

2017-05-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-6485. -- Resolution: Works for Me Fix Version/s: YARN-2915 I am closing this as I ran

[jira] [Created] (YARN-6634) [API] Define an API for ResourceManager WebServices

2017-05-22 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6634: Summary: [API] Define an API for ResourceManager WebServices Key: YARN-6634 URL: https://issues.apache.org/jira/browse/YARN-6634 Project: Hadoop YARN Issue

[jira] [Created] (YARN-6542) Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent

2017-05-01 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6542: Summary: Fix the logger in TestAlignedPlanner and TestGreedyReservationAgent Key: YARN-6542 URL: https://issues.apache.org/jira/browse/YARN-6542 Project: Hadoop YARN

[jira] [Created] (YARN-6541) Optimize {{PeriodicRLESparseResourceAllocation}} by auto-expanding it's time period

2017-05-01 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6541: Summary: Optimize {{PeriodicRLESparseResourceAllocation}} by auto-expanding it's time period Key: YARN-6541 URL: https://issues.apache.org/jira/browse/YARN-6541

[jira] [Created] (YARN-6485) [Regression] TestFederationRMStateStoreService is failing with null pointer exception

2017-04-14 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6485: Summary: [Regression] TestFederationRMStateStoreService is failing with null pointer exception Key: YARN-6485 URL: https://issues.apache.org/jira/browse/YARN-6485

[jira] [Created] (YARN-6484) [Documentation] Documenting the YARN Federation feature

2017-04-14 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6484: Summary: [Documentation] Documenting the YARN Federation feature Key: YARN-6484 URL: https://issues.apache.org/jira/browse/YARN-6484 Project: Hadoop YARN

Re: Two AMs in one YARN container?

2017-03-17 Thread Subru Krishnan
Thanks Arun for the heads-up. Hi Sergiy, We do run an UAM pool under one process (AMRMProxyService in NM) as that's the mechanism we use to span a single job across multiple clusters that are under federation. This is achieved by using the doAs method in UserGroupInformation, exactly as Jason

[jira] [Created] (YARN-6234) Support multiple attempts on the node when AMRMProxy is enabled

2017-02-24 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6234: Summary: Support multiple attempts on the node when AMRMProxy is enabled Key: YARN-6234 URL: https://issues.apache.org/jira/browse/YARN-6234 Project: Hadoop YARN

[jira] [Created] (YARN-6128) Add support for AMRMProxy HA

2017-01-27 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6128: Summary: Add support for AMRMProxy HA Key: YARN-6128 URL: https://issues.apache.org/jira/browse/YARN-6128 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-6127) Add support for work preserving NM restart when AMRMProxy is enabled

2017-01-27 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-6127: Summary: Add support for work preserving NM restart when AMRMProxy is enabled Key: YARN-6127 URL: https://issues.apache.org/jira/browse/YARN-6127 Project: Hadoop

[jira] [Resolved] (YARN-6083) Add doc for reservation in Fair Scheduler

2017-01-11 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-6083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-6083. -- Resolution: Duplicate [~yufeigu], IIUC this is a duplicate of YARN-4827. I already have a draft

[jira] [Created] (YARN-5905) Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP

2016-11-17 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5905: Summary: Update the RM webapp host that is reported as part of Federation membership to current primary RM's IP Key: YARN-5905 URL: https://issues.apache.org/jira/browse/YARN

[jira] [Created] (YARN-5904) Reduce the number of server threads for AMRMProxy

2016-11-17 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5904: Summary: Reduce the number of server threads for AMRMProxy Key: YARN-5904 URL: https://issues.apache.org/jira/browse/YARN-5904 Project: Hadoop YARN Issue

YARN bug bash summary

2016-10-28 Thread Subru Krishnan
Folks, First up big thanks to everyone who turned up and participated enthusiastically for the YARN bug bash event. A special shout out to Sunil for organizing a parallel event in Bangalore, that too on a very short notice. It was great to see people from such a wide range of companies

[jira] [Created] (YARN-5711) AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider

2016-10-05 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5711: Summary: AM cannot reconnect to RM after failover when using RequestHedgingRMFailoverProxyProvider Key: YARN-5711 URL: https://issues.apache.org/jira/browse/YARN-5711

[jira] [Created] (YARN-5702) Refactor TestPBImplRecords so that we can reuse for testing protocol records in other YARN modules

2016-10-03 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5702: Summary: Refactor TestPBImplRecords so that we can reuse for testing protocol records in other YARN modules Key: YARN-5702 URL: https://issues.apache.org/jira/browse/YARN-5702

[jira] [Created] (YARN-5604) Add versioning for FederationStateStore

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5604: Summary: Add versioning for FederationStateStore Key: YARN-5604 URL: https://issues.apache.org/jira/browse/YARN-5604 Project: Hadoop YARN Issue Type: Sub

[jira] [Created] (YARN-5603) Metrics for Federation entities like StateStore/Router/AMRMProxy

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5603: Summary: Metrics for Federation entities like StateStore/Router/AMRMProxy Key: YARN-5603 URL: https://issues.apache.org/jira/browse/YARN-5603 Project: Hadoop YARN

[jira] [Created] (YARN-5601) Make the RM epoch base value configurable

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5601: Summary: Make the RM epoch base value configurable Key: YARN-5601 URL: https://issues.apache.org/jira/browse/YARN-5601 Project: Hadoop YARN Issue Type: Sub

[jira] [Created] (YARN-5597) YARN Federation phase 2

2016-08-30 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5597: Summary: YARN Federation phase 2 Key: YARN-5597 URL: https://issues.apache.org/jira/browse/YARN-5597 Project: Hadoop YARN Issue Type: Improvement

[jira] [Resolved] (YARN-3665) Federation subcluster membership mechanisms

2016-08-30 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-3665. -- Resolution: Implemented Hadoop Flags: Reviewed Closing this as YARN-3671 includes this too

[jira] [Created] (YARN-5531) UnmanagedAM pool manager for federating application across clusters

2016-08-16 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5531: Summary: UnmanagedAM pool manager for federating application across clusters Key: YARN-5531 URL: https://issues.apache.org/jira/browse/YARN-5531 Project: Hadoop YARN

[jira] [Created] (YARN-5467) InputValidator for the FederationStateStore internal APIs

2016-08-02 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5467: Summary: InputValidator for the FederationStateStore internal APIs Key: YARN-5467 URL: https://issues.apache.org/jira/browse/YARN-5467 Project: Hadoop YARN

[jira] [Created] (YARN-5447) Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover

2016-07-28 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5447: Summary: Consider including allocationRequestId in NMContainerStatus to allow recovery in case of RM failover Key: YARN-5447 URL: https://issues.apache.org/jira/browse/YARN-5447

[jira] [Created] (YARN-5441) Fixing minor Scheduler test case failures

2016-07-27 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5441: Summary: Fixing minor Scheduler test case failures Key: YARN-5441 URL: https://issues.apache.org/jira/browse/YARN-5441 Project: Hadoop YARN Issue Type: Bug

[jira] [Resolved] (YARN-3927) Make the NodeManager's ContainerManager pluggable

2016-07-20 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-3927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-3927. -- Resolution: Workaround We ended up adding AMRMProxy as a first class service in NM. > M

[jira] [Created] (YARN-5413) Create a proxy chain for ResourceManager Admin API in the Router

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5413: Summary: Create a proxy chain for ResourceManager Admin API in the Router Key: YARN-5413 URL: https://issues.apache.org/jira/browse/YARN-5413 Project: Hadoop YARN

[jira] [Created] (YARN-5412) Create a proxy chain for ResourceManager REST API in the Router

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5412: Summary: Create a proxy chain for ResourceManager REST API in the Router Key: YARN-5412 URL: https://issues.apache.org/jira/browse/YARN-5412 Project: Hadoop YARN

[jira] [Created] (YARN-5411) Create a proxy for ApplicationClientProtocol in the Router

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5411: Summary: Create a proxy for ApplicationClientProtocol in the Router Key: YARN-5411 URL: https://issues.apache.org/jira/browse/YARN-5411 Project: Hadoop YARN

[jira] [Created] (YARN-5410) Bootstrap Router module

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5410: Summary: Bootstrap Router module Key: YARN-5410 URL: https://issues.apache.org/jira/browse/YARN-5410 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5408) In-memory based implementation of the FederationPolicyStore

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5408: Summary: In-memory based implementation of the FederationPolicyStore Key: YARN-5408 URL: https://issues.apache.org/jira/browse/YARN-5408 Project: Hadoop YARN

[jira] [Created] (YARN-5407) In-memory based implementation of the FederationMembershipStateStore

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5407: Summary: In-memory based implementation of the FederationMembershipStateStore Key: YARN-5407 URL: https://issues.apache.org/jira/browse/YARN-5407 Project: Hadoop

[jira] [Created] (YARN-5406) In-memory based implementation of the FederationMembershipStateStore

2016-07-20 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5406: Summary: In-memory based implementation of the FederationMembershipStateStore Key: YARN-5406 URL: https://issues.apache.org/jira/browse/YARN-5406 Project: Hadoop

[jira] [Created] (YARN-5331) Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5331: Summary: Extend RLESparseResourceAllocation with period for supporting recurring reservations in YARN ReservationSystem Key: YARN-5331 URL: https://issues.apache.org/jira/browse

[jira] [Created] (YARN-5330) SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5330: Summary: SharingPolicy enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5330 URL: https://issues.apache.org/jira/browse/YARN-5330

[jira] [Created] (YARN-5329) ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5329: Summary: ReservationAgent enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5329 URL: https://issues.apache.org/jira/browse/YARN

[jira] [Created] (YARN-5328) InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5328: Summary: InMemoryPlan enhancements required to support recurring reservations in the YARN ReservationSystem Key: YARN-5328 URL: https://issues.apache.org/jira/browse/YARN-5328

[jira] [Created] (YARN-5327) API changes required to support recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5327: Summary: API changes required to support recurring reservations in the YARN ReservationSystem Key: YARN-5327 URL: https://issues.apache.org/jira/browse/YARN-5327

[jira] [Created] (YARN-5326) Add support for recurring reservations in the YARN ReservationSystem

2016-07-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5326: Summary: Add support for recurring reservations in the YARN ReservationSystem Key: YARN-5326 URL: https://issues.apache.org/jira/browse/YARN-5326 Project: Hadoop

[jira] [Created] (YARN-5307) Federation Application State APIs

2016-07-01 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5307: Summary: Federation Application State APIs Key: YARN-5307 URL: https://issues.apache.org/jira/browse/YARN-5307 Project: Hadoop YARN Issue Type: Sub-task

[jira] [Created] (YARN-5300) Exclude generated federation protobuf sources from YARN Javadoc build

2016-06-27 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5300: Summary: Exclude generated federation protobuf sources from YARN Javadoc build Key: YARN-5300 URL: https://issues.apache.org/jira/browse/YARN-5300 Project: Hadoop

[jira] [Created] (YARN-5225) Move to a simple clean AMRMClientImpl (v2)

2016-06-09 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5225: Summary: Move to a simple clean AMRMClientImpl (v2) Key: YARN-5225 URL: https://issues.apache.org/jira/browse/YARN-5225 Project: Hadoop YARN Issue Type: Sub

[jira] [Created] (YARN-5203) Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API

2016-06-06 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5203: Summary: Return ResourceRequest JAXB object in ResourceManager Cluster Applications REST API Key: YARN-5203 URL: https://issues.apache.org/jira/browse/YARN-5203

[jira] [Resolved] (YARN-5137) Make DiskChecker pluggable

2016-05-25 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-5137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-5137. -- Resolution: Duplicate I am closing this as a duplicate of YARN-4271 as that covers the pluggable

[jira] [Created] (YARN-5132) Exclude generated protobuf sources from YARN Javadoc build

2016-05-23 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-5132: Summary: Exclude generated protobuf sources from YARN Javadoc build Key: YARN-5132 URL: https://issues.apache.org/jira/browse/YARN-5132 Project: Hadoop YARN

[jira] [Created] (YARN-4957) Add getNewReservation in ApplicationClientProtocol

2016-04-13 Thread Subru Krishnan (JIRA)
Subru Krishnan created YARN-4957: Summary: Add getNewReservation in ApplicationClientProtocol Key: YARN-4957 URL: https://issues.apache.org/jira/browse/YARN-4957 Project: Hadoop YARN Issue

[jira] [Resolved] (YARN-4903) Document how to pass ReservationId through the RM REST API

2016-04-08 Thread Subru Krishnan (JIRA)
[ https://issues.apache.org/jira/browse/YARN-4903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Subru Krishnan resolved YARN-4903. -- Resolution: Duplicate Closing as duplicate YARN-4625 includes updates to the documentation

  1   2   >