Re: Hadoop 3.2 Release Plan proposal

Hi Folks, Given all blockers are closed now, I am planning to do RC1 tomorrow. branch-3.2.0 remains closed for commit. Please let me know if any issues are missed. Thanks, Sunil G On Tue, Nov 13, 2018 at 8:11 PM Sunil G wrote: > Hi Folks, > > All blockers are closed by last weekend and

Re: Hadoop 3.2 Release Plan proposal

Hi Folks, All blockers are closed by last weekend and corrected jiras as well. Preparing RC0 now. Facing some issue with shaded jars file size. Hence respinning again. Planning to complete this by end of this week. Thanks Sunil On Fri, Oct 26, 2018 at 2:34 AM Konstantin Shvachko wrote: >

Re: Hadoop 3.2 Release Plan proposal

Another thing is that I see a bunch of jiras under HDFS-8707, which don't have the Fix Version field listing 3.2, some have it just empty. This means they will not be populated into release notes. Thanks, --Konstantin On Thu, Oct 25, 2018 at 7:59 AM Sunil G wrote: > Thanks Konstantin for

Re: Hadoop 3.2 Release Plan proposal

Thanks Konstantin for pointing out. As 3.2 is pretty much on RC level, its better we try to find a good solution to this issue. I ll follow up on this in the jira. - Sunil On Thu, Oct 25, 2018 at 11:35 AM Konstantin Shvachko wrote: > I've tried to attract attention to an incompatibility issue

Re: Hadoop 3.2 Release Plan proposal

I've tried to attract attention to an incompatibility issue through the jira, but it didn't work. So pitching in in this thread. https://issues.apache.org/jira/browse/HDFS-12026 It introduced binary incompatibility, which will prevent people from upgrading from 3.1 to 3.2. I think it can get messy

Re: Hadoop 3.2 Release Plan proposal

its in. good catch! On 20 Oct 2018, at 01:35, Wei-Chiu Chuang mailto:weic...@cloudera.com>> wrote: Thanks Sunil G for driving the release, I filed HADOOP-15866 for a compat fix. If any one has cycle please review it, as I think it is needed

Re: Hadoop 3.2 Release Plan proposal

Thanks Sunil G for driving the release, I filed HADOOP-15866 for a compat fix. If any one has cycle please review it, as I think it is needed for 3.2.0. On Thu, Oct 18, 2018 at 4:43 AM Sunil G wrote: > Hi Folks, > > As we previously

Re: Hadoop 3.2 Release Plan proposal

Hi Folks, We are now close to RC as other blocker issues are now merged to trunk and branch-3.2. Last 2 critical issues are closer to merge and will be committed in few hours. With this, I will be creating 3.2.0 branch today and will go ahead with RC related process. - Sunil On Mon, Oct 15,

Re: Hadoop 3.2 Release Plan proposal

Hello, were there any updates around the 3.2.0 RC timing? All I see in the current blockers are related to the new Submarine subproject, wasn't sure if that is what is holding things up. Cheers, Jon On Tue, Oct 2, 2018 at 7:13 PM, Sunil G wrote: > Thanks Robert and Haibo for quickly correcting

Re: Hadoop 3.2 Release Plan proposal

Thanks Robert and Haibo for quickly correcting same. Sigh, I somehow missed one file while committing the change. Sorry for the trouble. - Sunil On Wed, Oct 3, 2018 at 5:22 AM Robert Kanter wrote: > Looks like there's two that weren't updated: > >> [115] 16:32 : hadoop-common (trunk) :: grep

Re: Hadoop 3.2 Release Plan proposal

Looks like there's two that weren't updated: >> [115] 16:32 : hadoop-common (trunk) :: grep "3.2.0-SNAPSHOT" . -r --include=pom.xml ./hadoop-project/pom.xml: 3.2.0-SNAPSHOT ./pom.xml:3.2.0-SNAPSHOT I've just pushed in an addendum commit to fix those. In the future, please make sure to do a

Re: Hadoop 3.2 Release Plan proposal

Trunk is not building for me.. Did you miss a 3.2.0-SNAPSHOT in the top-level pom.xml? On Tue, Oct 2, 2018 at 10:16 AM Sunil G wrote: > Hi All > > As mentioned in earlier mail, I have cut branch-3.2 and reset trunk to > 3.3.0-SNAPSHOT. I will share the RC details sooner once all necessary >

Re: Hadoop 3.2 Release Plan proposal

Hi All As mentioned in earlier mail, I have cut branch-3.2 and reset trunk to 3.3.0-SNAPSHOT. I will share the RC details sooner once all necessary patches are pulled into branch-3.2. Thank You - Sunil On Mon, Sep 24, 2018 at 2:00 PM Sunil G wrote: > Hi All > > We are now down to the last

Re: Hadoop 3.2 Release Plan proposal

Hi All We are now down to the last Blocker and HADOOP-15407 is merged to trunk. Thanks for the support. *Plan for RC* 3.2 branch cut and reset trunk : *25th Tuesday* RC0 for 3.2: *28th Friday* Thank You Sunil On Mon, Sep 17, 2018 at 3:21 PM Sunil G wrote: > Hi All > > We are down to 3

Re: Hadoop 3.2 Release Plan proposal

Hi All We are down to 3 Blockers and 4 Critical now. Thanks all of you for helping in this. I am following up on these tickets, once its closed we will cut the 3.2 branch. Thanks Sunil Govindan On Wed, Sep 12, 2018 at 5:10 PM Sunil G wrote: > Hi All, > > Inline with the original 3.2

Re: Hadoop 3.2 Release Plan proposal

Hi All, Inline with the original 3.2 communication proposal dated 17th July 2018, I would like to provide more updates. We are approaching previously proposed code freeze date (September 14, 2018). So I would like to cut 3.2 branch on 17th Sept and point existing trunk to 3.3 if there are no

Re: Hadoop 3.2 Release Plan proposal

Hi Sunil, Quick correction on the task list (missed this earlier) -- HDFS-12615 is being done by Inigo Goiri -Virajith On Thu, Aug 30, 2018 at 9:30 AM Sunil G wrote: > Hi All, > > Inline with earlier communication dated 17th July 2018, I would like to > provide some updates. > > We are

Re: Hadoop 3.2 Release Plan proposal

Hi All, Inline with earlier communication dated 17th July 2018, I would like to provide some updates. We are approaching previously proposed code freeze date (Aug 31). One of the critical feature Node Attributes feature merge discussion/vote is ongoing. Also few other Blocker bugs need a bit

Re: Hadoop 3.2 Release Plan proposal

Hi All, Thanks for the feedbacks. Inline with earlier communication dated 17th July 2018, I would like to provide some updates. We are approaching previously proposed feature freeze date (Aug 21, about 7 days from today). If any features in branch which are targeted to 3.2.0, please reply to

Re: Hadoop 3.2 Release Plan proposal

Thanks Sunil for volunteering to lead the release effort. I am generally supportive of a release but -1 on a 3.2 (prefer a 3.1.x) as feel we already have too many branches to be maintained. I already see many commits are in different branches with no apparent rationale, for e.g: 3.1 has commits

Re: Hadoop 3.2 Release Plan proposal

Thanks Steve, Aaron, Wangda for sharing thoughts. Yes, important changes and features are much needed, hence we will be keeping the door open for them as possible. Also considering few more offline requests from other folks, I think extending the timeframe by couple of weeks makes sense

Re: Hadoop 3.2 Release Plan proposal

Thanks Sunil for volunteering to be RM of 3.2 release, +1 for that. To concerns from Steve, It is a good idea to keep the door open to get important changes / features in before cutoff. I would prefer to keep the proposed release date to make sure things can happen earlier instead of last minute

Re: Hadoop 3.2 Release Plan proposal

On Tue, Jul 17, 2018 at 7:21 PM Steve Loughran wrote: > > > On 16 Jul 2018, at 23:45, Sunil G sun...@apache.org>> wrote: > > I would also would like to take this opportunity to come up with a detailed > plan. > > - Feature freeze date : all features should be merged by August 10, 2018. > > > >

Re: Hadoop 3.2 Release Plan proposal

On 16 Jul 2018, at 23:45, Sunil G mailto:sun...@apache.org>> wrote: I would also would like to take this opportunity to come up with a detailed plan. - Feature freeze date : all features should be merged by August 10, 2018. That's three weeks from now. While I appreciate a faster cadence,

Re: Hadoop 3.2 Release Plan proposal

Hi Sunil, For YARN service and docker related work, I like to propose the following features to be merged: YARN-7129 Application Catalog for YARN applications YARN-7512 Support service upgrade via YARN Service API and CLI YARN-8220 Running Tensorflow on YARN with GPU and Docker - Examples

Hadoop 3.2 Release Plan proposal

Hi All, To continue a faster cadence of releases to accommodate more features, we could plan a Hadoop 3.2 release around August end. To start the process sooner, and to establish a timeline, I propose to target Hadoop 3.2.0 release by August end 2018. (About 1.5 months from now). I would