Re: Hadoop 3.3 Release Plan Proposal
*Important update: *branch-3.3 has created. and now trunk is to target to 3.4.0 ( As per above plan). ( will send in another mail with subject and post in slack group also.) Please merge any critical or blocker issues to branch-3.3 also. Thanks. On Tue, Mar 24, 2020 at 11:34 PM Brahma Reddy Battula wrote: > > Critical and blockers issues came down[1]. > > Planning the cut branch-3.3 this weekend and start release vote on next > weekend. > > > > 1. project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, > Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 ORDER > BY priority DESC > > > > On Thu, Feb 27, 2020 at 12:42 AM Brahma Reddy Battula > wrote: > >> Hi All, >> >> Inline with the original 3.3.0 communication proposal dated 8th Jan 2020, >> I would like to provide more updates[1]. >> >> We are approaching previously proposed code freeze date (March 10,2020). >> So I would like to cut 3.3 branch on *10th March* and point existing *trunk >> to 3.4* if there are no issues. >> >> *Current Release Plan:* >> >> *Feature freeze Date *: all features to merge by Feb 28, 2020.( it's >> almost done) >> *Code freeze Date *: blockers/critical only, no improvements and >> blocker/critical bug-fixes March 10, 2020 [2] ( as of now only 12 issues >> are there which are very old and I am tracking same.) >> *Release Date*: March 15, 2020. >> >> *Please let me know if I missed anything.* >> >> 1. >> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0 >> 2.project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, >> Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 ORDER >> BY priority DESC >> >> >> On Wed, Jan 22, 2020 at 11:22 PM Brahma Reddy Battula < >> brbapa...@gmail.com> wrote: >> >>> >>> Wiki was updated for 3.3 >>> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0 >>> . >>> >>> >>> >I'll move out anything that isn't needed. >>> >>> thanks steve. >>> >>> > We need to fix the shaded protobuf in >>> > Token issue to even get spark to compile. >>> >>> Looks this is done. https://issues.apache.org/jira/browse/HADOOP-16621 >>> >>> On Wed, Jan 8, 2020 at 7:41 PM Steve Loughran >>> wrote: >>> > > 2. Features close to finish: > > > *HADOOP-15620: Über-jira: S3A phase VI: Hadoop 3.3 features. ( owner > : Steve Loughran) > *HADOOP-15763: Über-JIRA: abfs phase II: Hadoop 3.3 features & > fixes. ( owner : Steve Loughran) > *HADOOP-15619:Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features. ( > owner : Steve Loughran) > > I'll move out anything that isn't needed. FWIW, most of these are in CDP 1.x, so there's been reasonable testing and I've got some provisional tuning to do. That is -if things didn't work in the test/production deployments, I'd know about the regressions (e.g. HADOOP-16751). This is S3A and ABFS code -no idea about the rest, and inevitably the big JAR changes will have surprises. We need to fix the shaded protobuf in Token issue to even get spark to compile. -Steve > > >>> >>> >>> -- >>> --Brahma Reddy Battula >>> >> >> >> -- >> >> >> >> --Brahma Reddy Battula >> > > > -- > > > > --Brahma Reddy Battula > -- --Brahma Reddy Battula
Re: Hadoop 3.3 Release Plan Proposal
Critical and blockers issues came down[1]. Planning the cut branch-3.3 this weekend and start release vote on next weekend. 1. project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 ORDER BY priority DESC On Thu, Feb 27, 2020 at 12:42 AM Brahma Reddy Battula wrote: > Hi All, > > Inline with the original 3.3.0 communication proposal dated 8th Jan 2020, > I would like to provide more updates[1]. > > We are approaching previously proposed code freeze date (March 10,2020). > So I would like to cut 3.3 branch on *10th March* and point existing *trunk > to 3.4* if there are no issues. > > *Current Release Plan:* > > *Feature freeze Date *: all features to merge by Feb 28, 2020.( it's > almost done) > *Code freeze Date *: blockers/critical only, no improvements and > blocker/critical bug-fixes March 10, 2020 [2] ( as of now only 12 issues > are there which are very old and I am tracking same.) > *Release Date*: March 15, 2020. > > *Please let me know if I missed anything.* > > 1. > https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0 > 2.project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, > Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 ORDER > BY priority DESC > > > On Wed, Jan 22, 2020 at 11:22 PM Brahma Reddy Battula > wrote: > >> >> Wiki was updated for 3.3 >> https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0. >> >> >> >I'll move out anything that isn't needed. >> >> thanks steve. >> >> > We need to fix the shaded protobuf in >> > Token issue to even get spark to compile. >> >> Looks this is done. https://issues.apache.org/jira/browse/HADOOP-16621 >> >> On Wed, Jan 8, 2020 at 7:41 PM Steve Loughran >> wrote: >> >>> > >>> > 2. Features close to finish: >>> > >>> > >>> > *HADOOP-15620: Über-jira: S3A phase VI: Hadoop 3.3 features. ( >>> owner >>> > : Steve Loughran) >>> > *HADOOP-15763: Über-JIRA: abfs phase II: Hadoop 3.3 features & >>> > fixes. ( owner : Steve Loughran) >>> > *HADOOP-15619:Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features. ( >>> > owner : Steve Loughran) >>> > >>> > I'll move out anything that isn't needed. >>> >>> FWIW, most of these are in CDP 1.x, so there's been reasonable testing >>> and >>> I've got some provisional tuning to do. That is -if things didn't work in >>> the test/production deployments, I'd know about the regressions (e.g. >>> HADOOP-16751). >>> >>> This is S3A and ABFS code -no idea about the rest, and inevitably the big >>> JAR changes will have surprises. We need to fix the shaded protobuf in >>> Token issue to even get spark to compile. >>> >>> -Steve >>> >>> > >>> > >>> >> >> >> -- >> --Brahma Reddy Battula >> > > > -- > > > > --Brahma Reddy Battula > -- --Brahma Reddy Battula
Re: Hadoop 3.3 Release Plan Proposal
Hi All, Inline with the original 3.3.0 communication proposal dated 8th Jan 2020, I would like to provide more updates[1]. We are approaching previously proposed code freeze date (March 10,2020). So I would like to cut 3.3 branch on *10th March* and point existing *trunk to 3.4* if there are no issues. *Current Release Plan:* *Feature freeze Date *: all features to merge by Feb 28, 2020.( it's almost done) *Code freeze Date *: blockers/critical only, no improvements and blocker/critical bug-fixes March 10, 2020 [2] ( as of now only 12 issues are there which are very old and I am tracking same.) *Release Date*: March 15, 2020. *Please let me know if I missed anything.* 1. https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0 2.project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 ORDER BY priority DESC On Wed, Jan 22, 2020 at 11:22 PM Brahma Reddy Battula wrote: > > Wiki was updated for 3.3 > https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0. > > > >I'll move out anything that isn't needed. > > thanks steve. > > > We need to fix the shaded protobuf in > > Token issue to even get spark to compile. > > Looks this is done. https://issues.apache.org/jira/browse/HADOOP-16621 > > On Wed, Jan 8, 2020 at 7:41 PM Steve Loughran > wrote: > >> > >> > 2. Features close to finish: >> > >> > >> > *HADOOP-15620: Über-jira: S3A phase VI: Hadoop 3.3 features. ( >> owner >> > : Steve Loughran) >> > *HADOOP-15763: Über-JIRA: abfs phase II: Hadoop 3.3 features & >> > fixes. ( owner : Steve Loughran) >> > *HADOOP-15619:Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features. ( >> > owner : Steve Loughran) >> > >> > I'll move out anything that isn't needed. >> >> FWIW, most of these are in CDP 1.x, so there's been reasonable testing and >> I've got some provisional tuning to do. That is -if things didn't work in >> the test/production deployments, I'd know about the regressions (e.g. >> HADOOP-16751). >> >> This is S3A and ABFS code -no idea about the rest, and inevitably the big >> JAR changes will have surprises. We need to fix the shaded protobuf in >> Token issue to even get spark to compile. >> >> -Steve >> >> > >> > >> > > > -- > --Brahma Reddy Battula > -- --Brahma Reddy Battula
Re: Hadoop 3.3 Release Plan Proposal
Wiki was updated for 3.3 https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.3.0. >I'll move out anything that isn't needed. thanks steve. > We need to fix the shaded protobuf in > Token issue to even get spark to compile. Looks this is done. https://issues.apache.org/jira/browse/HADOOP-16621 On Wed, Jan 8, 2020 at 7:41 PM Steve Loughran wrote: > > > > 2. Features close to finish: > > > > > > *HADOOP-15620: Über-jira: S3A phase VI: Hadoop 3.3 features. ( > owner > > : Steve Loughran) > > *HADOOP-15763: Über-JIRA: abfs phase II: Hadoop 3.3 features & > > fixes. ( owner : Steve Loughran) > > *HADOOP-15619:Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features. ( > > owner : Steve Loughran) > > > > I'll move out anything that isn't needed. > > FWIW, most of these are in CDP 1.x, so there's been reasonable testing and > I've got some provisional tuning to do. That is -if things didn't work in > the test/production deployments, I'd know about the regressions (e.g. > HADOOP-16751). > > This is S3A and ABFS code -no idea about the rest, and inevitably the big > JAR changes will have surprises. We need to fix the shaded protobuf in > Token issue to even get spark to compile. > > -Steve > > > > > > -- --Brahma Reddy Battula
Re: Hadoop 3.3 Release Plan Proposal
> > 2. Features close to finish: > > > *HADOOP-15620: Über-jira: S3A phase VI: Hadoop 3.3 features. ( owner > : Steve Loughran) > *HADOOP-15763: Über-JIRA: abfs phase II: Hadoop 3.3 features & > fixes. ( owner : Steve Loughran) > *HADOOP-15619:Über-JIRA: S3Guard Phase IV: Hadoop 3.3 features. ( > owner : Steve Loughran) > > I'll move out anything that isn't needed. FWIW, most of these are in CDP 1.x, so there's been reasonable testing and I've got some provisional tuning to do. That is -if things didn't work in the test/production deployments, I'd know about the regressions (e.g. HADOOP-16751). This is S3A and ABFS code -no idea about the rest, and inevitably the big JAR changes will have surprises. We need to fix the shaded protobuf in Token issue to even get spark to compile. -Steve > >