Re: [DISCUSS] Hadoop 3.3.1 release

Back at this. The Hadoop thirdparty 1.1.0 is released. We have one real blocker for the 3.3.1 release (HDFS-15790 Make ProtobufRpcEngineProtos and ProtobufRpcEngineProtos2 Co-Exist ) I tried to rebase the PR but it didn't work like I wanted. Some

Re: [DISCUSS] Hadoop 3.3.1 release

Hello it's me again. While working on the hadoop-thirdparty release, I would like to make progress on the Hadoop 3.3.1 release in parallel as well. Looking at the jira dashboard, I think the only real blocker is HDFS-15790 https://github.com/apache/hadoop/pull/2767 I'll try to review the

Re: [DISCUSS] Hadoop 3.3.1 release

Billie and Viraj, As of today we are at 657 resolved jiras in 3.3.1 https://issues.apache.org/jira/issues/?filter=-1=project%20in%20(HADOOP%2C%20HDFS%2C%20YARN%2C%20MAPREDUCE)%20AND%20status%20in%20(Resolved)%20AND%20fixVersion%20in%20(3.3.1) There are so many new features (

Re: [DISCUSS] Hadoop 3.3.1 release

I was thinking of backporting HADOOP-16948 for 3.3.1. Billie On Mon, Apr 19, 2021 at 1:33 AM Wei-Chiu Chuang wrote: > Hello, reviving this thread. > > I created a dashboard for Hadoop 3.3.1 release. > https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12336122 > Also a jira to

Re: [DISCUSS] Hadoop 3.3.1 release

Thanks Wei-Chiu. > If you believe there are more features/bug fixes we should include in 3.3.1 (I spent the past few weeks backporting jiras but I'm sure I missed some) please shout out. Although not marked critical, I believe HDFS-15982 could get in 3.3.1 if you are fine. Thanks to Bhavik for

Re: [DISCUSS] Hadoop 3.3.1 release

Hello, reviving this thread. I created a dashboard for Hadoop 3.3.1 release. https://issues.apache.org/jira/secure/Dashboard.jspa?selectPageId=12336122 Also a jira to track the release work: HADOOP-17647 We are currently at 5 release blockers

Re: [DISCUSS] Hadoop 3.3.1 release

Hi Steve and Wei-Chiu Regarding the IPV6,Few years back we have rebased the HADOOP-11890 to trunk and tried to work out with IPV6, we have faced some issues and have made the required changes for ipv6 to work.After the changes were made we have tested the IPV6 changes on top of Ipv4 and Ipv6

Re: [DISCUSS] Hadoop 3.3.1 release

Hi David, >> Still hoping for help here: >> https://issues.apache.org/jira/browse/HDFS-15790 I will raise a PR for the said solution soon (in a day or two). -Vinay On Thu, 11 Mar 2021 at 5:39 AM, David wrote: > Hello, > > Still hoping for help here: > >

Re: [DISCUSS] Hadoop 3.3.1 release

Without looking into details, I would say that new features like IPv6 support should get into 3.4.0 (and hopefully spend a little time to stabilize) before backporting to 3.3.x or lower branches. On Thu, Mar 11, 2021 at 1:21 AM Steve Loughran wrote: > I'm going to argue its too late to do IPv6

Re: [DISCUSS] Hadoop 3.3.1 release

Hello, Still hoping for help here: https://issues.apache.org/jira/browse/HDFS-15790 Looks like it has been worked on, not sure how to best move it forward. On Wed, Mar 10, 2021, 12:21 PM Steve Loughran wrote: > I'm going to argue its too late to do IPv6 support close to a release, as > it's

Re: [DISCUSS] Hadoop 3.3.1 release

I'm going to argue its too late to do IPv6 support close to a release, as it's best if its on developer machines for some time to let all quirks surface. It's not so much IPv6 itself, but do we cause any regressions on IPv4? But: it can/should go into trunk and stabilize there On Thu, 4 Mar 2021

Re: [DISCUSS] Hadoop 3.3.1 release

Hi Brahma, Can we have this new feature "YARN Registry based AM discovery with retry and in-flight task persistent via JHS" in the upcoming 3.1.1 release. I have also attached a test-report in the below jira. https://issues.apache.org/jira/browse/MAPREDUCE-6726 Thanks, D M Murali Krishna Reddy

Re: [DISCUSS] Hadoop 3.3.1 release

Hi Bilwa, I have commented on the jira's you mentioned. Based on the stability we can plan this.But needs to be merged ASAP. On Fri, Feb 19, 2021 at 5:20 PM bilwa st wrote: > Hi Brahma, > > Can we have below features in 3.3.1 release? We have been using these > features for a long time. They

Re: [DISCUSS] Hadoop 3.3.1 release

Sorry for the late reply.. I will come up with a plan.. Please let me know if anybody has some features/improvements/bugs that need to be included. On Mon, Feb 15, 2021 at 9:39 PM Sunil Govindan wrote: > Hi Wei-Chiu, > > What will be the next steps here for 3.3.1 planning? > > Thanks > Sunil >

Re: [DISCUSS] Hadoop 3.3.1 release

Hi Wei-Chiu, What will be the next steps here for 3.3.1 planning? Thanks Sunil On Mon, Feb 8, 2021 at 11:56 PM Stack wrote: > On Wed, Feb 3, 2021 at 6:41 AM Steve Loughran > > wrote: > > > > > Regarding blockers : how about we have a little hackathon where we try > > and get things in. This

Re: [DISCUSS] Hadoop 3.3.1 release

On Wed, Feb 3, 2021 at 6:41 AM Steve Loughran wrote: > > Regarding blockers : how about we have a little hackathon where we try > and get things in. This means a promise of review time from the people with > commit rights and other people who understand the code (Stack?) > > I'm up for helping

Re: [DISCUSS] Hadoop 3.3.1 release

yeah, it's time.I've been trying to get things lined up for this object-store wise, a few things tagged as blockers where I really want them in Wei Chiu -if you want to be the release manager I'll share the workload, Regarding blockers : how about we have a little hackathon where we try and get

Re: [DISCUSS] Hadoop 3.3.1 release

+1 Just to mention we would need to release hadoop-thirdparty too before. Presently we are using the snapshot version of it. -Ayush > On 28-Jan-2021, at 6:59 AM, Wei-Chiu Chuang wrote: > > Hi all, > > Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated > more than 400

Re: [DISCUSS] Hadoop 3.3.1 release

Thanks for bringing up the topic Wei-Chiu. +1 on a 3.3.1 soon. Was going to spend time testing Yours, S On Wed, Jan 27, 2021 at 5:28 PM Wei-Chiu Chuang wrote: > Hi all, > > Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated > more than 400 changes in the

Re: [DISCUSS] Hadoop 3.3.1 release

Would be great for the Hive team to see this one as well: https://issues.apache.org/jira/browse/HDFS-15790 On Wed, Jan 27, 2021 at 8:28 PM Wei-Chiu Chuang wrote: > Hi all, > > Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated > more than 400 changes in the branch-3.3.

[DISCUSS] Hadoop 3.3.1 release

Hi all, Hadoop 3.3.0 was released half a year ago, and as of now we've accumulated more than 400 changes in the branch-3.3. A number of downstreamers are eagerly waiting for 3.3.1 which addresses the guava version conflict issue.