Hi Fokko, Thanks for volunteering to release 1.13.1! That would be great and I am looking forward to you being the release manager for that.
We can have the 1.13.1 release to add back the support old Hadoop version, but the question is should we release ASAP or wait for a reasonable time window? The new version 1.13.0 is just released and I am not sure if there are more issues coming so that we can put together the fixes into 1.13.1. Is Iceberg urgently blocked on this? Xinli Shang On Tue, Apr 25, 2023 at 6:51 PM Gang Wu <[email protected]> wrote: > That sounds good to me. > > I have just released 1.13.0, just let me know if you need anything > on my end to make the next release. > > Best, > Gang > > On Tue, Apr 25, 2023 at 10:31 PM Fokko Driesprong <[email protected]> > wrote: > > > Hey Gang, > > > > Thanks for the quick reply. I think 2.8.x is water under the bridge, but > I > > can be convinced otherwise. I also spend a few cycles to see if we can > get > > compatibility with 2.7.3+, but it doesn't seem trivial > > <https://github.com/apache/parquet-mr/pull/1075#issuecomment-1514518094 > >. > > As Gabor said on the ticket, it is fine to drop support for older systems > > from time to time. The public Hadoop 2.8 > > <https://github.com/apache/hadoop/tree/branch-2.8> doesn't seem to get > any > > active updates. I don't fully agree with the ticket, you can still read > > Parquet, but using an older version of the library. > > > > Kind regards, > > Fokko Driesprong > > > > Op di 25 apr 2023 om 16:13 schreef Gang Wu <[email protected]>: > > > > > Hi Fokko, > > > > > > There is an issue of the 1.13.0 release: > > > https://issues.apache.org/jira/browse/PARQUET-2276. > > > > > > It seems that Hadoop 2.8.x is no longer supported after 1.13.0. I have > > seen > > > that > > > you have added CI checks for Hadoop 2.9.x. Not sure if this is a > > > blocking issue. > > > > > > Best, > > > Gang > > > > > > > > > > > > On Tue, Apr 25, 2023 at 3:25 PM Fokko Driesprong <[email protected]> > > wrote: > > > > > > > Hi all, > > > > > > > > I would like to discuss releasing Parquet 1.13.1. For Iceberg we ran > > into > > > > two things: > > > > > > > > - We noticed that support for Hadoop 2 was dropped. Iceberg is > still > > > on > > > > 2.7.3, and we're aware of the fact that has been released in > August > > > > 2016. > > > > The PR that I've created > > > > <https://github.com/apache/parquet-mr/pull/1083/> bumps the lower > > > bound > > > > to Hadoop 2.9.2. Which is also old, but if possible we would like > to > > > > cater > > > > to the widest audience possible. > > > > - At Iceberg we also have the Apache Flink integration, and Flink > is > > > > able to run without Hadoop. This required some minor changes > (#1074 > > > > <https://github.com/apache/parquet-mr/pull/1074>, #1073 > > > > <https://github.com/apache/parquet-mr/pull/1073>) that already > have > > > > been > > > > backported. It would be awesome to get these out. > > > > > > > > My question is, after the release of 1.13.0 are there any issues that > > > came > > > > up, or anything that you would like to see being released? I'm happy > to > > > > volunteer as a release manager for 1.13.1. Let us know! > > > > > > > > Kind regards, > > > > Fokko > > > > > > > > > > -- Xinli Shang
