Hey Gang, Thanks for the quick reply. I think 2.8.x is water under the bridge, but I can be convinced otherwise. I also spend a few cycles to see if we can get compatibility with 2.7.3+, but it doesn't seem trivial <https://github.com/apache/parquet-mr/pull/1075#issuecomment-1514518094>. As Gabor said on the ticket, it is fine to drop support for older systems from time to time. The public Hadoop 2.8 <https://github.com/apache/hadoop/tree/branch-2.8> doesn't seem to get any active updates. I don't fully agree with the ticket, you can still read Parquet, but using an older version of the library.
Kind regards, Fokko Driesprong Op di 25 apr 2023 om 16:13 schreef Gang Wu <[email protected]>: > Hi Fokko, > > There is an issue of the 1.13.0 release: > https://issues.apache.org/jira/browse/PARQUET-2276. > > It seems that Hadoop 2.8.x is no longer supported after 1.13.0. I have seen > that > you have added CI checks for Hadoop 2.9.x. Not sure if this is a > blocking issue. > > Best, > Gang > > > > On Tue, Apr 25, 2023 at 3:25 PM Fokko Driesprong <[email protected]> wrote: > > > Hi all, > > > > I would like to discuss releasing Parquet 1.13.1. For Iceberg we ran into > > two things: > > > > - We noticed that support for Hadoop 2 was dropped. Iceberg is still > on > > 2.7.3, and we're aware of the fact that has been released in August > > 2016. > > The PR that I've created > > <https://github.com/apache/parquet-mr/pull/1083/> bumps the lower > bound > > to Hadoop 2.9.2. Which is also old, but if possible we would like to > > cater > > to the widest audience possible. > > - At Iceberg we also have the Apache Flink integration, and Flink is > > able to run without Hadoop. This required some minor changes (#1074 > > <https://github.com/apache/parquet-mr/pull/1074>, #1073 > > <https://github.com/apache/parquet-mr/pull/1073>) that already have > > been > > backported. It would be awesome to get these out. > > > > My question is, after the release of 1.13.0 are there any issues that > came > > up, or anything that you would like to see being released? I'm happy to > > volunteer as a release manager for 1.13.1. Let us know! > > > > Kind regards, > > Fokko > > >
