Hi Xinli, I know that some folks are waiting on running Apache Flink without Hadoop (but using the parquet-mr library in Iceberg). Spark already upgraded to Parquet 1.3.0, and I did some checks today with Hive, and I don't see any blockers there. What's your understanding of a reasonable time window? Personally, I don't mind running a release, especially a patch release should be quite straightforward.
Kind regards, Fokko Driesprong Op wo 26 apr 2023 om 04:37 schreef Xinli shang <[email protected]>: > Hi Fokko, > > Thanks for volunteering to release 1.13.1! That would be great and I am > looking forward to you being the release manager for that. > > We can have the 1.13.1 release to add back the support old Hadoop version, > but the question is should we release ASAP or wait for a reasonable time > window? The new version 1.13.0 is just released and I am not sure if there > are more issues coming so that we can put together the fixes into 1.13.1. > Is Iceberg urgently blocked on this? > > Xinli Shang > > > > On Tue, Apr 25, 2023 at 6:51 PM Gang Wu <[email protected]> wrote: > > > That sounds good to me. > > > > I have just released 1.13.0, just let me know if you need anything > > on my end to make the next release. > > > > Best, > > Gang > > > > On Tue, Apr 25, 2023 at 10:31 PM Fokko Driesprong <[email protected]> > > wrote: > > > > > Hey Gang, > > > > > > Thanks for the quick reply. I think 2.8.x is water under the bridge, > but > > I > > > can be convinced otherwise. I also spend a few cycles to see if we can > > get > > > compatibility with 2.7.3+, but it doesn't seem trivial > > > < > https://github.com/apache/parquet-mr/pull/1075#issuecomment-1514518094 > > >. > > > As Gabor said on the ticket, it is fine to drop support for older > systems > > > from time to time. The public Hadoop 2.8 > > > <https://github.com/apache/hadoop/tree/branch-2.8> doesn't seem to get > > any > > > active updates. I don't fully agree with the ticket, you can still read > > > Parquet, but using an older version of the library. > > > > > > Kind regards, > > > Fokko Driesprong > > > > > > Op di 25 apr 2023 om 16:13 schreef Gang Wu <[email protected]>: > > > > > > > Hi Fokko, > > > > > > > > There is an issue of the 1.13.0 release: > > > > https://issues.apache.org/jira/browse/PARQUET-2276. > > > > > > > > It seems that Hadoop 2.8.x is no longer supported after 1.13.0. I > have > > > seen > > > > that > > > > you have added CI checks for Hadoop 2.9.x. Not sure if this is a > > > > blocking issue. > > > > > > > > Best, > > > > Gang > > > > > > > > > > > > > > > > On Tue, Apr 25, 2023 at 3:25 PM Fokko Driesprong <[email protected]> > > > wrote: > > > > > > > > > Hi all, > > > > > > > > > > I would like to discuss releasing Parquet 1.13.1. For Iceberg we > ran > > > into > > > > > two things: > > > > > > > > > > - We noticed that support for Hadoop 2 was dropped. Iceberg is > > still > > > > on > > > > > 2.7.3, and we're aware of the fact that has been released in > > August > > > > > 2016. > > > > > The PR that I've created > > > > > <https://github.com/apache/parquet-mr/pull/1083/> bumps the > lower > > > > bound > > > > > to Hadoop 2.9.2. Which is also old, but if possible we would > like > > to > > > > > cater > > > > > to the widest audience possible. > > > > > - At Iceberg we also have the Apache Flink integration, and > Flink > > is > > > > > able to run without Hadoop. This required some minor changes > > (#1074 > > > > > <https://github.com/apache/parquet-mr/pull/1074>, #1073 > > > > > <https://github.com/apache/parquet-mr/pull/1073>) that already > > have > > > > > been > > > > > backported. It would be awesome to get these out. > > > > > > > > > > My question is, after the release of 1.13.0 are there any issues > that > > > > came > > > > > up, or anything that you would like to see being released? I'm > happy > > to > > > > > volunteer as a release manager for 1.13.1. Let us know! > > > > > > > > > > Kind regards, > > > > > Fokko > > > > > > > > > > > > > > > > > -- > Xinli Shang >
