Hi everyone, I'm seeing some great progress on the Parquet side and it was almost one year ago that I ran the last 1.13.1 release (May 2023). Are there any considerations of doing a 1.14.0 release?
Looking forward, I would like to discuss a Parquet-mr 2.0 release. - Looking at other projects in the space there are more and more that are moving to Java 11+, for example, Spark 4.0 (June 2024) and Iceberg 2.0 (the first release after 1.5.0 that's being voted on right now). - We currently have support for Hadoop 2.x which is compiled against Java 7. I would suggest dropping everything below 3.3 as that's the minimal version supporting Java 11 <https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+Java+Versions>. Because some APIs changed, we also have to use reflection, which is not great. I would also like to thank Xinli for updating the Parquet Sync invite. I was there on the 30th of January, but all by myself. The next sync next week Tuesday would be a great opportunity to go over this topic. Looking forward to your thoughts! Kind regards, Fokko Driesprong
