dongjoon-hyun commented on PR #52165: URL: https://github.com/apache/spark/pull/52165#issuecomment-3240831583
Thank you so much always for keeping tracking the upstream RCs, @pan3793 . As a release manager of Apache Spark 4.0.1, as of now, I don't think this is a blocker for Apache Spark 4.0.1 release because - This is a feature release instead of a maintenance release of Parquet (as you mentioned). - There is no official Parquet release (still RC3?). - After we get the official 1.16.0 release, we still need to spend more efforts to validate more with `Apache Spark 4.1.0` (master branch) for a while because Apache Parquet is the default file format of Apache Spark 4.1.0 first. Of course, after we merge this to `master` branch, all downstream forks can cherry-pick and use Apache Parquet 1.16.0 at their own risks in their production environment. That's the main purpose to valid and merge this PR to `master` branch. Personally, I'm also going to verify with internal benchmarks and more production usages if Apache Parquet 1.16.0 RC3 passes the vote. I'm sure that we agree that the best case for all and world-wide community, Apache Parquet 1.15.3 is released for Apache Spark 4.0.2 in next 3 months. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
