srowen commented on issue #26804: [WIP][SPARK-26346][BUILD][SQL] Upgrade parquet to 1.11.0 URL: https://github.com/apache/spark/pull/26804#issuecomment-564503856 What does Parquet 1.11 buy in terms of improvements? perf or bug fixes? I'd generally think we _want_ to make this change for Spark 3.0 rather than say 3.1, to reduce risk. But, yes always bears understanding if it is going to change behavior in important ways. Is there a perf angle here? is the benchmark idea to detect improvements or regressions?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
