peter-toth commented on PR #59269: URL: https://github.com/apache/spark/pull/59269#issuecomment-6095593015
Thank you @dongjoon-hyun for merging this! My first Late Materialization PR (https://github.com/apache/spark/pull/58895) depends on Parquet 1.18.1, which is not available in 4.x due to our version policy. I'm planning on extending the feature to DSv2 next. Actually, once that is available, it would allow me to backport the non-Parquet specific parts or the Late Materialization PR and this follow-up PR to 4.x together with DSv2 support, but let's decide on the backport once we get there. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
