pan3793 commented on PR #49874: URL: https://github.com/apache/spark/pull/49874#issuecomment-2649824762
@dongjoon-hyun All variant shred-related changes except this one are currently disabled(by internal SQL confs) in Spark 4.0, and only usable as test features, which is safe for future breaking changes as they are not delivered as user-facing features. The latest shredding spec https://github.com/apache/parquet-format/pull/461 just got merged a few days ago and has no reference implementation yet, it's not trivial to build a real test. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
