Kimahriman commented on PR #37514: URL: https://github.com/apache/spark/pull/37514#issuecomment-1214475501
I mostly did this as an exercise to learn more about V2 tables and get the built-in file sources closer to complete. I set out just to enable subquery partition pruning, but along the way I found the best way was through the DPP mechanism, which didn't yet work for file source v2 either. I can separate the two things out, but wanted to get general thoughts on this approach and if it makes sense. Definitely not an expert in any parts of these code paths. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
