westonpace opened a new pull request, #34348: URL: https://github.com/apache/arrow/pull/34348
This is just an starting point. There are a number of different things that will hopefully be eventually added (support for more formats, different scanning scenarios, running multiple scans in parallel). It's currently exposed as a unit test and can maybe be a bit slow (takes ~30 seconds with one thread on my machine). Eventually it might make more sense to change this to a nightly test that runs for a longer duration. We should also probably have a version that runs on release mode. I also fixed an issue encountered with partition guarantee normalization. I could separate that into a separate PR if desired. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
