alamb opened a new pull request, #7936: URL: https://github.com/apache/arrow-datafusion/pull/7936
## Which issue does this PR close? Closes https://github.com/apache/arrow-datafusion/issues/7935 ## Rationale for this change Inspired by PR https://github.com/apache/arrow-datafusion/pull/7745, the repartition input code as it is now is both a bit messy (needs a `#cfg`) but also only works for `ParquetExec` and `CsvExec`, where the code is general for any ExecutionPlan. ## What changes are included in this PR? 1. Extract the `repartition` code to a trait on ExecutionPlan, which also allows other (user defined) table sources to benefit from this optimization 2. Document what is happening in more detail 3. Move implementation code for Parquet and CSV ## Are these changes tested? Covered by existing tests ## Are there any user-facing changes? <!-- If there are user-facing changes then we may require documentation to be updated before approving the PR. --> <!-- If there are any breaking changes to public APIs, please add the `api change` label. --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
