Rich-T-kid opened a new pull request, #27032: URL: https://github.com/apache/datafusion/pull/27032
## Why This stacks #26816 and #26826 so their combined effect can be measured with Parquet RLE dictionary reads enabled. ## What changed - Add the shared `CachingArrayHasher` used by both operators. - Reuse dictionary value hashes across `RepartitionExec` batches while the values `Arc` is unchanged. - Reuse dictionary value hashes and known dictionary-to-group mappings in non-streaming aggregation. - Keep non-dictionary and streaming aggregation on their existing paths. ## Validation Focused caching-hasher, repartition, and aggregation tests pass. Formatting, scoped Clippy, and the repository pre-push checks pass. Combined benchmark results are in progress. This is an integration draft for #26816 and #26826; it does not supersede either PR yet. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
