Rich-T-kid opened a new pull request, #27032:
URL: https://github.com/apache/datafusion/pull/27032

   ## Why
   
   This stacks #26816 and #26826 so their combined effect can be measured with 
Parquet RLE dictionary reads enabled.
   
   ## What changed
   
   - Add the shared `CachingArrayHasher` used by both operators.
   - Reuse dictionary value hashes across `RepartitionExec` batches while the 
values `Arc` is unchanged.
   - Reuse dictionary value hashes and known dictionary-to-group mappings in 
non-streaming aggregation.
   - Keep non-dictionary and streaming aggregation on their existing paths.
   
   ## Validation
   
   Focused caching-hasher, repartition, and aggregation tests pass. Formatting, 
scoped Clippy, and the repository pre-push checks pass. Combined benchmark 
results are in progress.
   
   This is an integration draft for #26816 and #26826; it does not supersede 
either PR yet.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to