Rich-T-kid opened a new issue, #26168: URL: https://github.com/apache/datafusion/issues/26168
### Is your feature request related to a problem or challenge? `hash_dictionary_scatter` in `datafusion/common/src/hash_utils.rs` is on the hot path for aggregation, hash join, and hash partitioning when a `DictionaryArray` feeds the hash key. The current loop carries per-element null-key and null-value branches even on the common all-valid case. ### Describe the solution you'd like Specialize the scatter by `HAS_NULL_KEYS` / `HAS_NULL_VALUES` const generics so the dense case is branch-free and the null-keys case walks the key null buffer in 64-bit chunks with a branchless gather + csel-blend fast path. ### Describe alternatives you've considered N/A ### Additional context PR to follow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
