Rich-T-kid opened a new pull request, #12336:
URL: https://github.com/apache/arrow-rs/pull/12336

   # Which issue does this PR close?
   
   - Closes #11567
   
   # Rationale for this change
   
   `BatchCoalescer::push_batch_with_indices` currently materializes an 
intermediate `BooleanArray` through `take` before copying it into the 
coalescer. This adds work for sparse indexed selections.
   
   # What changes are included in this PR?
   
   Add a Boolean-specific indexed-copy path that gathers selected value and 
validity bits directly into the in-progress buffers. The existing bounds 
checking and dense-selection fallback are preserved.
   
   # Are these changes tested?
   
   Added coverage for nullable and non-null Boolean arrays, sliced value and 
validity buffers with different offsets, repeated and out-of-order indices, 
empty indices, and lazy validity. Existing mixed-schema and target-batch 
chunking coverage also exercises this path.
   
   Local `single_boolean` measurements improve the direct-copy cases by 26-35%. 
The 80% selectivity cases retain the existing materialized path and remain 
effectively unchanged. Hosted benchmark results are pending.
   
   # Are there any significant user-facing changes?
   
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to