Rich-T-kid opened a new pull request, #12336: URL: https://github.com/apache/arrow-rs/pull/12336
# Which issue does this PR close? - Closes #11567 # Rationale for this change `BatchCoalescer::push_batch_with_indices` currently materializes an intermediate `BooleanArray` through `take` before copying it into the coalescer. This adds work for sparse indexed selections. # What changes are included in this PR? Add a Boolean-specific indexed-copy path that gathers selected value and validity bits directly into the in-progress buffers. The existing bounds checking and dense-selection fallback are preserved. # Are these changes tested? Added coverage for nullable and non-null Boolean arrays, sliced value and validity buffers with different offsets, repeated and out-of-order indices, empty indices, and lazy validity. Existing mixed-schema and target-batch chunking coverage also exercises this path. Local `single_boolean` measurements improve the direct-copy cases by 26-35%. The 80% selectivity cases retain the existing materialized path and remain effectively unchanged. Hosted benchmark results are pending. # Are there any significant user-facing changes? No. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
