pepijnve opened a new pull request, #10161: URL: https://github.com/apache/arrow-rs/pull/10161
# Which issue does this PR close? None # Rationale for this change During profiling of a DataFusion query String concatenation, in particular of two StringView arrays, proved to be a hotspot. This MR proposes a revised version of `concat_elements_string_view_array` which eliminates some overhead that comes from using a fairly generic implementation strategy. Benchmarking shows improvement of 20-40%. # What changes are included in this PR? - Replace `StringViewBuilder` based concatenation implementation with one that directly writes the various buffers of the array # Are these changes tested? - Covered by existing tests, and some additional test cases added to ensure newly added code is covered # Are there any user-facing changes? No -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
