tobixdev commented on issue #8561: URL: https://github.com/apache/arrow-rs/issues/8561#issuecomment-3377214866
I am a fan of trying to eliminate the current allocation in the `extend` implementation using some finite-size buffer (e.g., `u64`) if this has at similar (or better) performance than the Vec allocation(s). I am not too familiar with the use of the builder in arrow but I am having troubles of how we the two use cases are mutually exclusive to optimize in a single builder. Couldn't we optimize the BooleanBuilder / BooleanBufferBuilder for the first use case and, if necessary, offer a `get_bit_raw` and `set_bit_raw` similar to `arrow_buffer::bitutil` that allows switching bits on/off efficiently? This could then also circumvent any bounds checks and therefore support the second use case. Could you maybe provide an example? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
