alamb commented on PR #7513: URL: https://github.com/apache/arrow-rs/pull/7513#issuecomment-2913158567
Ok, I reworked a bunch of the code in this PR so it is now structured to use a `IncrementalRecordBatchBuilder` which builds output in `batch_size` batches from filtered results-- in and of itself this doesn't improve performance, but I am finally set up now to add a way to incrementally build up Arrays from filters. I will continue working on this tomorrow. Now I need to go do other things and reviews, etc -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
