pitrou commented on PR #45272: URL: https://github.com/apache/arrow/pull/45272#issuecomment-3027961571
> I wonder if the ArrayIterator returning a shared_ptr<ArrayData> is the next bottleneck? Well, if we want an `ArrayIterator` for list arrays, it should not store a `ArrayData` but a `ArraySpan`. This implies that `RangeDataEqualsImpl` should be modified to take `ArraySpan` as well. Even better in the future would be to compare entire ranges of non-null list values at once. For example, for `[[1, 2, 3], [4, 5], null, [6, 7]]`, compare the entire range `[1, 2, 3, 4, 5]` instead of two separate ranges. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
