vegarsti opened a new issue, #8707:
URL: https://github.com/apache/arrow-rs/issues/8707
I think what @tustvold is getting at is that the `filter` kernel is (very)
fast and thus using it rather than the `take` kernel is likely to be faster.
So I think the idea here is instead of building up `value_indexes` it would
be to implement some way to turn the result of `Partition` into a boolean array
and pass to the filter kernel
I think we can file this idea as a ticket and potentially do it as a follow
on PR / performance optimization
```rust
let partitions = partition(&[Arc::clone(cast_array)])?;
// ....
let filter: BooleanArray = partitions.into_inner(); // not sure about
this API
// call filter instead of take
let values_array = filter(&cast_array, &filter)?;
```
_Originally posted by @alamb in
https://github.com/apache/arrow-rs/pull/8589#discussion_r2456121522_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
