Dandandan commented on issue #17098: URL: https://github.com/apache/datafusion/issues/17098#issuecomment-3486760255
I think the idea there is to specialize the code for concrete types (e.g. `ArrowNativeType`) so not `ScalarValue`, but `f64`, `u32`, etc. Another option that we can try is to use https://docs.rs/arrow/latest/arrow/compute/kernels/sort/fn.sort_limit.html for small Ns (e.g. N <= 50) before converting to rows. This does still a bit of unnecessary work (sort instead of partition) but for small N it should be OK. If it works out we could also implement / include a top kernel. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
