alamb commented on PR #2593: URL: https://github.com/apache/arrow-rs/pull/2593#issuecomment-1240766172
> Yes, switching lexsort to performing a radix sort on this format will likely yield significant returns. For what it is worth, I think there will likely be cases where the cost of creating the row format (copying bytes around) -- both CPU and Memory -- will outweigh the sorting performance improvement, so we will have to think about when to use one or the other carefully. For example, I suspect sorting a single UInt64 array will likely work faster without copying the data into a row format (that is the same) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
