sundy-li commented on pull request #9602: URL: https://github.com/apache/arrow/pull/9602#issuecomment-788550187
I removed `pdqsort`, because the performance didn't show any improvement during the benches. Added a separate function `partial_sort `as @jorgecarleitao suggested. I did not find any other `partial_sort` function in Rust like std::partial_sort in c++. So I created [one](https://github.com/sundy-li/partial_sort). And the benche results about partial_sort in arrow are: ``` sort 2^10 time: [156.26 us 156.97 us 157.88 us] sort 2^12 time: [753.58 us 755.43 us 758.14 us] sort nulls 2^10 time: [133.73 us 134.42 us 135.27 us] sort nulls 2^12 time: [633.41 us 635.28 us 637.51 us] sort 2^12 limit 10 time: [49.246 us 49.820 us 50.667 us] sort 2^12 limit 100 time: [115.11 us 116.26 us 117.76 us] sort 2^12 limit 1000 time: [113.61 us 114.21 us 114.85 us] sort nulls 2^12 limit 10 time: [66.283 us 66.725 us 67.347 us] sort nulls 2^12 limit 100 time: [66.455 us 66.932 us 67.504 us] sort nulls 2^12 limit 1000 time: [65.030 us 65.218 us 65.412 us] ``` ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org