mbutrovich commented on PR #9683: URL: https://github.com/apache/arrow-rs/pull/9683#issuecomment-4219153957
Byte Buffer is the current commit: | Schema, N | Original | PR Feedback | Byte Buffer | Buffer vs Original | |---|---|---|---|---| | [i32, i32_opt], 4096 | 71.987 µs | 70.200 µs | 74.722 µs | +3.8% | | [i32, i32_opt], 32768 | 359.07 µs | 341.22 µs | 320.76 µs | -10.7% | | [i32, str_opt(16)], 4096 | 88.564 µs | 88.874 µs | 87.527 µs | -1.2% | | [i32, str_opt(16)], 32768 | 510.93 µs | 493.01 µs | 485.17 µs | -5.0% | | [i32, str(16)], 4096 | 85.021 µs | 92.958 µs | 88.301 µs | +3.9% | | [i32, str(16)], 32768 | 457.38 µs | 425.87 µs | 413.71 µs | -9.5% | | [str_opt(16), str(16)], 4096 | 123.71 µs | 133.51 µs | 132.79 µs | +7.3% | | [str_opt(16), str(16)], 32768 | 946.89 µs | 993.63 µs | 948.77 µs | +0.2% | | [str_opt(16), str_opt(50), str(16)], 4096 | 155.40 µs | 165.69 µs | 164.27 µs | +5.7% | | [str_opt(16), str_opt(50), str(16)], 32768 | 1.2148 ms | 1.2654 ms | 1.2207 ms | +0.5% | | [str_opt(16), str(16), x5], 4096 | 188.98 µs | 199.13 µs | 199.64 µs | +5.6% | | [str_opt(16), str(16), x5], 32768 | 1.5222 ms | 1.5486 ms | 1.5407 ms | +1.2% | | [i32_opt, dict(100,str_opt(50))], 4096 | 100.16 µs | 101.17 µs | 102.22 µs | +2.1% | | [i32_opt, dict(100,str_opt(50))], 32768 | 627.81 µs | 686.16 µs | 709.65 µs | +13.0% | | [dict x2], 4096 | 90.044 µs | 89.670 µs | 93.701 µs | +4.1% | | [dict x2], 32768 | 722.44 µs | 741.11 µs | 760.66 µs | +5.3% | | [dict x3, str(16)], 4096 | 179.50 µs | 187.09 µs | 182.74 µs | +1.8% | | [dict x3, str(16)], 32768 | 1.5303 ms | 1.5696 ms | 1.5158 ms | -0.9% | | [dict x3, str_opt(50)], 4096 | 192.86 µs | 200.81 µs | 197.92 µs | +2.6% | | [dict x3, str_opt(50)], 32768 | 1.7082 ms | 1.7309 ms | 1.6815 ms | -1.6% | | [i32_opt, i32_list], 4096 | 157.57 µs | 160.09 µs | 158.90 µs | +0.8% | | [i32_opt, i32_list], 32768 | 1.3393 ms | 1.4233 ms | 1.4378 ms | +7.4% | | [i32_opt, i32_list_opt], 4096 | 161.53 µs | 164.17 µs | 171.16 µs | +6.0% | | [i32_opt, i32_list_opt], 32768 | 1.3731 ms | 1.4992 ms | 1.4596 ms | +6.3% | | [i32_list_opt, i32_opt], 4096 | 173.67 µs | 179.41 µs | 184.39 µs | +6.2% | | [i32_list_opt, i32_opt], 32768 | 1.5963 ms | 1.5744 ms | 1.5886 ms | -0.5% | | [i32, str_list(4)], 4096 | 287.85 µs | 291.31 µs | 302.80 µs | +5.2% | | [i32, str_list(4)], 32768 | 3.3054 ms | 3.2674 ms | 3.2501 ms | -1.7% | | [str_list(4), i32], 4096 | 297.47 µs | 360.26 µs | 324.41 µs | +9.1% | | [str_list(4), i32], 32768 | 3.8276 ms | 3.8494 ms | 3.8520 ms | +0.6% | | [i32, str_list_opt(4)], 4096 | 261.91 µs | 325.47 µs | 287.95 µs | +9.9% | | [i32, str_list_opt(4)], 32768 | 3.1478 ms | 3.1075 ms | 3.0864 ms | -2.0% | | [str_list_opt(4), i32], 4096 | 300.98 µs | 334.20 µs | 317.49 µs | +5.5% | | [str_list_opt(4), i32], 32768 | 3.7982 ms | 3.8360 ms | 3.7977 ms | 0.0% | | [i32, i32_list, str(16)], 4096 | 170.03 µs | 175.74 µs | 171.79 µs | +1.0% | | [i32, i32_list, str(16)], 32768 | 1.1633 ms | 1.1742 ms | 1.1638 ms | 0.0% | | [i32_opt, i32_list_opt, str_opt(50)], 4096 | 195.77 µs | 198.17 µs | 195.62 µs | -0.1% | | [i32_opt, i32_list_opt, str_opt(50)], 32768 | 1.6350 ms | 1.7419 ms | 1.7033 ms | +4.2% | Here it is compared to the other sorts: | Schema, N | Best Other Sort | Radix (Byte Buffer) | Radix Wins? | |---|---|---|---| | [i32, i32_opt], 4096 | 86.1 µs | 74.7 µs | Yes | | [i32, i32_opt], 32768 | 859.9 µs | 320.8 µs | Yes | | [i32, str_opt(16)], 4096 | 87.4 µs | 87.5 µs | Tie | | [i32, str_opt(16)], 32768 | 873.2 µs | 485.2 µs | Yes | | [i32, str(16)], 4096 | 85.7 µs | 88.3 µs | No | | [i32, str(16)], 32768 | 877.2 µs | 413.7 µs | Yes | | [str_opt(16), str(16)], 4096 | 159.2 µs | 132.8 µs | Yes | | [str_opt(16), str(16)], 32768 | 1.6544 ms | 948.8 µs | Yes | | [str_opt(16), str_opt(50), str(16)], 4096 | 194.0 µs | 164.3 µs | Yes | | [str_opt(16), str_opt(50), str(16)], 32768 | 2.0054 ms | 1.2207 ms | Yes | | [str x5], 4096 | 229.2 µs | 199.6 µs | Yes | | [str x5], 32768 | 2.2503 ms | 1.5407 ms | Yes | | [i32_opt, dict], 4096 | 110.0 µs | 102.2 µs | Yes | | [i32_opt, dict], 32768 | 1.2056 ms | 709.7 µs | Yes | | [dict x2], 4096 | 50.7 µs | 93.7 µs | No | | [dict x2], 32768 | 503.1 µs | 760.7 µs | No | | [dict x3, str(16)], 4096 | 192.1 µs | 182.7 µs | Yes | | [dict x3, str(16)], 32768 | 2.0349 ms | 1.5158 ms | Yes | | [dict x3, str_opt(50)], 4096 | 213.7 µs | 197.9 µs | Yes | | [dict x3, str_opt(50)], 32768 | 2.1790 ms | 1.6815 ms | Yes | | [i32_opt, i32_list], 4096 | 139.1 µs | 158.9 µs | No | | [i32_opt, i32_list], 32768 | 1.4647 ms | 1.4378 ms | Yes | | [i32_opt, i32_list_opt], 4096 | 148.1 µs | 171.2 µs | No | | [i32_opt, i32_list_opt], 32768 | 1.6325 ms | 1.4596 ms | Yes | | [i32_list_opt, i32_opt], 4096 | 225.0 µs | 184.4 µs | Yes | | [i32_list_opt, i32_opt], 32768 | 2.5477 ms | 1.5886 ms | Yes | | [i32, str_list(4)], 4096 | 85.0 µs | 302.8 µs | No | | [i32, str_list(4)], 32768 | 874.5 µs | 3.2501 ms | No | | [str_list(4), i32], 4096 | 295.8 µs | 324.4 µs | No | | [str_list(4), i32], 32768 | 3.4113 ms | 3.8520 ms | No | | [i32, str_list_opt(4)], 4096 | 87.0 µs | 288.0 µs | No | | [i32, str_list_opt(4)], 32768 | 873.5 µs | 3.0864 ms | No | | [str_list_opt(4), i32], 4096 | 354.1 µs | 317.5 µs | Yes | | [str_list_opt(4), i32], 32768 | 3.7977 ms | 3.7977 ms | Tie | | [i32, i32_list, str(16)], 4096 | 85.0 µs | 171.8 µs | No | | [i32, i32_list, str(16)], 32768 | 868.2 µs | 1.1638 ms | No | | [i32_opt, i32_list_opt, str_opt(50)], 4096 | 157.4 µs | 195.6 µs | No | | [i32_opt, i32_list_opt, str_opt(50)], 32768 | 1.7421 ms | 1.7033 ms | Yes | -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
