korowa commented on PR #5490: URL: https://github.com/apache/arrow-datafusion/pull/5490#issuecomment-1460721845
I've also benchmarked vs main using `-m` flag -- and despite it should be cleaner due to excluding file scanning from execution time, there still are fluctuations in both sides ``` Query branch main ---------------------------------------------- Query 1 avg time: 668.26 ms 652.55 ms Query 2 avg time: 212.92 ms 216.46 ms Query 3 avg time: 113.40 ms 116.00 ms Query 4 avg time: 73.98 ms 65.35 ms Query 5 avg time: 333.21 ms 318.39 ms Query 6 avg time: 26.49 ms 28.68 ms Query 7 avg time: 690.75 ms 732.79 ms Query 8 avg time: 151.35 ms 170.01 ms Query 9 avg time: 378.67 ms 415.37 ms Query 10 avg time: 228.83 ms 252.53 ms Query 11 avg time: 240.78 ms 216.22 ms Query 12 avg time: 98.05 ms 96.31 ms Query 13 avg time: 657.82 ms 638.33 ms Query 14 avg time: 38.87 ms 35.11 ms Query 15 avg time: 101.51 ms 109.23 ms Query 16 avg time: 149.93 ms 149.01 ms Query 17 avg time: 3713.62 ms 3952.60 ms Query 18 avg time: 2312.22 ms 2463.61 ms Query 19 avg time: 106.72 ms 107.72 ms Query 20 avg time: 1047.35 ms 1022.07 ms Query 21 avg time: 892.56 ms 855.86 ms Query 22 avg time: 87.27 ms 73.53 ms ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
