alamb commented on PR #12092: URL: https://github.com/apache/datafusion/pull/12092#issuecomment-2410952786
Here are the current performance results: π Basically 10% faster across all queries and no slow downs π @Rachelint @jayzhan211 @XiangpengHao and many many others. ``` Benchmark clickbench_1.json -------------------- ββββββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββββββ³ββββββββββββββββ β Query β main_base β alamb_enable_string_view_by_defβ¦ β Change β β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ© β QQuery 0 β 0.70ms β 0.67ms β no change β β QQuery 1 β 75.35ms β 69.82ms β +1.08x faster β β QQuery 2 β 123.15ms β 128.37ms β no change β β QQuery 3 β 129.02ms β 128.14ms β no change β β QQuery 4 β 947.97ms β 967.71ms β no change β β QQuery 5 β 1086.19ms β 1060.35ms β no change β β QQuery 6 β 65.49ms β 66.43ms β no change β β QQuery 7 β 80.72ms β 84.38ms β no change β β QQuery 8 β 1330.08ms β 1332.41ms β no change β β QQuery 9 β 1345.21ms β 1344.89ms β no change β β QQuery 10 β 443.35ms β 335.50ms β +1.32x faster β β QQuery 11 β 493.80ms β 372.10ms β +1.33x faster β β QQuery 12 β 1205.69ms β 1101.01ms β +1.10x faster β β QQuery 13 β 1921.43ms β 1617.54ms β +1.19x faster β β QQuery 14 β 1355.42ms β 1146.40ms β +1.18x faster β β QQuery 15 β 1106.21ms β 1129.07ms β no change β β QQuery 16 β 2546.11ms β 2434.61ms β no change β β QQuery 17 β 2358.85ms β 2269.62ms β no change β β QQuery 18 β 4944.14ms β 5101.45ms β no change β β QQuery 19 β 121.48ms β 124.59ms β no change β β QQuery 20 β 1637.28ms β 1377.14ms β +1.19x faster β β QQuery 21 β 2106.73ms β 1716.14ms β +1.23x faster β β QQuery 22 β 5050.72ms β 4231.71ms β +1.19x faster β β QQuery 23 β 12149.30ms β 9998.89ms β +1.22x faster β β QQuery 24 β 793.52ms β 683.81ms β +1.16x faster β β QQuery 25 β 700.98ms β 587.52ms β +1.19x faster β β QQuery 26 β 860.57ms β 725.23ms β +1.19x faster β β QQuery 27 β 2540.34ms β 2104.51ms β +1.21x faster β β QQuery 28 β 14015.68ms β 14587.90ms β no change β β QQuery 29 β 571.20ms β 554.32ms β no change β β QQuery 30 β 1239.94ms β 1118.25ms β +1.11x faster β β QQuery 31 β 1276.58ms β 1189.58ms β +1.07x faster β β QQuery 32 β 4230.09ms β 4204.57ms β no change β β QQuery 33 β 5223.33ms β 4283.46ms β +1.22x faster β β QQuery 34 β 5328.12ms β 4264.81ms β +1.25x faster β β QQuery 35 β 1754.78ms β 1797.85ms β no change β β QQuery 36 β 306.94ms β 287.75ms β +1.07x faster β β QQuery 37 β 220.70ms β 182.40ms β +1.21x faster β β QQuery 38 β 192.66ms β 188.30ms β no change β β QQuery 39 β 790.63ms β 551.89ms β +1.43x faster β β QQuery 40 β 86.56ms β 84.86ms β no change β β QQuery 41 β 83.08ms β 77.75ms β +1.07x faster β β QQuery 42 β 93.76ms β 94.03ms β no change β ββββββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ ββββββββββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ β Benchmark Summary β β β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ© β Total Time (main_base) β 82933.83ms β β Total Time (alamb_enable_string_view_by_default) β 75707.73ms β β Average Time (main_base) β 1928.69ms β β Average Time (alamb_enable_string_view_by_default) β 1760.64ms β β Queries Faster β 22 β β Queries Slower β 0 β β Queries with No Change β 21 β ββββββββββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ ``` Also for partitioned: ``` -------------------- Benchmark clickbench_partitioned.json -------------------- ββββββββββββββββ³βββββββββββββ³βββββββββββββββββββββββββββββββββββ³ββββββββββββββββ β Query β main_base β alamb_enable_string_view_by_defβ¦ β Change β β‘βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ© β QQuery 0 β 2.24ms β 2.22ms β no change β β QQuery 1 β 37.96ms β 38.15ms β no change β β QQuery 2 β 95.79ms β 94.43ms β no change β β QQuery 3 β 102.41ms β 100.80ms β no change β β QQuery 4 β 927.15ms β 930.56ms β no change β β QQuery 5 β 973.96ms β 951.87ms β no change β β QQuery 6 β 34.33ms β 33.58ms β no change β β QQuery 7 β 42.82ms β 41.29ms β no change β β QQuery 8 β 1364.76ms β 1344.57ms β no change β β QQuery 9 β 1309.61ms β 1365.89ms β no change β β QQuery 10 β 346.30ms β 307.70ms β +1.13x faster β β QQuery 11 β 394.60ms β 347.22ms β +1.14x faster β β QQuery 12 β 1097.07ms β 1007.94ms β +1.09x faster β β QQuery 13 β 1636.51ms β 1602.93ms β no change β β QQuery 14 β 1197.28ms β 1069.49ms β +1.12x faster β β QQuery 15 β 1068.82ms β 1077.73ms β no change β β QQuery 16 β 2485.04ms β 2398.93ms β no change β β QQuery 17 β 2275.37ms β 2212.18ms β no change β β QQuery 18 β 4952.47ms β 5114.44ms β no change β β QQuery 19 β 96.01ms β 92.62ms β no change β β QQuery 20 β 1719.75ms β 1254.03ms β +1.37x faster β β QQuery 21 β 2001.12ms β 1481.53ms β +1.35x faster β β QQuery 22 β 5169.50ms β 2649.07ms β +1.95x faster β β QQuery 23 β 10586.32ms β 8619.20ms β +1.23x faster β β QQuery 24 β 594.74ms β 517.28ms β +1.15x faster β β QQuery 25 β 495.22ms β 427.98ms β +1.16x faster β β QQuery 26 β 660.64ms β 565.71ms β +1.17x faster β β QQuery 27 β 2557.47ms β 1846.03ms β +1.39x faster β β QQuery 28 β 13399.41ms β 13583.18ms β no change β β QQuery 29 β 535.81ms β 524.10ms β no change β β QQuery 30 β 1034.30ms β 964.20ms β +1.07x faster β β QQuery 31 β 1101.14ms β 1035.81ms β +1.06x faster β β QQuery 32 β 4202.55ms β 4049.53ms β no change β β QQuery 33 β 5136.86ms β 3916.87ms β +1.31x faster β β QQuery 34 β 5104.18ms β 3932.13ms β +1.30x faster β β QQuery 35 β 1909.94ms β 1797.84ms β +1.06x faster β β QQuery 36 β 264.07ms β 225.04ms β +1.17x faster β β QQuery 37 β 121.76ms β 92.57ms β +1.32x faster β β QQuery 38 β 147.92ms β 131.16ms β +1.13x faster β β QQuery 39 β 749.30ms β 477.60ms β +1.57x faster β β QQuery 40 β 56.82ms β 55.17ms β no change β β QQuery 41 β 47.54ms β 45.12ms β +1.05x faster β β QQuery 42 β 63.14ms β 64.81ms β no change β ββββββββββββββββ΄βββββββββββββ΄βββββββββββββββββββββββββββββββββββ΄ββββββββββββββββ ββββββββββββββββββββββββββββββββββββββββββββββββββββββ³βββββββββββββ β Benchmark Summary β β β‘ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ© β Total Time (main_base) β 78099.98ms β β Total Time (alamb_enable_string_view_by_default) β 68390.51ms β β Average Time (main_base) β 1816.28ms β β Average Time (alamb_enable_string_view_by_default) β 1590.48ms β β Queries Faster β 22 β β Queries Slower β 0 β β Queries with No Change β 21 β ββββββββββββββββββββββββββββββββββββββββββββββββββββββ΄βββββββββββββ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
