mustafasrepo commented on PR #8558: URL: https://github.com/apache/arrow-datafusion/pull/8558#issuecomment-1864251713
I ran a benchmark for the clickbench queries. Results can be found below ``` -------------------- Benchmark clickbench_1.json -------------------- ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓ ┃ Query ┃ apache_main ┃ feature_conflicting_order_sensitive_aggregates ┃ Change ┃ ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩ │ QQuery 0 │ 1.98ms │ 1.78ms │ +1.12x faster │ │ QQuery 1 │ 42.83ms │ 40.52ms │ +1.06x faster │ │ QQuery 2 │ 106.42ms │ 106.61ms │ no change │ │ QQuery 3 │ 95.70ms │ 93.81ms │ no change │ │ QQuery 4 │ 715.72ms │ 707.31ms │ no change │ │ QQuery 5 │ 1226.86ms │ 1187.07ms │ no change │ │ QQuery 6 │ 42.34ms │ 40.89ms │ no change │ │ QQuery 7 │ 41.88ms │ 43.14ms │ no change │ │ QQuery 8 │ 1339.71ms │ 1415.74ms │ 1.06x slower │ │ QQuery 9 │ 2088.04ms │ 2147.51ms │ no change │ │ QQuery 10 │ 307.61ms │ 298.18ms │ no change │ │ QQuery 11 │ 336.17ms │ 326.19ms │ no change │ │ QQuery 12 │ 1048.58ms │ 1047.89ms │ no change │ │ QQuery 13 │ 1963.13ms │ 2538.39ms │ 1.29x slower │ │ QQuery 14 │ 1143.45ms │ 1168.10ms │ no change │ │ QQuery 15 │ 803.05ms │ 803.61ms │ no change │ │ QQuery 16 │ 2672.08ms │ 3191.41ms │ 1.19x slower │ │ QQuery 17 │ 2836.43ms │ 3035.65ms │ 1.07x slower │ │ QQuery 18 │ 7873.86ms │ 7561.24ms │ no change │ │ QQuery 19 │ 65.87ms │ 68.65ms │ no change │ │ QQuery 20 │ 2181.40ms │ 2208.87ms │ no change │ │ QQuery 21 │ 2490.83ms │ 2623.68ms │ 1.05x slower │ │ QQuery 22 │ 6244.41ms │ 6256.67ms │ no change │ │ QQuery 23 │ 12160.02ms │ 12248.42ms │ no change │ │ QQuery 24 │ 651.40ms │ 650.38ms │ no change │ │ QQuery 25 │ 549.93ms │ 606.82ms │ 1.10x slower │ │ QQuery 26 │ 704.31ms │ 744.19ms │ 1.06x slower │ │ QQuery 27 │ 1831.90ms │ 1919.69ms │ no change │ │ QQuery 28 │ 17298.30ms │ 17411.88ms │ no change │ │ QQuery 29 │ 737.44ms │ 561.39ms │ +1.31x faster │ │ QQuery 30 │ 1840.93ms │ 1080.96ms │ +1.70x faster │ │ QQuery 31 │ 2432.19ms │ 1233.25ms │ +1.97x faster │ │ QQuery 32 │ 23034.53ms │ 14705.08ms │ +1.57x faster │ │ QQuery 33 │ 20271.47ms │ 17623.06ms │ +1.15x faster │ │ QQuery 34 │ 22261.09ms │ 18786.91ms │ +1.18x faster │ │ QQuery 35 │ 2101.48ms │ 1865.86ms │ +1.13x faster │ │ QQuery 36 │ 240.72ms │ 275.98ms │ 1.15x slower │ │ QQuery 37 │ 156.44ms │ 162.19ms │ no change │ │ QQuery 38 │ 139.25ms │ 161.45ms │ 1.16x slower │ │ QQuery 39 │ 558.83ms │ 519.59ms │ +1.08x faster │ │ QQuery 40 │ 66.60ms │ 77.42ms │ 1.16x slower │ │ QQuery 41 │ 61.02ms │ 67.05ms │ 1.10x slower │ │ QQuery 42 │ 66.56ms │ 71.96ms │ 1.08x slower │ └──────────────┴─────────────┴────────────────────────────────────────────────┴───────────────┘ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━┓ ┃ Benchmark Summary ┃ ┃ ┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━┩ │ Total Time (apache_main) │ 142832.78ms │ │ Total Time (feature_conflicting_order_sensitive_aggregates) │ 127686.45ms │ │ Average Time (apache_main) │ 3321.69ms │ │ Average Time (feature_conflicting_order_sensitive_aggregates) │ 2969.45ms │ │ Queries Faster │ 10 │ │ Queries Slower │ 12 │ │ Queries with No Change │ 21 │ └───────────────────────────────────────────────────────────────┴─────────────┘ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
