adriangb commented on PR #16433: URL: https://github.com/apache/datafusion/pull/16433#issuecomment-3184720872
ClickBench results for partitioned datasets look much better: ``` ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓ ┃ Query ┃ main ┃ topk-filters ┃ Change ┃ ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩ │ QQuery 0 │ 0.92 ms │ 1.15 ms │ 1.25x slower │ │ QQuery 1 │ 12.45 ms │ 11.01 ms │ +1.13x faster │ │ QQuery 2 │ 42.41 ms │ 35.19 ms │ +1.21x faster │ │ QQuery 3 │ 40.63 ms │ 33.55 ms │ +1.21x faster │ │ QQuery 4 │ 337.67 ms │ 267.36 ms │ +1.26x faster │ │ QQuery 5 │ 434.44 ms │ 362.25 ms │ +1.20x faster │ │ QQuery 6 │ 1.21 ms │ 1.05 ms │ +1.15x faster │ │ QQuery 7 │ 14.20 ms │ 11.94 ms │ +1.19x faster │ │ QQuery 8 │ 413.55 ms │ 317.13 ms │ +1.30x faster │ │ QQuery 9 │ 601.85 ms │ 480.06 ms │ +1.25x faster │ │ QQuery 10 │ 100.43 ms │ 84.75 ms │ +1.18x faster │ │ QQuery 11 │ 108.91 ms │ 91.61 ms │ +1.19x faster │ │ QQuery 12 │ 419.13 ms │ 323.82 ms │ +1.29x faster │ │ QQuery 13 │ 570.70 ms │ 481.27 ms │ +1.19x faster │ │ QQuery 14 │ 428.36 ms │ 310.63 ms │ +1.38x faster │ │ QQuery 15 │ 426.88 ms │ 309.22 ms │ +1.38x faster │ │ QQuery 16 │ 1251.45 ms │ 729.69 ms │ +1.72x faster │ │ QQuery 17 │ 1175.59 ms │ 738.35 ms │ +1.59x faster │ │ QQuery 18 │ 2670.84 ms │ 1945.33 ms │ +1.37x faster │ │ QQuery 19 │ 41.71 ms │ 32.77 ms │ +1.27x faster │ │ QQuery 20 │ 1002.98 ms │ 738.13 ms │ +1.36x faster │ │ QQuery 21 │ 969.39 ms │ 763.04 ms │ +1.27x faster │ │ QQuery 22 │ 1506.05 ms │ 1214.86 ms │ +1.24x faster │ │ QQuery 23 │ 4418.24 ms │ 4008.72 ms │ +1.10x faster │ │ QQuery 24 │ 198.37 ms │ 196.65 ms │ no change │ │ QQuery 25 │ 150.97 ms │ 150.72 ms │ no change │ │ QQuery 26 │ 200.45 ms │ 191.65 ms │ no change │ │ QQuery 27 │ 1007.57 ms │ 893.24 ms │ +1.13x faster │ │ QQuery 28 │ 7214.47 ms │ 7065.58 ms │ no change │ │ QQuery 29 │ 356.81 ms │ 327.34 ms │ +1.09x faster │ │ QQuery 30 │ 323.66 ms │ 310.25 ms │ no change │ │ QQuery 31 │ 366.94 ms │ 346.37 ms │ +1.06x faster │ │ QQuery 32 │ 2028.11 ms │ 1692.80 ms │ +1.20x faster │ │ QQuery 33 │ 2286.38 ms │ 1775.46 ms │ +1.29x faster │ │ QQuery 34 │ 1978.34 ms │ 2305.40 ms │ 1.17x slower │ │ QQuery 35 │ 555.06 ms │ 552.82 ms │ no change │ │ QQuery 36 │ 61.16 ms │ 62.54 ms │ no change │ │ QQuery 37 │ 24.59 ms │ 23.99 ms │ no change │ │ QQuery 38 │ 61.70 ms │ 63.87 ms │ no change │ │ QQuery 39 │ 102.67 ms │ 103.98 ms │ no change │ │ QQuery 40 │ 17.16 ms │ 18.43 ms │ 1.07x slower │ │ QQuery 41 │ 16.16 ms │ 17.05 ms │ 1.06x slower │ │ QQuery 42 │ 12.72 ms │ 13.14 ms │ no change │ └──────────────┴────────────┴──────────────┴───────────────┘ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org