xudong963 commented on PR #22406: URL: https://github.com/apache/datafusion/pull/22406#issuecomment-4505567382
``` Comparing HEAD and optimize-metric-label-clone -------------------- Benchmark clickbench_partitioned.json -------------------- ┏━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓ ┃ Query ┃ HEAD ┃ optimize-metric-label-clone ┃ Change ┃ ┡━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩ │ QQuery 0 │ 1.25 / 4.88 ±7.10 / 19.08 ms │ 1.24 / 4.74 ±6.85 / 18.44 ms │ no change │ │ QQuery 1 │ 12.72 / 13.19 ±0.27 / 13.54 ms │ 12.41 / 12.59 ±0.12 / 12.79 ms │ no change │ │ QQuery 2 │ 36.05 / 36.35 ±0.29 / 36.76 ms │ 35.26 / 35.49 ±0.20 / 35.77 ms │ no change │ │ QQuery 3 │ 30.56 / 31.21 ±0.56 / 32.26 ms │ 30.05 / 30.67 ±0.40 / 31.15 ms │ no change │ │ QQuery 4 │ 227.42 / 230.90 ±2.03 / 232.73 ms │ 222.91 / 226.11 ±2.73 / 229.55 ms │ no change │ │ QQuery 5 │ 282.95 / 291.43 ±5.71 / 299.55 ms │ 269.88 / 272.91 ±1.95 / 275.02 ms │ +1.07x faster │ │ QQuery 6 │ 1.31 / 1.45 ±0.21 / 1.87 ms │ 1.30 / 1.44 ±0.21 / 1.85 ms │ no change │ │ QQuery 7 │ 14.49 / 14.72 ±0.20 / 15.06 ms │ 13.24 / 13.41 ±0.11 / 13.52 ms │ +1.10x faster │ │ QQuery 8 │ 353.72 / 358.26 ±3.25 / 363.10 ms │ 316.77 / 322.80 ±4.98 / 330.69 ms │ +1.11x faster │ │ QQuery 9 │ 504.80 / 525.83 ±16.69 / 550.95 ms │ 453.11 / 461.08 ±6.06 / 468.47 ms │ +1.14x faster │ │ QQuery 10 │ 74.89 / 75.79 ±0.59 / 76.70 ms │ 67.44 / 68.56 ±0.93 / 69.97 ms │ +1.11x faster │ │ QQuery 11 │ 85.71 / 88.28 ±1.49 / 90.21 ms │ 79.50 / 85.36 ±7.18 / 98.84 ms │ no change │ │ QQuery 12 │ 302.66 / 313.37 ±9.02 / 326.65 ms │ 264.62 / 268.11 ±3.82 / 274.21 ms │ +1.17x faster │ │ QQuery 13 │ 395.13 / 410.33 ±10.08 / 422.76 ms │ 362.85 / 379.92 ±18.18 / 412.54 ms │ +1.08x faster │ │ QQuery 14 │ 297.13 / 306.98 ±5.39 / 311.50 ms │ 278.44 / 284.32 ±8.03 / 299.70 ms │ +1.08x faster │ │ QQuery 15 │ 279.03 / 290.90 ±7.09 / 298.52 ms │ 262.63 / 276.79 ±13.07 / 294.05 ms │ no change │ │ QQuery 16 │ 643.31 / 658.86 ±9.23 / 670.52 ms │ 606.35 / 618.16 ±9.99 / 634.22 ms │ +1.07x faster │ │ QQuery 17 │ 619.64 / 626.45 ±3.58 / 629.18 ms │ 607.94 / 622.64 ±9.62 / 638.01 ms │ no change │ │ QQuery 18 │ 1277.23 / 1309.21 ±24.11 / 1339.36 ms │ 1236.62 / 1268.49 ±23.29 / 1298.67 ms │ no change │ │ QQuery 19 │ 28.38 / 33.27 ±5.80 / 42.04 ms │ 27.17 / 30.62 ±6.22 / 43.03 ms │ +1.09x faster │ │ QQuery 20 │ 540.87 / 552.94 ±17.26 / 587.01 ms │ 512.30 / 518.43 ±6.56 / 530.92 ms │ +1.07x faster │ │ QQuery 21 │ 631.41 / 668.91 ±24.18 / 698.39 ms │ 590.60 / 596.31 ±3.09 / 599.34 ms │ +1.12x faster │ │ QQuery 22 │ 1090.23 / 1163.35 ±48.21 / 1216.81 ms │ 1049.01 / 1062.04 ±14.23 / 1086.27 ms │ +1.10x faster │ │ QQuery 23 │ 3170.41 / 3242.28 ±74.02 / 3371.65 ms │ 3153.57 / 3177.24 ±20.39 / 3211.35 ms │ no change │ │ QQuery 24 │ 41.69 / 42.28 ±0.78 / 43.77 ms │ 41.72 / 46.02 ±4.86 / 54.71 ms │ 1.09x slower │ │ QQuery 25 │ 111.63 / 114.54 ±2.86 / 119.78 ms │ 110.56 / 112.35 ±0.95 / 113.40 ms │ no change │ │ QQuery 26 │ 42.14 / 46.10 ±4.95 / 55.41 ms │ 42.27 / 43.81 ±1.95 / 47.48 ms │ no change │ │ QQuery 27 │ 664.33 / 675.94 ±8.66 / 691.28 ms │ 666.57 / 680.76 ±8.10 / 688.32 ms │ no change │ │ QQuery 28 │ 3028.56 / 3214.93 ±169.71 / 3421.29 ms │ 3022.95 / 3039.02 ±15.83 / 3069.37 ms │ +1.06x faster │ │ QQuery 29 │ 45.27 / 51.26 ±10.61 / 72.47 ms │ 41.32 / 48.36 ±5.12 / 54.61 ms │ +1.06x faster │ │ QQuery 30 │ 313.84 / 339.16 ±31.47 / 398.98 ms │ 295.28 / 306.27 ±9.20 / 323.23 ms │ +1.11x faster │ │ QQuery 31 │ 293.78 / 310.80 ±16.66 / 339.43 ms │ 279.12 / 285.27 ±6.67 / 298.12 ms │ +1.09x faster │ │ QQuery 32 │ 927.95 / 977.48 ±33.70 / 1016.01 ms │ 939.54 / 963.27 ±25.79 / 1012.67 ms │ no change │ │ QQuery 33 │ 1445.41 / 1454.09 ±11.45 / 1475.87 ms │ 1453.82 / 1482.26 ±18.84 / 1503.58 ms │ no change │ │ QQuery 34 │ 1433.66 / 1474.45 ±28.90 / 1508.60 ms │ 1459.84 / 1478.18 ±12.08 / 1495.87 ms │ no change │ │ QQuery 35 │ 282.32 / 285.97 ±3.37 / 292.26 ms │ 297.44 / 306.43 ±8.38 / 320.56 ms │ 1.07x slower │ │ QQuery 36 │ 68.57 / 78.19 ±7.80 / 92.35 ms │ 66.89 / 70.39 ±4.74 / 79.58 ms │ +1.11x faster │ │ QQuery 37 │ 36.22 / 40.35 ±4.89 / 48.98 ms │ 36.08 / 37.56 ±2.12 / 41.72 ms │ +1.07x faster │ │ QQuery 38 │ 44.43 / 45.82 ±1.62 / 48.97 ms │ 40.47 / 45.41 ±7.69 / 60.73 ms │ no change │ │ QQuery 39 │ 144.07 / 149.52 ±3.05 / 152.79 ms │ 142.12 / 150.57 ±7.21 / 162.31 ms │ no change │ │ QQuery 40 │ 14.34 / 15.46 ±1.39 / 18.14 ms │ 14.26 / 14.55 ±0.15 / 14.71 ms │ +1.06x faster │ │ QQuery 41 │ 13.97 / 14.21 ±0.26 / 14.71 ms │ 14.12 / 14.27 ±0.12 / 14.40 ms │ no change │ │ QQuery 42 │ 13.36 / 15.74 ±3.62 / 22.95 ms │ 13.30 / 13.54 ±0.15 / 13.74 ms │ +1.16x faster │ └───────────┴────────────────────────────────────────┴───────────────────────────────────────┴───────────────┘ ┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┳━━━━━━━━━━━━┓ ┃ Benchmark Summary ┃ ┃ ┡━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━╇━━━━━━━━━━━━┩ │ Total Time (HEAD) │ 20595.44ms │ │ Total Time (optimize-metric-label-clone) │ 19776.53ms │ │ Average Time (HEAD) │ 478.96ms │ │ Average Time (optimize-metric-label-clone) │ 459.92ms │ │ Queries Faster │ 21 │ │ Queries Slower │ 2 │ │ Queries with No Change │ 20 │ │ Queries with Failure │ 0 │ └────────────────────────────────────────────┴────────────┘ ``` It shows similar performance improvements as lazy registration. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
