alamb commented on PR #6034: URL: https://github.com/apache/arrow-datafusion/pull/6034#issuecomment-1520256950
I got similar results in my next performance run: ``` ****** TPCH SF1 (Parquet) ****** + python3 /home/alamb/arrow-datafusion/benchmarks/compare.py /home/alamb/benchmarking/feature%2Fstream_groupby4/tpch_sf1_parquet_main.json /home/alamb/benchmarking/feature%2Fstream_groupby4/tpch_sf1_parquet_branch.json ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┓ ┃ Query ┃ /home/alamb… ┃ /home/alamb… ┃ Change ┃ ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━┩ │ QQuery 1 │ 1439.84ms │ 1472.45ms │ no change │ │ QQuery 2 │ 408.59ms │ 428.13ms │ no change │ │ QQuery 3 │ 541.64ms │ 550.25ms │ no change │ │ QQuery 4 │ 218.62ms │ 227.71ms │ no change │ │ QQuery 5 │ 690.76ms │ 702.12ms │ no change │ │ QQuery 6 │ 447.31ms │ 456.74ms │ no change │ │ QQuery 7 │ 1223.94ms │ 1262.33ms │ no change │ │ QQuery 8 │ 707.30ms │ 731.55ms │ no change │ │ QQuery 9 │ 1331.92ms │ 1309.76ms │ no change │ │ QQuery 10 │ 791.17ms │ 813.92ms │ no change │ │ QQuery 11 │ 338.22ms │ 338.76ms │ no change │ │ QQuery 12 │ 330.78ms │ 329.38ms │ no change │ │ QQuery 13 │ 1102.45ms │ 1134.98ms │ no change │ │ QQuery 14 │ 450.43ms │ 447.24ms │ no change │ │ QQuery 15 │ 401.69ms │ 407.17ms │ no change │ │ QQuery 16 │ 335.41ms │ 370.62ms │ 1.10x slower │ │ QQuery 17 │ 2793.22ms │ 2984.28ms │ 1.07x slower │ │ QQuery 18 │ 3602.06ms │ 3855.55ms │ 1.07x slower │ │ QQuery 19 │ 757.20ms │ 772.06ms │ no change │ │ QQuery 20 │ 1208.05ms │ 1409.62ms │ 1.17x slower │ │ QQuery 21 │ 1662.33ms │ 1672.38ms │ no change │ │ QQuery 22 │ 191.45ms │ 195.55ms │ no change │ └──────────────┴──────────────┴──────────────┴──────────────┘ + echo '****** TPCH SF1 (mem) ******' ****** TPCH SF1 (mem) ****** + python3 /home/alamb/arrow-datafusion/benchmarks/compare.py /home/alamb/benchmarking/feature%2Fstream_groupby4/tpch_sf1_mem_main.json /home/alamb/benchmarking/feature%2Fstream_groupby4/tpch_sf1_mem_branch.json ┏━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━┳━━━━━━━━━━━━━━━┓ ┃ Query ┃ -o ┃ -o ┃ Change ┃ ┡━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━╇━━━━━━━━━━━━━━━┩ │ QQuery 1 │ 731.33ms │ 759.80ms │ no change │ │ QQuery 2 │ 266.90ms │ 315.18ms │ 1.18x slower │ │ QQuery 3 │ 168.24ms │ 181.07ms │ 1.08x slower │ │ QQuery 4 │ 107.01ms │ 107.07ms │ no change │ │ QQuery 5 │ 469.84ms │ 472.69ms │ no change │ │ QQuery 6 │ 37.35ms │ 38.33ms │ no change │ │ QQuery 7 │ 1119.56ms │ 1121.01ms │ no change │ │ QQuery 8 │ 253.48ms │ 258.02ms │ no change │ │ QQuery 9 │ 595.14ms │ 604.48ms │ no change │ │ QQuery 10 │ 326.75ms │ 343.41ms │ 1.05x slower │ │ QQuery 11 │ 262.07ms │ 293.92ms │ 1.12x slower │ │ QQuery 12 │ 141.94ms │ 151.47ms │ 1.07x slower │ │ QQuery 13 │ 645.04ms │ 698.31ms │ 1.08x slower │ │ QQuery 14 │ 51.78ms │ 48.35ms │ +1.07x faster │ │ QQuery 15 │ 100.32ms │ 114.44ms │ 1.14x slower │ │ QQuery 16 │ 240.47ms │ 285.68ms │ 1.19x slower │ │ QQuery 17 │ 2448.05ms │ 2590.14ms │ 1.06x slower │ │ QQuery 18 │ 3131.16ms │ 3295.09ms │ 1.05x slower │ │ QQuery 19 │ 147.72ms │ 150.86ms │ no change │ │ QQuery 20 │ 931.54ms │ 1052.21ms │ 1.13x slower │ │ QQuery 21 │ 1454.51ms │ 1438.62ms │ no change │ │ QQuery 22 │ 144.76ms │ 141.84ms │ no change │ └──────────────┴──────────────┴──────────────┴───────────────┘ ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
