adriangb commented on PR #18306:
URL: https://github.com/apache/datafusion/pull/18306#issuecomment-3452548069
Here's some initial results:
```
โฏ cargo run --release -p datafusion-cli -- -f q.sql
Finished `release` profile [optimized] target(s) in 0.47s
Running `target/release/datafusion-cli -f q.sql`
DataFusion CLI v50.3.0
+-------+
| count |
+-------+
| 1000 |
+-------+
1 row(s) fetched.
Elapsed 0.006 seconds.
0 row(s) fetched.
Elapsed 0.001 seconds.
+-----------+
| count |
+-----------+
| 100000000 |
+-----------+
1 row(s) fetched.
Elapsed 1.746 seconds.
0 row(s) fetched.
Elapsed 0.001 seconds.
+----+----+----+
| k | v | k |
+----+----+----+
| 50 | 50 | 50 |
| 51 | 51 | 51 |
| 52 | 52 | 52 |
| 53 | 53 | 53 |
| 54 | 54 | 54 |
| 55 | 55 | 55 |
| 56 | 56 | 56 |
| 57 | 57 | 57 |
| 58 | 58 | 58 |
| 59 | 59 | 59 |
| 60 | 60 | 60 |
| 61 | 61 | 61 |
| 62 | 62 | 62 |
| 63 | 63 | 63 |
| 64 | 64 | 64 |
| 65 | 65 | 65 |
| 66 | 66 | 66 |
| 67 | 67 | 67 |
| 68 | 68 | 68 |
| 69 | 69 | 69 |
| 70 | 70 | 70 |
| 71 | 71 | 71 |
| 72 | 72 | 72 |
| 73 | 73 | 73 |
| 74 | 74 | 74 |
| 75 | 75 | 75 |
| 76 | 76 | 76 |
| 77 | 77 | 77 |
| 78 | 78 | 78 |
| 79 | 79 | 79 |
| 80 | 80 | 80 |
| 81 | 81 | 81 |
| 82 | 82 | 82 |
| 83 | 83 | 83 |
| 84 | 84 | 84 |
| 85 | 85 | 85 |
| 86 | 86 | 86 |
| 87 | 87 | 87 |
| 88 | 88 | 88 |
| 89 | 89 | 89 |
| . |
| . |
| . |
+----+----+----+
951 row(s) fetched. (First 40 displayed. Use --maxrows to adjust)
Elapsed 0.004 seconds.
datafusion on ๎ pushdown-hashes-case [?] is ๐ฆ v50.3.0 via ๐ v3.13.7
(datafusion-benchmark) via ๐ฆ v1.90.0 on โ๏ธ [email protected](us-east4) took
3s
โฏ datafusion-cli -f q.sql
DataFusion CLI v50.0.0
+-------+
| count |
+-------+
| 1000 |
+-------+
1 row(s) fetched.
Elapsed 0.065 seconds.
0 row(s) fetched.
Elapsed 0.004 seconds.
+-----------+
| count |
+-----------+
| 100000000 |
+-----------+
1 row(s) fetched.
Elapsed 1.531 seconds.
0 row(s) fetched.
Elapsed 0.001 seconds.
+----+----+----+
| k | v | k |
+----+----+----+
| 50 | 50 | 50 |
| 51 | 51 | 51 |
| 52 | 52 | 52 |
| 53 | 53 | 53 |
| 54 | 54 | 54 |
| 55 | 55 | 55 |
| 56 | 56 | 56 |
| 57 | 57 | 57 |
| 58 | 58 | 58 |
| 59 | 59 | 59 |
| 60 | 60 | 60 |
| 61 | 61 | 61 |
| 62 | 62 | 62 |
| 63 | 63 | 63 |
| 64 | 64 | 64 |
| 65 | 65 | 65 |
| 66 | 66 | 66 |
| 67 | 67 | 67 |
| 68 | 68 | 68 |
| 69 | 69 | 69 |
| 70 | 70 | 70 |
| 71 | 71 | 71 |
| 72 | 72 | 72 |
| 73 | 73 | 73 |
| 74 | 74 | 74 |
| 75 | 75 | 75 |
| 76 | 76 | 76 |
| 77 | 77 | 77 |
| 78 | 78 | 78 |
| 79 | 79 | 79 |
| 80 | 80 | 80 |
| 81 | 81 | 81 |
| 82 | 82 | 82 |
| 83 | 83 | 83 |
| 84 | 84 | 84 |
| 85 | 85 | 85 |
| 86 | 86 | 86 |
| 87 | 87 | 87 |
| 88 | 88 | 88 |
| 89 | 89 | 89 |
| . |
| . |
| . |
+----+----+----+
951 row(s) fetched. (First 40 displayed. Use --maxrows to adjust)
Elapsed 0.136 seconds.
datafusion on ๎ pushdown-hashes-case [?] is ๐ฆ v50.3.0 via ๐ v3.13.7
(datafusion-benchmark) via ๐ฆ v1.90.0 on โ๏ธ [email protected](us-east4)
โฏ ./benchmarks/bench.sh compare main pushdown-hashes-case
Comparing main and pushdown-hashes-case
--------------------
Benchmark tpch_sf10.json
--------------------
โโโโโโโโโโโโโโโโณโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโโโโโ
โ Query โ main โ pushdown-hashes-case โ Change โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ QQuery 1 โ 495.39 ms โ 443.15 ms โ +1.12x faster โ
โ QQuery 2 โ 94.35 ms โ 86.27 ms โ +1.09x faster โ
โ QQuery 3 โ 255.05 ms โ 248.12 ms โ no change โ
โ QQuery 4 โ 209.80 ms โ 196.09 ms โ +1.07x faster โ
โ QQuery 5 โ 375.67 ms โ 349.27 ms โ +1.08x faster โ
โ QQuery 6 โ 146.43 ms โ 133.02 ms โ +1.10x faster โ
โ QQuery 7 โ 573.03 ms โ 505.02 ms โ +1.13x faster โ
โ QQuery 8 โ 434.82 ms โ 366.27 ms โ +1.19x faster โ
โ QQuery 9 โ 653.18 ms โ 558.85 ms โ +1.17x faster โ
โ QQuery 10 โ 359.55 ms โ 330.17 ms โ +1.09x faster โ
โ QQuery 11 โ 77.48 ms โ 66.45 ms โ +1.17x faster โ
โ QQuery 12 โ 204.63 ms โ 188.96 ms โ +1.08x faster โ
โ QQuery 13 โ 359.42 ms โ 345.62 ms โ no change โ
โ QQuery 14 โ 178.11 ms โ 178.12 ms โ no change โ
โ QQuery 15 โ 260.67 ms โ 258.49 ms โ no change โ
โ QQuery 16 โ 64.22 ms โ 66.97 ms โ no change โ
โ QQuery 17 โ 656.44 ms โ 703.65 ms โ 1.07x slower โ
โ QQuery 18 โ 1193.44 ms โ 1072.72 ms โ +1.11x faster โ
โ QQuery 19 โ 293.48 ms โ 285.36 ms โ no change โ
โ QQuery 20 โ 236.95 ms โ 235.57 ms โ no change โ
โ QQuery 21 โ 706.11 ms โ 692.01 ms โ no change โ
โ QQuery 22 โ 84.61 ms โ 84.55 ms โ no change โ
โโโโโโโโโโโโโโโโดโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโโโโโ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโณโโโโโโโโโโโโ
โ Benchmark Summary โ โ
โกโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโฉ
โ Total Time (main) โ 7912.82ms โ
โ Total Time (pushdown-hashes-case) โ 7394.69ms โ
โ Average Time (main) โ 359.67ms โ
โ Average Time (pushdown-hashes-case) โ 336.12ms โ
โ Queries Faster โ 12 โ
โ Queries Slower โ 1 โ
โ Queries with No Change โ 9 โ
โ Queries with Failure โ 0 โ
โโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโโดโโโโโโโโโโโโ
```
Where `q.sql` is basically
https://datafusion.apache.org/blog/2025/09/10/dynamic-filters/#hash-join-dynamic-filters
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
