andygrove commented on PR #3536:
URL:
https://github.com/apache/datafusion-comet/pull/3536#issuecomment-3910545337
I ran a memory profiling comparison to main with replaceSortMergeJoin=false
as well.
| Query | BL Time (s) | DF52 Time (s) | Time Delta | BL OffHeap Exec | DF52
OffHeap Exec | OffHeap Delta | BL JVM Heap | DF52 JVM Heap | Heap Delta |
|-------|-------------|---------------|------------|-----------------|-------------------|---------------|-------------|---------------|------------|
| Q1 | 82.6 | 82.5 | -0.2% | 514 MB | 514 MB | 0.0% | 5.53 GB | 4.15 GB |
-25.0% |
| Q2 | 15.9 | 15.6 | -1.8% | n/a | n/a | n/a | n/a | 2.84 GB | n/a |
| Q3 | 30.0 | 30.1 | +0.3% | 3.75 GB | 1.69 GB | -54.9% | 4.37 GB | 3.55 GB
| -18.8% |
| Q4 | 24.9 | 25.1 | +0.9% | 16.00 GB | 16.00 GB | 0.0% | 2.52 GB | 2.15 GB
| -14.8% |
| Q5 | 58.2 | 57.3 | -1.4% | 3.51 GB | 3.00 GB | -14.5% | 3.72 GB | 5.55 GB
| +49.3% |
| Q6 | 4.8 | 5.0 | +5.3% | n/a | n/a | n/a | n/a | n/a | n/a |
| Q7 | 28.5 | 27.7 | -2.5% | 2.62 GB | n/a | n/a | 6.55 GB | 6.76 GB | +3.3%
|
| Q8 | 42.8 | 41.9 | -2.1% | 657 MB | n/a | n/a | 7.01 GB | 6.12 GB | -12.6%
|
| Q9 | 86.1 | 86.6 | +0.6% | 3.00 GB | 3.00 GB | 0.0% | 5.39 GB | 6.56 GB |
+21.7% |
| Q10 | 24.1 | 25.0 | +3.7% | 3.04 GB | 1.43 GB | -53.0% | 2.29 GB | 1.25 GB
| -45.5% |
| Q11 | 17.2 | 17.4 | +1.2% | 1.00 GB | 2.00 GB | +100.0% | 2.82 GB | 3.79
GB | +34.5% |
| Q12 | 16.7 | 16.3 | -2.7% | 644 MB | n/a | n/a | 4.37 GB | n/a | n/a |
| Q13 | 25.2 | 24.8 | -1.7% | 5.16 GB | 5.13 GB | -0.5% | 3.05 GB | 4.06 GB
| +33.1% |
| Q14 | 8.6 | 8.7 | +0.9% | n/a | n/a | n/a | n/a | n/a | n/a |
| Q15 | 19.6 | 19.5 | -0.4% | 460 MB | 520 MB | +12.9% | 1.81 GB | 2.13 GB |
+17.2% |
| Q16 | 11.4 | 10.6 | -6.7% | n/a | 2.00 GB | n/a | n/a | 3.69 GB | n/a |
| Q17 | 77.7 | 78.0 | +0.4% | 2.03 GB | 2.02 GB | -0.8% | 4.44 GB | 5.24 GB
| +17.9% |
| Q18 | 82.7 | 82.1 | -0.8% | 3.19 GB | 4.75 GB | +49.0% | 5.96 GB | 5.91 GB
| -0.9% |
| Q19 | 9.6 | 9.6 | -0.5% | n/a | n/a | n/a | n/a | n/a | n/a |
| Q20 | 14.4 | 14.5 | +0.8% | n/a | n/a | n/a | 3.44 GB | n/a | n/a |
| Q21 | 79.1 | 78.6 | -0.7% | 5.13 GB | 5.25 GB | +2.4% | 4.58 GB | 4.93 GB
| +7.7% |
| Q22 | 12.6 | 12.6 | -0.4% | n/a | n/a | n/a | 1.95 GB | n/a | n/a |
| Total | 772.6 | 769.4 | -0.4% | | | | | | |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
