yihua commented on issue #930:
URL: https://github.com/apache/hudi-rs/issues/930#issuecomment-6536950917
TPC-H SF100 on DataFusion with hudi-rs 0.6.0 (`release-0.6.0-rc.1`,
DataFusion 55) and 0.5.0 (`release-0.5.0`, DataFusion 54). Query performance is
on par between the two releases: the total runtime is 190.9 s vs 191.6 s and
the geometric mean is 7.66 s vs 7.62 s. Individual queries move in both
directions (Q04, Q07 and Q08 are faster on 0.6.0; Q11, Q13 and Q22 are slower)
and net out to about the same.
Both versions ran on the same r8gd.4xlarge (us-west-2) against the same
SF100 Hudi COW tables on S3; each query has 2 warmup and 3 measured iterations,
and the chart shows the mean.
TPC-H Query Runtime Comparison
================================================================================
```
Q01 datafusion+hudi-rs 0.6.0 |███████████ |
7372.2 ms
datafusion+hudi-rs 0.5.0 |███████████ |
7326.6 ms
Q02 datafusion+hudi-rs 0.6.0 |██████ |
4065.2 ms
datafusion+hudi-rs 0.5.0 |██████ |
4360.6 ms
Q03 datafusion+hudi-rs 0.6.0 |██████████ |
6893.8 ms
datafusion+hudi-rs 0.5.0 |██████████ |
7095.4 ms
Q04 datafusion+hudi-rs 0.6.0 |███████████ |
7682.8 ms
datafusion+hudi-rs 0.5.0 |████████████ |
8464.4 ms
Q05 datafusion+hudi-rs 0.6.0 |███████████████ |
10097.5 ms
datafusion+hudi-rs 0.5.0 |███████████████ |
10330.2 ms
Q06 datafusion+hudi-rs 0.6.0 |██████████ |
7010.7 ms
datafusion+hudi-rs 0.5.0 |███████████ |
7649.7 ms
Q07 datafusion+hudi-rs 0.6.0 |█████████████ |
8920.4 ms
datafusion+hudi-rs 0.5.0 |██████████████ |
9739.1 ms
Q08 datafusion+hudi-rs 0.6.0 |████████████ |
8027.4 ms
datafusion+hudi-rs 0.5.0 |█████████████ |
8840.4 ms
Q09 datafusion+hudi-rs 0.6.0 |█████████████████ |
12002.1 ms
datafusion+hudi-rs 0.5.0 |██████████████████ |
12244.1 ms
Q10 datafusion+hudi-rs 0.6.0 |████████████ |
8315.0 ms
datafusion+hudi-rs 0.5.0 |████████████ |
8583.6 ms
Q11 datafusion+hudi-rs 0.6.0 |█████ |
3232.2 ms
datafusion+hudi-rs 0.5.0 |████ |
2484.2 ms
Q12 datafusion+hudi-rs 0.6.0 |███████████ |
7564.5 ms
datafusion+hudi-rs 0.5.0 |███████████ |
7611.8 ms
Q13 datafusion+hudi-rs 0.6.0 |████████ |
5417.8 ms
datafusion+hudi-rs 0.5.0 |███████ |
4884.8 ms
Q14 datafusion+hudi-rs 0.6.0 |████████ |
5488.1 ms
datafusion+hudi-rs 0.5.0 |████████ |
5307.4 ms
Q15 datafusion+hudi-rs 0.6.0 |██████████████████ |
12271.0 ms
datafusion+hudi-rs 0.5.0 |█████████████████ |
11755.3 ms
Q16 datafusion+hudi-rs 0.6.0 |███████ |
4626.9 ms
datafusion+hudi-rs 0.5.0 |███████ |
5029.5 ms
Q17 datafusion+hudi-rs 0.6.0 |███████████████ |
10431.3 ms
datafusion+hudi-rs 0.5.0 |██████████████ |
9950.8 ms
Q18 datafusion+hudi-rs 0.6.0 |████████████████████████████████████████ |
27623.9 ms
datafusion+hudi-rs 0.5.0 |████████████████████████████████████████ |
27419.6 ms
Q19 datafusion+hudi-rs 0.6.0 |██████████ |
6565.9 ms
datafusion+hudi-rs 0.5.0 |█████████ |
6446.8 ms
Q20 datafusion+hudi-rs 0.6.0 |███████████ |
7407.7 ms
datafusion+hudi-rs 0.5.0 |██████████ |
7114.1 ms
Q21 datafusion+hudi-rs 0.6.0 |███████████████████████ |
16042.2 ms
datafusion+hudi-rs 0.5.0 |███████████████████████ |
15694.6 ms
Q22 datafusion+hudi-rs 0.6.0 |██████ |
3843.1 ms
datafusion+hudi-rs 0.5.0 |█████ |
3262.0 ms
```
Summary
--------------------------------------------------------------------------------
```
Tot datafusion+hudi-rs 0.6.0 |████████████████████████████████████████ |
190901.5 ms
datafusion+hudi-rs 0.5.0 |████████████████████████████████████████ |
191595.1 ms
Geo datafusion+hudi-rs 0.6.0 |████████████████████████████████████████ |
7663.1 ms
datafusion+hudi-rs 0.5.0 |████████████████████████████████████████ |
7622.5 ms
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
