baibaichen commented on PR #5735: URL: https://github.com/apache/incubator-gluten/pull/5735#issuecomment-2128434970
因为 BHJ 右表构建的逻辑改变了，测试结果如下：
| baseline | 对照组 5735
| |
| ----------------------------------------------------- |
---------------------------------------------------- | ---- |
| job_2190 [spark.sql.autoBroadcastJoinThreshold=20MB] |
| |
| job_2202 [spark.sql.autoBroadcastJoinThreshold=100MB] |
job_2203[spark.sql.autoBroadcastJoinThreshold=100MB] | |
| job_2206 [spark.sql.autoBroadcastJoinThreshold=100MB] |
job_2207[spark.sql.autoBroadcastJoinThreshold=100MB] | |
受 `spark.sql.autoBroadcastJoinThreshold` 影响比较大的查询是 q8,q9,q17,q18，我们看到
q8,q9,q17 都有 6% 的回退，结果如下：
| name |
[job_2207](https://opencicd.kyligence.com/job/gluten/job/gluten-perf/2207/) |
[job_2203](https://opencicd.kyligence.com/job/gluten/job/gluten-perf/2203/) |
[job_2206](https://opencicd.kyligence.com/job/gluten/job/gluten-perf/2206/) |
[job_2202](https://opencicd.kyligence.com/job/gluten/job/gluten-perf/2202/) |
job_2206-job2207 | job_2202-job2203 |
[job_2190](https://opencicd.kyligence.com/job/gluten/job/gluten-perf/2190/) |
job2190- job_2202 |
| ------- | ------------------------------------------------------------ |
------------------------------------------------------------ |
------------------------------------------------------------ |
------------------------------------------------------------ | ----------------
| ---------------- |
------------------------------------------------------------ |
----------------- |
| q01 | 3634 |
3682 | 3689
| 3653
| 55 | -29 | 3574
| -79 |
| q02 | 3180 |
3139 | 2904
| 2870
| -276 | -269 | 2313
| -557 |
| q03 | 5264 |
5386 | 5540
| 5399
| 276 | 13 | 5201
| -198 |
| q04 | 3295 |
3338 | 3438
| 3412
| 143 | 74 | 3262
| -150 |
| q05 | 8737 |
9065 | 8799
| 8828
| 62 | -237 | 8595
| -233 |
| q06 | 998 |
1027 | 1060
| 1032
| 62 | 5 | 999
| -33 |
| q07 | 9763 |
9958 | 9686
| 9856
| -77 | -102 | 9592
| -264 |
| **q08** | 4717 |
4840 | 4504
| 4539
| <u>-213</u> | <u>-301</u> | 8821
| **4282** |
| **q09** | 9230 |
9363 | 8824
| 8882
| <u>-406</u> | <u>-481</u> | 12956
| **4074** |
| q10 | 5604 |
5713 | 5834
| 5663
| 230 | -50 | 5638
| -25 |
| q11 | 1776 |
1792 | 1618
| 1606
| -158 | -186 | 1620
| 14 |
| q12 | 3932 |
4041 | 4056
| 3991
| 124 | -50 | 3882
| -109 |
| q13 | 3705 |
3671 | 3674
| 3660
| -31 | -11 | 3612
| -48 |
| q14 | 1997 |
2128 | 2091
| 2085
| 94 | -43 | 1987
| -98 |
| q15 | 4071 |
4204 | 3780
| 3753
| -291 | -451 | 3239
| -514 |
| q16 | 5403 |
5661 | 5572
| 5330
| 169 | -331 | 5363
| 33 |
| **q17** | 8725 |
9143 | 8662
| 8754
| <u>-63</u> | <u>-389</u> | 10985
| **2231** |
| **q18** | 11715 |
12066 | 12132
| 12137
| <u>417</u> | <u>71</u> | 14916
| **2779** |
| q19 | 3788 |
4005 | 3915
| 3985
| 127 | -20 | 3813
| -172 |
| q20 | 3223 |
3239 | 2984
| 2877
| -239 | -362 | 3258
| 381 |
| q21 | 28 |
28 | 28
| 25
| 0 | -3 | 26
| 1 |
| q22 | 1112 |
1157 | 1146
| 1111
| 34 | -46 | 1103
| -8 |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
