ulysses-you commented on PR #36180:
URL: https://github.com/apache/spark/pull/36180#issuecomment-1102596212
Some performance number with the benchmark:
```
sort merge join with buffered side duplicates, switched: true,:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns)
Relative
-------------------------------------------------------------------------------------------------------------------------------------------------------------
sort merge join with buffered side duplicates, switched: true, wholestage
off 5175 5196 30 6.5 154.2
1.0X
sort merge join with buffered side duplicates, switched: true, wholestage
on 4991 5221 407 6.7 148.7
1.0X
Running benchmark: sort merge join with buffered side duplicates, switched:
false,
Running case: sort merge join with buffered side duplicates, switched:
false, wholestage off
Stopped after 2 iterations, 12610 ms
Running case: sort merge join with buffered side duplicates, switched:
false, wholestage on
Stopped after 5 iterations, 33804 ms
OpenJDK 64-Bit Server VM 1.8.0_322-b06 on Mac OS X 12.3.1
Apple M1 Pro
sort merge join with buffered side duplicates, switched: false,:
Best Time(ms) Avg Time(ms) Stdev(ms) Rate(M/s) Per Row(ns)
Relative
--------------------------------------------------------------------------------------------------------------------------------------------------------------
sort merge join with buffered side duplicates, switched: false, wholestage
off 6291 6305 20 5.3 187.5
1.0X
sort merge join with buffered side duplicates, switched: false, wholestage
on 6635 6761 126 5.1 197.7
0.9X
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
