adesh-rao opened a new issue, #7548:
URL: https://github.com/apache/incubator-gluten/issues/7548
### Backend
VL (Velox)
### Bug description
Setup: Running TPCDS benchmark on spark with gluten.
With increasing broadcast hash join threshold, the performance of TPCDS
benchmark degrades (config: `spark.sql.autoBroadcastJoinThreshold`).
Config-Value|TPCDS Total Time Taken
-|-
10MB|795sec
50MB|870sec
100MB|890sec
We have jobs with BHJ threshold set to 200MB in vanilla spark. Such jobs are
not showing any gains with Spark+Gluten.
### Spark version
Spark-3.5.x
### Spark configurations
`spark.sql.autoBroadcastJoinThreshold`
### System information
_No response_
### Relevant logs
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
