beliefer opened a new pull request, #39049: URL: https://github.com/apache/spark/pull/39049
### What changes were proposed in this pull request? Currently, Spark runtime filter supports bloom filter and in subquery filter. The in subquery filter always execute `Murmur3Hash` before aggregate the join key. Because the data size before aggregate will lager than after, we can delay execute `Murmur3Hash` until after aggregation for semi-join runtime filter and it will reduce the number of calls to `Murmur3Hash` and improve performance. ### Why are the changes needed? Improve performance for semi-join runtime filter. ### Does this PR introduce _any_ user-facing change? 'No'. Just update the inner implementation. ### How was this patch tested? Manual tests TPC-DS. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
