devanbenz commented on issue #26169: URL: https://github.com/apache/datafusion/issues/26169#issuecomment-6134798328
I have an experiment at #26249 where instead of a `CASE` statement to route probe rows to the hash tables of a partitioned hash join, it uses a specialized expression that routes by row index. `CASE` copies the batch's columns to isolate each branch's rows, this new expression only ever touches the hashes making sure we don't need to perform the copies. It appears to improve performance overall for most TPC-H queries, with Q17 showing a huge improvement: - main: 5.57s - #26249: 2.20s -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
