gruuya commented on PR #25292: URL: https://github.com/apache/datafusion/pull/25292#issuecomment-5762702179
> Happy to prototype it on top of your branch and post A/B numbers (your clustered case, the unclustered repro, and a clustered build side past 100k keys) @jayzhan211 if you're still up for doing this please let me know. I do have a [PoC](https://github.com/apache/datafusion/compare/main...splitgraph:arrow-datafusion:hash-join-dynamic-pruning-bitmap) clauded up but i'd need to do a self-review first before opening up a PR, and it might take you less time to do the same. Benchmarking shows the PoC is within the margin of this branch when it comes to the unclustered scenario (which is the default in tpc-{h,ds}), but it's slightly more complex. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
