findepi commented on PR #13147: URL: https://github.com/apache/datafusion/pull/13147#issuecomment-2449500965
In Trino a similar feature is called Dynamic Filters, but it doesn't use Bloom filters for filtering. AFAIK, Bloom filters were considered (that was the initial idea), but didn't end up being the chosen implementation strategy. The implementation tracks "ranges" of allowed values instead. I am not very familiar with the reasoning, but it wasn't incidental. @mbutrovich would it be worthwhile to familiarize with Dynamic Filters in Trino and reasoning behind design decisions? Their slack is probably best place to ask. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
