gabotechs commented on issue #20176: URL: https://github.com/apache/datafusion/issues/20176#issuecomment-3858739065
I imagine that there should be a relatively easy fix for this though, we can be in two situations: 1. There is a RepartitionExec in between the producer and consumer side of the dynamic filter => the expressions the producer side of the dynamic filter needs to account for it by building expressions that look like `CASE hash(key) % N...` 2. There is no RepartitionExec in between the producer and consumer side of the dynamic filter => it's fine to treat each partition in isolation, the producer side of the dynamic filter can work per partition and produce one expression for partition 0, that will be consumed by the partition 0 on the consumer side, same for all the other partitions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
