Dandandan commented on issue #11212: URL: https://github.com/apache/datafusion/issues/11212#issuecomment-2205591055
Thanks for providing some benchmarks / example @acking-you ! I think the missing optimizations seem to be: * Checking for array.true_count() to be all zero / all true. I think this is an optimization that might be better to implement in the arrow-rs and/or (_and_kleene_, _or_kleene_) kernels as a special case instead of in DataFusion. * UDF -> Immutable/non-volatile are executed during optimization in the constant evaluator, so the extra optimization will only apply for _non-volatile UDFs_. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
