hhr293 commented on PR #12756: URL: https://github.com/apache/gluten/pull/12756#issuecomment-5311525804
> Thanks for the PR! It looks like this change introduces a dedicated optimizer rule. Have you considered contributing this optimization upstream to the Spark community as well? It seems fairly generic and potentially useful beyond Gluten. Thanks for the suggestion. The rewrite itself is generic, but the performance issue was identified and validated on Gluten/Velox. We kept it in Gluten first to limit the rollout scope while validating correctness and profitability. If the rule proves broadly applicable, upstreaming it to Spark would be the natural next step. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
