ulysses-you commented on PR #37239: URL: https://github.com/apache/spark/pull/37239#issuecomment-1191310121
> BTW, does filter pushdown have the same issue? no The conflicts issue has been hacky fixed in ColumnPruning https://github.com/apache/spark/blob/c2536a7eabd8764cbbaaff22935e19685b92f22b/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala#L819-L829 Due to the subexpression elimination in codegen, the complex expression is not an issue too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
