Re: [PR] [SPARK-47870][SQL] Optimize predicate after push extra predicate through join [spark]

2024-04-16 Thread via GitHub
zml1206 commented on PR #46085: URL: https://github.com/apache/spark/pull/46085#issuecomment-2060202987 cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [SPARK-47870][SQL] Optimize predicate after push extra predicate through join [spark]

2024-04-16 Thread via GitHub
zml1206 commented on code in PR #46085: URL: https://github.com/apache/spark/pull/46085#discussion_r1568115344 ## sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/FilterPushdownSuite.scala: ## @@ -46,15 +46,30 @@ class FilterPushdownSuite extends PlanTest {

[PR] [SPARK-47870][SQL] Optimize predicate after push extra predicate through join [spark]

2024-04-16 Thread via GitHub
zml1206 opened a new pull request, #46085: URL: https://github.com/apache/spark/pull/46085 ### What changes were proposed in this pull request? Add rules `ConstantFolding`、`BooleanSimplification` and `PruneFilters` at last of push extra predicate through join batch to optimize