[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625876#comment-16625876
]
Yuming Wang commented on SPARK-23985:
-
Thanks [~uzadude] I will deep dive it.
> predicate push down
[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625448#comment-16625448
]
Ohad Raviv commented on SPARK-23985:
{quote}You should move where("a>'1'") before withColumn:{quote}
[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625436#comment-16625436
]
Ohad Raviv commented on SPARK-23985:
the same is true for Spark 2.4:
{code}
[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625432#comment-16625432
]
Yuming Wang commented on SPARK-23985:
-
This works:
{code:scala}
import
[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625422#comment-16625422
]
Ohad Raviv commented on SPARK-23985:
you're right. that's very strange. looks like something got
[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16625305#comment-16625305
]
Yuming Wang commented on SPARK-23985:
-
[~uzadude] It seems already works:
{code:scala}
[
https://issues.apache.org/jira/browse/SPARK-23985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16439114#comment-16439114
]
Ohad Raviv commented on SPARK-23985:
I see in the Optimizer that filters are getting pushed only if
