Huaxin Gao created SPARK-36454:
----------------------------------
Summary: Not push down partition filter to ORCScan for DSv2
Key: SPARK-36454
URL: https://issues.apache.org/jira/browse/SPARK-36454
Project: Spark
Issue Type: Bug
Components: SQL
Affects Versions: 3.3.0
Reporter: Huaxin Gao
Seems to me that partition filter is only used for partition pruning and
shouldn't be pushed down to ORCScan. We don't push down partition filter to
ORCScan in DSv1, and we don't push down partition filter for parquet in both
DSv1 and DSv2.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
