Younes created SPARK-11150: ------------------------------ Summary: Dynamic partition pruning Key: SPARK-11150 URL: https://issues.apache.org/jira/browse/SPARK-11150 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.5.1, 1.6.0 Reporter: Younes
Partitions are not pruned when joined on the partition columns. This is the same issue as HIVE-9152. Ex: Select .... from tab where partcol=1 will prune on value 1 Select .... from tab join dim on (dim.partcol=tab.partcol) where dim.partcol=1 will scan all partitions. Tables are based on parquets. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org