Dynamic partition pruning

[Younes Naguib]

Hi all

I'm running sqls on spark 1.5.1 and using tables based on parquets.
My tables are not pruned when joined on partition columns.
Ex:
Select .... from tab where partcol=1 will prune on value 1
Select .... from tab join dim on (dim.partcol=tab.partcol) where dim.partcol=1 
will scan all partitions.

Any ideas or workarounds?


Thanks,
Younes