We don't support dynamic partition pruning yet. On Fri, Oct 16, 2015 at 10:20 AM, Younes Naguib < [email protected]> wrote:
> Hi all > > > > I’m running sqls on spark 1.5.1 and using tables based on parquets. > > My tables are not pruned when joined on partition columns. > > Ex: > > Select .... from tab where partcol=1 will prune on value 1 > > Select .... from tab join dim on (dim.partcol=tab.partcol) where > dim.partcol=1 will scan all partitions. > > > > Any ideas or workarounds? > > > > > > *Thanks,* > > *Younes* > > >
