Thanks, Do you have a Jira I can follow for this? y
From: Michael Armbrust [mailto:[email protected]] Sent: October-16-15 2:18 PM To: Younes Naguib Cc: [email protected] Subject: Re: Dynamic partition pruning We don't support dynamic partition pruning yet. On Fri, Oct 16, 2015 at 10:20 AM, Younes Naguib <[email protected]<mailto:[email protected]>> wrote: Hi all I’m running sqls on spark 1.5.1 and using tables based on parquets. My tables are not pruned when joined on partition columns. Ex: Select .... from tab where partcol=1 will prune on value 1 Select .... from tab join dim on (dim.partcol=tab.partcol) where dim.partcol=1 will scan all partitions. Any ideas or workarounds? Thanks, Younes
