I don't think this actually answers your question. You can limit your filters by directory to avoid reads from the filesystem, and some of the storage plugins like Hbase and Hive implement scan level pushdown, but I do not know if this is sophisticated enough that a join would be aware of the partitioning. I'll keep watching the thread and reach out to our planning experts if they don't chime in.
- Jason On Fri, Feb 13, 2015 at 5:45 AM, Carol McDonald <[email protected]> wrote: > yes you can read about it here > > https://cwiki.apache.org/confluence/display/DRILL/Partition+Pruning > > On Fri, Feb 13, 2015 at 6:42 AM, Uli Bethke <[email protected]> wrote: > > > I have two large tables in Hive (both partitioned and bucketed). Using > Map > > side joins I can take advantage of data locality for the hash join table. > > > > Using Drill does the optimizer take the partitioning and bucketing into > > consideration? > > thanks > > uli > > > > >
