Opened https://issues.apache.org/jira/browse/SPARK-3462
I'll take a look at ColumnPruning and see what I can do On Tue, Sep 9, 2014 at 12:46 PM, Michael Armbrust <mich...@databricks.com> wrote: > On Tue, Sep 9, 2014 at 10:17 AM, Cody Koeninger <c...@koeninger.org> > wrote: >> >> Is there a reason in general not to push projections and predicates down >> into the individual ParquetTableScans in a union? >> > > This would be a great case to add to ColumnPruning. Would be awesome if > you could open a JIRA or even a PR :) >
