Cool. Thanks Yingyi! On Sat, Aug 27, 2016 at 1:58 AM, Yingyi Bu <[email protected]> wrote:
> Currently you can push Project into the source but not Select. > You're welcome to enhance IMetedataProvider to support that. You can take > a look at DataSourceScanPOperator: > > Pair<IOperatorDescriptor, AlgebricksPartitionConstraint> p = > mp.getScannerRuntime(dataSource, vars, > projectVars, scan.isProjectPushed(), scan.getMinFilterVars(), > scan.getMaxFilterVars(), opSchema, > typeEnv, context, builder.getJobSpec(), implConfig); > > > Best, > > Yingyi > > > On Fri, Aug 26, 2016 at 3:44 PM, Wail Alkowaileet <[email protected]> > wrote: > > > Hi AsterixDBers. > > > > Is there any easy way to push-down filter to an external source (in my > case > > Parquet) without being too intrusive ? > > > > This can perform way faster than STREAM-SELECT, as parquet can > potentially > > skip Row Groups while scanning. > > -- > > > > *Regards,* > > Wail Alkowaileet > > > -- *Regards,* Wail Alkowaileet
