+Parquet Dev List Predicate push-down in the Pig loader is in the current master, but not in a released 1.8 version. It should be out in 1.9. Otherwise, your code looks correct.
rb On Mon, Jun 13, 2016 at 4:32 PM, Rana Faisal Munir <[email protected]> wrote: > Dear Sir, > > > > I am working on Apache Pig and Parquet. I am testing predicate pushdown > but somehow it is not working fine. I am using Parquet 1.8 and Pig 0.16 > versions. I am using this simple code to apply predicate pushdown which is > working fine in ORC. Could you please help me to identify the problem? > > > > > > lineitempart = load '/intermediate/Lineitem-Part/' USING > org.apache.parquet.pig.ParquetLoader(); > > > > SET parquet.pig.predicate.pushdown.enable true > > > > lineitem = FILTER lineitempart BY l_orderkey <= 27; > > > > > > STORE lineitem INTO '/output/query/s20/' USING PigStorage('|'); > > > > > > Regards > > Faisal > -- Ryan Blue
