Ryan Blue commented on PARQUET-751:

Merged #379. Thanks for reviewing, Dan!

> DictionaryFilter patch broke column projection
> ----------------------------------------------
>                 Key: PARQUET-751
>                 URL: https://issues.apache.org/jira/browse/PARQUET-751
>             Project: Parquet
>          Issue Type: Bug
>          Components: parquet-mr
>    Affects Versions: 1.9.0
>            Reporter: Ryan Blue
>            Assignee: Ryan Blue
>             Fix For: 1.9.0
> The {{DictionaryFilter}} patch included a change to reuse a 
> {{ParquetFileReader}} rather than creating new ones (and opening new file 
> streams). But by reusing a reader, the projection columns are no longer set. 
> The result is that all columns are read from disk, but only the requested 
> columns are materialized. The fix is to set the requested schema on the file 
> reader when it is fetched from the read context inside 
> {{InternalParquetRecordReader}}.

This message was sent by Atlassian JIRA

Reply via email to