[
https://issues.apache.org/jira/browse/IMPALA-6433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16938842#comment-16938842
]
ASF subversion and git services commented on IMPALA-6433:
---------------------------------------------------------
Commit b7c081cb9966166be8d20d6b75a541394a001ddc in impala's branch
refs/heads/master from Csaba Ringhofer
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=b7c081c ]
IMPALA-6433: Part 1: Extract page reading logic from ParquetColumnReader
Moved some responsibilities from parquet-column-readers.cc to
new classes 'ParquetColumnChunkReader' and 'ParquetPageReader':
- reading pages from ScanRange
- decompress data if needed
The main motivation is to make the implementation of V2 data page
reading simpler by moving most parts that will differ between V1 and V2
into a class with manageable complexity.
Testing:
- ran parquet related scanner tests
Change-Id: Ic0289394adcb97a3529313030930c9c5b85aaa12
Reviewed-on: http://gerrit.cloudera.org:8080/13329
Tested-by: Impala Public Jenkins <[email protected]>
Reviewed-by: Csaba Ringhofer <[email protected]>
> Add read support for PageHeaderV2 to the parquet scanner
> --------------------------------------------------------
>
> Key: IMPALA-6433
> URL: https://issues.apache.org/jira/browse/IMPALA-6433
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Affects Versions: Impala 2.11.0
> Reporter: Lars Volker
> Assignee: Csaba Ringhofer
> Priority: Major
> Labels: parquet
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
