[
https://issues.apache.org/jira/browse/PARQUET-922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lars Volker updated PARQUET-922:
--------------------------------
Summary: Add Indexpages to the format to support efficient page skipping
(was: Add Indexpages to the Format to support efficient page skipping)
> Add Indexpages to the format to support efficient page skipping
> ---------------------------------------------------------------
>
> Key: PARQUET-922
> URL: https://issues.apache.org/jira/browse/PARQUET-922
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-format
> Reporter: Julien Le Dem
> Assignee: Marcel Kornacker
>
> When a Parquet file is sorted we can define an index consisting of the
> boundary values for the pages of the columns sorted on as well as the offsets
> and length of said pages in the file.
> The goal is to optimize lookup and range scan type queries, using this to
> read only the pages containing data matching the filter.
> We'd require the pages to be aligned accross columns.
> [~marcelk] will add a link to the google doc to discuss the spec
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
