[
https://issues.apache.org/jira/browse/PARQUET-922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16356582#comment-16356582
]
Gabor Szadovszky commented on PARQUET-922:
------------------------------------------
Hi [~legend],
I am working on it. Already linked the related JIRA to this one: PARQUET-1201.
Please, feel free to add any questions to that JIRA if you think it is public
or send an email directly to me.
> Add index pages to the format to support efficient page skipping
> ----------------------------------------------------------------
>
> Key: PARQUET-922
> URL: https://issues.apache.org/jira/browse/PARQUET-922
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-format
> Reporter: Julien Le Dem
> Assignee: Marcel Kornacker
> Priority: Major
> Fix For: format-2.4.0
>
>
> When a Parquet file is sorted we can define an index consisting of the
> boundary values for the pages of the columns sorted on as well as the offsets
> and length of said pages in the file.
> The goal is to optimize lookup and range scan type queries, using this to
> read only the pages containing data matching the filter.
> We'd require the pages to be aligned accross columns.
> [~marcelk] will add a link to the google doc to discuss the spec
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
