[
https://issues.apache.org/jira/browse/DRILL-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacques Nadeau updated DRILL-2842:
----------------------------------
Fix Version/s: 0.9.0
> Parquet files with large file metadata sometimes fail to read in the
> FooterGather
> ---------------------------------------------------------------------------------
>
> Key: DRILL-2842
> URL: https://issues.apache.org/jira/browse/DRILL-2842
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Reporter: Jason Altekruse
> Assignee: Jason Altekruse
> Priority: Critical
> Fix For: 0.9.0
>
> Attachments: 2842.patch
>
>
> Parquet files with large footers could not be read. The length of the footer
> is written at the end of the file. To avoid excessive reads for smaller
> files, we read a reasonable amount of the end of the file that may contain
> the whole footer, with the actual exact length appearing at the end of the
> read. After checking the length we tried to read the remining portion ahead
> of what was already read and splice them together. The offset for where to
> put the bytes read first was off.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
