[
https://issues.apache.org/jira/browse/DRILL-2842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jacques Nadeau resolved DRILL-2842.
-----------------------------------
Resolution: Fixed
Fixed in a7a60a2
> Parquet files with large file metadata sometimes fail to read in the
> FooterGather
> ---------------------------------------------------------------------------------
>
> Key: DRILL-2842
> URL: https://issues.apache.org/jira/browse/DRILL-2842
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Reporter: Jason Altekruse
> Assignee: Jason Altekruse
> Priority: Critical
> Attachments: 2842.patch
>
>
> Parquet files with large footers could not be read. The length of the footer
> is written at the end of the file. To avoid excessive reads for smaller
> files, we read a reasonable amount of the end of the file that may contain
> the whole footer, with the actual exact length appearing at the end of the
> read. After checking the length we tried to read the remining portion ahead
> of what was already read and splice them together. The offset for where to
> put the bytes read first was off.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
