-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33423/
-----------------------------------------------------------

Review request for drill and Steven Phillips.


Bugs: DRILL-2842
    https://issues.apache.org/jira/browse/DRILL-2842


Repository: drill-git


Description
-------

Parquet files with large footers could not be read. The length of the footer is 
written at the end of the file. To avoid excessive reads for smaller files, we 
read a reasonable amount of the end of the file that may contain the whole 
footer, with the actual exact length appearing at the end of the read. After 
checking the length we tried to read the remining portion ahead of what was 
already read and splice them together. The offset for where to put the bytes 
read first was off.


Diffs
-----

  
exec/java-exec/src/main/java/org/apache/drill/exec/store/parquet/FooterGatherer.java
 0bb86e1 
  
exec/java-exec/src/test/java/org/apache/drill/exec/fn/interp/TestConstantFolding.java
 b17935a 
  
exec/java-exec/src/test/java/org/apache/drill/exec/physical/impl/writer/TestParquetWriter.java
 89837e7 

Diff: https://reviews.apache.org/r/33423/diff/


Testing
-------

In progress


Thanks,

Jason Altekruse

Reply via email to