Bhallamudi Venkata Siva Kamesh created DRILL-3720:
-----------------------------------------------------
Summary: Avro Record Reader should process Avro files by per block
basis
Key: DRILL-3720
URL: https://issues.apache.org/jira/browse/DRILL-3720
Project: Apache Drill
Issue Type: Improvement
Components: Storage - Other
Affects Versions: 1.1.0, 1.0.0
Reporter: Bhallamudi Venkata Siva Kamesh
Assignee: Jacques Nadeau
Fix For: 1.2.0
Currently Avro Record Reader processes entire file in single drill bit. This is
fine as long as files are of size HDFS block size. However, if the size of the
file is *large*, it causes a lot of performance issues.
To address this, Avro Record Reader should process Avro files by per block
basis.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)