Avro Container File format change: add block size to block descriptor
----------------------------------------------------------------------
Key: AVRO-380
URL: https://issues.apache.org/jira/browse/AVRO-380
Project: Avro
Issue Type: Improvement
Components: doc, java, spec
Affects Versions: 1.3.0
Reporter: Scott Carey
Fix For: 1.3.0
The new file format in AVRO-160 limits a few use cases that I have found to be
important.
A block currently contains a count of the number of records, the block data,
and a sync marker.
This change would add the block size, in bytes, along side the number of
records.
This allows efficient access to a block's data without the need to decode the
data into individual Datums, which is useful for various use cases.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
