[
https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023453#comment-13023453
]
Doug Cutting commented on AVRO-806:
-----------------------------------
A breif description of my patch:
I've added methods to Codec to create the Encoder and Decoder used for the
file. Then I've added methods to Encoder and Decoder called as we start to
read each record, as we start to read each field, and as we finish reading each
field. These are used by the ColumnEncoder and ColumnDecoder implementations
to track the depth and column and then switch input or output to the correct
buffer as objects are written and read.
I hope this makes sense!
> add a column-major codec for data files
> ---------------------------------------
>
> Key: AVRO-806
> URL: https://issues.apache.org/jira/browse/AVRO-806
> Project: Avro
> Issue Type: New Feature
> Components: java, spec
> Reporter: Doug Cutting
> Assignee: Doug Cutting
> Attachments: AVRO-806.patch
>
>
> Define a codec that, when a data file's schema is a record schema, writes
> blocks within the file in column-major order. This would permit better
> compression and also permit efficient skipping of fields that are not of
> interest.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira