[ 
https://issues.apache.org/jira/browse/AVRO-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023453#comment-13023453
 ] 

Doug Cutting commented on AVRO-806:
-----------------------------------

A breif description of my patch:

I've added methods to Codec to create the Encoder and Decoder used for the 
file.  Then I've added methods to Encoder and Decoder called as we start to 
read each record, as we start to read each field, and as we finish reading each 
field.  These are used by the ColumnEncoder and ColumnDecoder implementations 
to track the depth and column and then switch input or output to the correct 
buffer as objects are written and read.

I hope this makes sense! 

> add a column-major codec for data files
> ---------------------------------------
>
>                 Key: AVRO-806
>                 URL: https://issues.apache.org/jira/browse/AVRO-806
>             Project: Avro
>          Issue Type: New Feature
>          Components: java, spec
>            Reporter: Doug Cutting
>            Assignee: Doug Cutting
>         Attachments: AVRO-806.patch
>
>
> Define a codec that, when a data file's schema is a record schema, writes 
> blocks within the file in column-major order.  This would permit better 
> compression and also permit efficient skipping of fields that are not of 
> interest.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to