[ https://issues.apache.org/jira/browse/AVRO-1259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13616956#comment-13616956 ]
Hudson commented on AVRO-1259: ------------------------------ Integrated in AvroJava #360 (See [https://builds.apache.org/job/AvroJava/360/]) AVRO-1259. Java: Improve Trevni's encoding of sparse columns. (Revision 1461896) Result = SUCCESS cutting : Files : * /avro/trunk/CHANGES.txt * /avro/trunk/lang/java/trevni/core/src/main/java/org/apache/trevni/ArrayColumnOutputBuffer.java * /avro/trunk/lang/java/trevni/core/src/main/java/org/apache/trevni/ColumnFileReader.java * /avro/trunk/lang/java/trevni/core/src/main/java/org/apache/trevni/ColumnFileWriter.java * /avro/trunk/lang/java/trevni/core/src/main/java/org/apache/trevni/ColumnOutputBuffer.java * /avro/trunk/lang/java/trevni/core/src/main/java/org/apache/trevni/InputBuffer.java * /avro/trunk/lang/java/trevni/doc/apt/spec.apt > improve Trevni encoding of sparse fields > ---------------------------------------- > > Key: AVRO-1259 > URL: https://issues.apache.org/jira/browse/AVRO-1259 > Project: Avro > Issue Type: Improvement > Components: trevni > Reporter: Doug Cutting > Assignee: Doug Cutting > Fix For: 1.7.5 > > Attachments: AVRO-1259.patch, AVRO-1259.patch, AVRO-1259.patch > > > If in most records a field is null, Trevni writes a null byte (zero length) > for that record in that column. This might be optimized by instead using a > run-length encoding for lengths. The length is signed, so negative lengths > might be used to indicate the number of zero-lengths before the next non-zero > value. This could thus be back-compatible. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira