[
https://issues.apache.org/jira/browse/AVRO-957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Cooper updated AVRO-957:
--------------------------------
Description:
We (Experian Hitwise) have added codec support to avro-c (as per the avro
spec), with preliminary deflate/inflate support (as well as null codec support).
This changes the way blocks are written to the file, with the block data being
passed through the codec interface, before being written to file.
This also changes the way blocks are read from a file, with the block data
first being read into a buffer, before being passed through the codec
interface, then a memory reader is set to the decoded data, which is read by
the user calls avro_file_reader_read_value() and avro_file_reader_read()
Please feel free to make changes, as although I did try to emulate the coding
style of the rest of the avro c library, there may be things I've done
"differently" :-)
Code is available from Github: https://github.com/hitwise/avro (branch: codec)
was:
We (Experian Hitwise) have added codec support to avro-c (as per the avro
spec), with preliminary deflate/inflate support (as well as null codec support).
This changes the way blocks are written to the file, with the block data being
passed through the codec interface, before being written to file.
This also changes the way blocks are read from a file, with the block data
first being read into a buffer, before being passed through the codec
interface, then a memory reader is set to the decoded data, which is read by
the user calls avro_file_reader_read_value() and avro_file_reader_read()
Please feel free to make changes, as although I did try to emulate the coding
style of the rest of the avro c library, there may be things I've done
"differently" :-)
Code is available from Github: https://github.com/hitwise/avro (branch:
codec-deflate)
> Added Codec Support to Avro-C
> -----------------------------
>
> Key: AVRO-957
> URL: https://issues.apache.org/jira/browse/AVRO-957
> Project: Avro
> Issue Type: New Feature
> Components: c
> Reporter: Lucas Martin-King
> Labels: c, codec, deflate
>
> We (Experian Hitwise) have added codec support to avro-c (as per the avro
> spec), with preliminary deflate/inflate support (as well as null codec
> support).
> This changes the way blocks are written to the file, with the block data
> being passed through the codec interface, before being written to file.
> This also changes the way blocks are read from a file, with the block data
> first being read into a buffer, before being passed through the codec
> interface, then a memory reader is set to the decoded data, which is read by
> the user calls avro_file_reader_read_value() and avro_file_reader_read()
> Please feel free to make changes, as although I did try to emulate the coding
> style of the rest of the avro c library, there may be things I've done
> "differently" :-)
> Code is available from Github: https://github.com/hitwise/avro (branch:
> codec)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
