[
https://issues.apache.org/jira/browse/AVRO-1414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Doug Cutting updated AVRO-1414:
-------------------------------
Attachment: AVRO-1414.patch
This patch didn't apply cleanly. Here's a version that does.
I also changed it to call the ZLib codec "deflate" as the Avro spec suggests,
however the files this generates are not readable by Java, indicating there's
something wrong still.
Lastly, this should perhaps not implement the non-standard "gzip" codec as no
other implementation will be able to read it, no? The compression of GZip is
the same as ZLib. Both use the deflate codec, but GZip has extra headers.
> Compression with C++ DataFile
> -----------------------------
>
> Key: AVRO-1414
> URL: https://issues.apache.org/jira/browse/AVRO-1414
> Project: Avro
> Issue Type: Improvement
> Components: c++
> Reporter: Daniel Russel
> Attachments: AVRO-1414.patch, patch
>
>
> There is no way to use compression with the C++ DataFileReader and C++
> DataFileWriter, from what I can tell. Adding compression of the written
> blocks using boost streams is relatively straight forward and I can provide a
> patch if people are interested.
> However, there are a couple caveats:
> - the windows builds of boost don't currently include zlib support (required
> for compression) by default. You have to do extra work to get it.
> - I don't know if doing it that way is compatible with other avro
> implementations
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
