Joseph Adler created CRUNCH-36:
----------------------------------
Summary: Avro Compression settings are ignored by Crunch
Key: CRUNCH-36
URL: https://issues.apache.org/jira/browse/CRUNCH-36
Project: Crunch
Issue Type: Bug
Components: IO
Affects Versions: 0.3.0
Reporter: Joseph Adler
Fix For: 0.3.0
Java Avro Map/reduce jobs will compress the output if the configuration setting
mapred.output.compress is true. Avro supports two codecs (deflate and snappy).
Users typically select the code by calling AvroJob.setOutputCodec and
specifying either org.apache.avro.file.DataFileConstants.SNAPPY_CODEC or
org.apache.avro.file.DataFileConstants.DEFLATE_CODEC. Users can specify the
deflate level by setting the configuration setting avro.mapred.deflate.level.
org.apache.crunch.types.avro.AvroOutuptFormat currently ignores these setting.
I'll follow up with a patch that fixes this problem.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
