[
https://issues.apache.org/jira/browse/AVRO-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13574645#comment-13574645
]
Ted Malaska commented on AVRO-1243:
-----------------------------------
Yes both comments make a lot of sense. OK so I'm going to try to make both
happen with the following approach.
1. I'm going to add BZip2 dependance to Avro.
2. I'm going to remove all the reflection and replace it with logic that will
translate mapred.output.compress and mapred.output.compression.codec to the
correct Avro implementation. If a Avro implementation can't be found I'll
through an exception.
Let me know if I got it wrong. Thanks again for the feedback.
I should have something to show soon.
> Avro support for all compression codecs
> ---------------------------------------
>
> Key: AVRO-1243
> URL: https://issues.apache.org/jira/browse/AVRO-1243
> Project: Avro
> Issue Type: Improvement
> Components: java
> Affects Versions: 1.7.3
> Reporter: Ted Malaska
> Priority: Minor
> Attachments: AVRO-1243.not-ready.1.patch, AVRO-1243.not-ready.patch
>
>
> I may be reading this wrong but at this time
> org.apache.avro.file.CodecFactory only supports null, deflate, and snappy
> compression codecs.
> I would like to change the fromString method to use
> Class.forName(codec).newInstance(); after the codec was not found in the
> REGISTERED map but before the AvroRuntimeException is thrown.
> Here are some of my supporting thoughts
> 1. This should not interduce much slowness because it will only be called
> initialize.
> 2. This will allow for support for GZip, BZip2, and LZO with out adding more
> dependances to the maven pom file.
> 3. This will allow for a future Jiri I would like to do that would allow
> AvroOutputFormat to be able to use the following configs:
> mapred.output.compress and mapred.output.compression.codec
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
