[ 
https://issues.apache.org/jira/browse/AVRO-1243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13573706#comment-13573706
 ] 

Joey Echeverria commented on AVRO-1243:
---------------------------------------

q. You might add a HadoopCodec to the avro-mapred module that implements an 
Avro codec in terms of a Hadoop CompressionCodec..

I like the idea of a Hadoop Codec, but should it be only available as part of 
avro-mapred or should it be it's own module? As I understand it, with the 
exception of null and deflate, compression codecs are an optional part of the 
Avro spec so there should already be ways of handling trying to load a codec 
that doesn't exist.
                
> Support all compression codecs
> ------------------------------
>
>                 Key: AVRO-1243
>                 URL: https://issues.apache.org/jira/browse/AVRO-1243
>             Project: Avro
>          Issue Type: Improvement
>          Components: java
>    Affects Versions: 1.7.3
>            Reporter: Ted Malaska
>            Priority: Minor
>
> I may be reading this wrong but at this time 
> org.apache.avro.file.CodecFactory only supports null, deflate, and snappy 
> compression codecs.
> I would like to change the fromString method to use 
> Class.forName(codec).newInstance(); after the codec was not found in the 
> REGISTERED map but before the AvroRuntimeException is thrown. 
> Here are some of my supporting thoughts
> 1. This should not interduce much slowness because it will only be called 
> initialize.
> 2. This will allow for support for GZip, BZip2, and LZO with out adding more 
> dependances to the maven pom file.
> 3. This will allow for a future Jiri I would like to do that would allow 
> AvroOutputFormat to be able to use the following configs: 
> mapred.output.compress and mapred.output.compression.codec

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to