[
https://issues.apache.org/jira/browse/AVRO-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15332138#comment-15332138
]
Ryan Blue commented on AVRO-1862:
---------------------------------
[~wikp], isn't {{.avro}} the correct extension? You're writing the Avro
container format with internal blocks compressed using the compression codec. I
think that a final extension like {{.gz}} implies that you can run {{gunzip}}
on the file, but that doesn't work with Avro. What about adding the compression
before the Avro ext, like {{.gz.avro}}? I think that better shows what's
happening.
> AvroOutputFormat saves compressed avrò files without respecting codec's
> default extension
> -----------------------------------------------------------------------------------------
>
> Key: AVRO-1862
> URL: https://issues.apache.org/jira/browse/AVRO-1862
> Project: Avro
> Issue Type: Improvement
> Components: java
> Reporter: Piotr Wikieł
> Priority: Minor
> Attachments: AVRO-1862.patch
>
>
> Common pattern in naming compressed files is giving them extension derived
> from compression codec, for example: {{.gz}}, {{.zip}}, {{.bz2}}.
> {{AvroOutputFormat}} currently does not respect this convention.
> I've adapted some code from Hadoop's {{TextOutputFormat}} in
> backward-compatible manner adding following {{JobConf}} property:
> {{avro.mapred.output.extension.from-codec}} ({{boolean}}, default: {{false}})
> - when set to {{true}}, extension will be changed according to above rule.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
