[
https://issues.apache.org/jira/browse/AVRO-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13846937#comment-13846937
]
Doug Cutting commented on AVRO-1234:
------------------------------------
Patch looks good. We might add more javadoc, noting that the default is to
ignore, plus add doc for the default constant. Other than that +1.
> Avro MapReduce jobs silently ignore input data without '.avro' extension
> ------------------------------------------------------------------------
>
> Key: AVRO-1234
> URL: https://issues.apache.org/jira/browse/AVRO-1234
> Project: Avro
> Issue Type: Bug
> Affects Versions: 1.7.3
> Reporter: Dave Beech
> Assignee: Dave Beech
> Fix For: 1.7.6
>
> Attachments: AVRO-1234-1.patch, AVRO-1234.patch
>
>
> The AvroInputFormat class explicitly checks each input path for a '.avro'
> extension.
> If only some of the input paths have the correct extension, the remainder are
> silently ignored and not included in the job. However, if none of the input
> paths have the extension, the job will continue and succeed even though no
> map tasks are allocated, and no work is done.
> This only happens using the old mapred API. The new mapreduce API version
> will happily read files regardless of extension.
> Is the check necessary?
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
