[
https://issues.apache.org/jira/browse/AVRO-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13847000#comment-13847000
]
ASF subversion and git services commented on AVRO-1234:
-------------------------------------------------------
Commit 1550605 from [~cutting] in branch 'avro/trunk'
[ https://svn.apache.org/r1550605 ]
AVRO-1234. Java: Permit AvroInputFormat to process files whose names don't end
in .avro. Contributed by Dave Beech & Sandy Ryza.
> Avro MapReduce jobs silently ignore input data without '.avro' extension
> ------------------------------------------------------------------------
>
> Key: AVRO-1234
> URL: https://issues.apache.org/jira/browse/AVRO-1234
> Project: Avro
> Issue Type: Bug
> Affects Versions: 1.7.3
> Reporter: Dave Beech
> Assignee: Dave Beech
> Fix For: 1.7.6
>
> Attachments: AVRO-1234-1.patch, AVRO-1234-2.patch, AVRO-1234.patch
>
>
> The AvroInputFormat class explicitly checks each input path for a '.avro'
> extension.
> If only some of the input paths have the correct extension, the remainder are
> silently ignored and not included in the job. However, if none of the input
> paths have the extension, the job will continue and succeed even though no
> map tasks are allocated, and no work is done.
> This only happens using the old mapred API. The new mapreduce API version
> will happily read files regardless of extension.
> Is the check necessary?
--
This message was sent by Atlassian JIRA
(v6.1.4#6159)
