[ 
https://issues.apache.org/jira/browse/AVRO-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sandy Ryza updated AVRO-1234:
-----------------------------

    Status: Patch Available  (was: Open)

> Avro MapReduce jobs silently ignore input data without '.avro' extension
> ------------------------------------------------------------------------
>
>                 Key: AVRO-1234
>                 URL: https://issues.apache.org/jira/browse/AVRO-1234
>             Project: Avro
>          Issue Type: Bug
>    Affects Versions: 1.7.3
>            Reporter: Dave Beech
>            Assignee: Dave Beech
>             Fix For: 1.7.6
>
>         Attachments: AVRO-1234-1.patch, AVRO-1234.patch
>
>
> The AvroInputFormat class explicitly checks each input path for a '.avro' 
> extension. 
> If only some of the input paths have the correct extension, the remainder are 
> silently ignored and not included in the job. However, if none of the input 
> paths have the extension, the job will continue and succeed even though no 
> map tasks are allocated, and no work is done.
> This only happens using the old mapred API. The new mapreduce API version 
> will happily read files regardless of extension. 
> Is the check necessary?



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Reply via email to