[ 
https://issues.apache.org/jira/browse/AVRO-1234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13847240#comment-13847240
 ] 

Hudson commented on AVRO-1234:
------------------------------

SUCCESS: Integrated in AvroJava #406 (See 
[https://builds.apache.org/job/AvroJava/406/])
AVRO-1234. Java: Permit AvroInputFormat to process files whose names don't end 
in .avro.  Contributed by Dave Beech & Sandy Ryza. (cutting: rev 1550605)
* /avro/trunk/CHANGES.txt
* 
/avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroAsTextInputFormat.java
* 
/avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/AvroInputFormat.java
* 
/avro/trunk/lang/java/mapred/src/main/java/org/apache/avro/mapred/tether/TetherInputFormat.java
* 
/avro/trunk/lang/java/mapred/src/test/java/org/apache/avro/mapred/TestAvroInputFormat.java


> Avro MapReduce jobs silently ignore input data without '.avro' extension
> ------------------------------------------------------------------------
>
>                 Key: AVRO-1234
>                 URL: https://issues.apache.org/jira/browse/AVRO-1234
>             Project: Avro
>          Issue Type: Bug
>    Affects Versions: 1.7.3
>            Reporter: Dave Beech
>            Assignee: Dave Beech
>             Fix For: 1.7.6
>
>         Attachments: AVRO-1234-1.patch, AVRO-1234-2.patch, AVRO-1234.patch
>
>
> The AvroInputFormat class explicitly checks each input path for a '.avro' 
> extension. 
> If only some of the input paths have the correct extension, the remainder are 
> silently ignored and not included in the job. However, if none of the input 
> paths have the extension, the job will continue and succeed even though no 
> map tasks are allocated, and no work is done.
> This only happens using the old mapred API. The new mapreduce API version 
> will happily read files regardless of extension. 
> Is the check necessary?



--
This message was sent by Atlassian JIRA
(v6.1.4#6159)

Reply via email to