[
https://issues.apache.org/jira/browse/MAPREDUCE-815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aaron Kimball updated MAPREDUCE-815:
------------------------------------
Attachment: MAPREDUCE-815.2.patch
New patch per code-review.
* HADOOP-6492 has been updated with {{org.apache.hadoop.fs.AvroFSInput}};
AvroRecordReader now makes use of this.
* AvroInputFormat/AvroRecordReader now always returns a null value (while
Writables can't handle nulls, I've confirmed that Avro can accept a null schema
for a value and this works in-shuffle)
* AvroRecordReader now traps {{java.util.NoSuchElementException}} in
{{nextKeyValue()}} to gracefully handle EOF
* Tests now include a test which does not set an explicit schema, but instead
uses the Generic interface to read it from the file
* javadoc comments updated
* {{SYNC_DISTANCE}} removed.
> Add AvroInputFormat and AvroOutputFormat so that hadoop can use Avro
> Serialization
> ----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-815
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-815
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Ravi Gummadi
> Assignee: Aaron Kimball
> Attachments: MAPREDUCE-815.2.patch, MAPREDUCE-815.patch
>
>
> MapReduce needs AvroInputFormat similar to other InputFormats like
> TextInputFormat to be able to use avro serialization in hadoop. Similarly
> AvroOutputFormat is needed.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
