[ https://issues.apache.org/jira/browse/CRUNCH-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14053199#comment-14053199 ]
Josh Wills commented on CRUNCH-433: ----------------------------------- Oh, and one other thought-- do we need to add a classifier line to the avro-mapred dependencies in the POM for this stuff to work properly on MR1 vs. MR2? > Add support for reading specific/reflect data from an Avro MR file > ------------------------------------------------------------------ > > Key: CRUNCH-433 > URL: https://issues.apache.org/jira/browse/CRUNCH-433 > Project: Crunch > Issue Type: New Feature > Reporter: Gabriel Reid > Assignee: Gabriel Reid > Attachments: CRUNCH-433.patch > > > An Avro Key/Value file written via raw MapReduce contains records that follow > the schema generated by the org.apache.avro.hadoop.io.AvroKeyValue class. > If these files contain specific or reflection-based records, there is > currently no easy way to read them in as specific or reflection records. > Using the basic public Crunch APIs, they can only be read as generic records > (that also contain generic records). > A method should be added to the Avros class which allows specifying specific > PTypes to be used for reading the underlying data types within a raw MR > output file. > Link to related discussion that inspired this ticket on the user list: > http://s.apache.org/es -- This message was sent by Atlassian JIRA (v6.2#6252)