[ https://issues.apache.org/jira/browse/CRUNCH-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Josh Wills updated CRUNCH-448: ------------------------------ Attachment: CRUNCH-448b.patch Cleaned this up a bit, going to submit it now. > Smart-ish case class serialization for Scrunch > ---------------------------------------------- > > Key: CRUNCH-448 > URL: https://issues.apache.org/jira/browse/CRUNCH-448 > Project: Crunch > Issue Type: Improvement > Components: Scrunch > Reporter: Josh Wills > Attachments: CRUNCH-448.patch, CRUNCH-448b.patch > > > I took advantage of some of the new reflection features in Scala 2.10 to make > automatic serialization of case classes much cooler, viz., > 1) We can automatically map any case class to a TupleN and properly infer > PTypes for Scala types (options, lists, etc.), just as we do for regular > PCollections. > 2) For Avro serialization, we will also capture the names of the case class' > fields and map them to the names of the fields in the Avro record we > generate, which makes debugging intermediate outputs much easier. -- This message was sent by Atlassian JIRA (v6.2#6252)