[ 
https://issues.apache.org/jira/browse/CRUNCH-448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Josh Wills updated CRUNCH-448:
------------------------------

    Attachment: CRUNCH-448b.patch

Cleaned this up a bit, going to submit it now.

> Smart-ish case class serialization for Scrunch
> ----------------------------------------------
>
>                 Key: CRUNCH-448
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-448
>             Project: Crunch
>          Issue Type: Improvement
>          Components: Scrunch
>            Reporter: Josh Wills
>         Attachments: CRUNCH-448.patch, CRUNCH-448b.patch
>
>
> I took advantage of some of the new reflection features in Scala 2.10 to make 
> automatic serialization of case classes much cooler, viz.,
> 1) We can automatically map any case class to a TupleN and properly infer 
> PTypes for Scala types (options, lists, etc.), just as we do for regular 
> PCollections.
> 2) For Avro serialization, we will also capture the names of the case class' 
> fields and map them to the names of the fields in the Avro record we 
> generate, which makes debugging intermediate outputs much easier.



--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to