Josh Wills created CRUNCH-242:
---------------------------------

             Summary: Input/output conversion needs to be controlled by the 
Source/Target interfaces
                 Key: CRUNCH-242
                 URL: https://issues.apache.org/jira/browse/CRUNCH-242
             Project: Crunch
          Issue Type: Bug
            Reporter: Josh Wills


I was working on adding support for Parquet to Crunch, and ran into the issue 
that Parquet always assumes that the value it returns is on the "value" side of 
the key-value pair of an InputFormat/OutputFormat. Crunch, for semi-sensible 
historical reasons, makes this position dependent on the PTypeFamily (Avro 
PTypes write to the key, Writable PTypes write to the value). Since the Parquet 
InputFormat/OutputFormat treat the two types the same way, we need a way for 
the Source and Target implementations to override the default configuration of 
the PTypes and choose the right side for the given format.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to