[
https://issues.apache.org/jira/browse/CRUNCH-248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Wills updated CRUNCH-248:
------------------------------
Attachment: CRUNCH-248.patch
Patch to fix this: instead of trying to print the whole record, we just print
the most recently returned value.
> SingleUseIterable exceptions mask CrunchRuntimeExceptions thrown in the
> reducer
> -------------------------------------------------------------------------------
>
> Key: CRUNCH-248
> URL: https://issues.apache.org/jira/browse/CRUNCH-248
> Project: Crunch
> Issue Type: Bug
> Components: Core
> Reporter: Josh Wills
> Assignee: Josh Wills
> Fix For: 0.8.0
>
> Attachments: CRUNCH-248.patch
>
>
> If a DoFn on the reducer throws a CrunchRuntimeException, the record you were
> processing when the exception was thrown. Since the record is usually some
> instance of Pair<K, Iterable<V>> and the Iterable is single-use, attempting
> to write the record to the log causes an exception to be thrown when we try
> to render the data in the Iterable by calling its iterator() method for the
> second time.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
