Josh Wills created CRUNCH-248:
---------------------------------

             Summary: SingleUseIterable exceptions mask CrunchRuntimeExceptions 
thrown in the reducer
                 Key: CRUNCH-248
                 URL: https://issues.apache.org/jira/browse/CRUNCH-248
             Project: Crunch
          Issue Type: Bug
          Components: Core
            Reporter: Josh Wills
            Assignee: Josh Wills
             Fix For: 0.8.0
         Attachments: CRUNCH-248.patch

If a DoFn on the reducer throws a CrunchRuntimeException, the record you were 
processing when the exception was thrown. Since the record is usually some 
instance of Pair<K, Iterable<V>> and the Iterable is single-use, attempting to 
write the record to the log causes an exception to be thrown when we try to 
render the data in the Iterable by calling its iterator() method for the second 
time.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to