Josh Wills created CRUNCH-394:
---------------------------------
Summary: Ensure that the Broadcast configuration in
SparkRuntimeContext is never null
Key: CRUNCH-394
URL: https://issues.apache.org/jira/browse/CRUNCH-394
Project: Crunch
Issue Type: Bug
Reporter: Josh Wills
It looks like it's possible for Spark to recompute some RDDs that get reloaded
between output runs. When this happens, the Broadcast<byte[]> field that
contains the serialized Configuration object is null b/c we haven't declared an
output RDD to run against yet. I added a change to ensure that the serialized
Configuration object is always defined, even before we generate any output, to
ensure that we don't throw an NPE.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
