[
https://issues.apache.org/jira/browse/SPARK-20777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Richard Moorhead closed SPARK-20777.
------------------------------------
Resolution: Won't Fix
Issue was multiple rdd transformations werent checkpointed from where
checkpoint was restored.
> Spark Streaming NullPointerException when restoring from hdfs checkpoint
> ------------------------------------------------------------------------
>
> Key: SPARK-20777
> URL: https://issues.apache.org/jira/browse/SPARK-20777
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.2
> Environment: AWS EMR 5.2
> Reporter: Richard Moorhead
> Priority: Minor
>
> When restoring a spark streaming job from a checkpoint I am experiencing
> infrequent NullPointerExceptions when transformations are applied to RDDs
> with `foreachRDD`
> http://stackoverflow.com/questions/43984672/spark-kinesis-streaming-checkpoint-recovery-rdd-nullpointer-exception
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
