Re: Checkpoint support?

Have a look at the StageInfo https://spark.apache.org/docs/latest/api/scala/index.html#org.apache.spark.scheduler.StageInfo class, it has method stageFailed. You could make use of it. I don't understand the point of restarting the entire application. Thanks Best Regards On Tue, Jun 30, 2015 at

Checkpoint support?

My job has multiple stages, each time a stage fails i have to restart the entire app. I understand Spark restarts failed tasks. However, Is there a way to restart a Spark app from failed stage ? -- Deepak