Looked at: https://spark.apache.org/docs/latest/configuration.html
I don't think Spark supports per stage speculation. On Fri, Jan 22, 2016 at 10:15 AM, Adam McElwee <a...@mcelwee.me> wrote: > I've used speculative execution a couple times in the past w/ good > results, but I have one stage in my job with a non-idempotent operation in > a `forEachPartition` block. I don't see a way to disable speculative retry > on certain stages, but does anyone know of any tricks to help out here? > > Spark version: 1.6.0 > > Thanks, > -Adam >
