Github user ssaavedra commented on the issue: https://github.com/apache/spark/pull/20383 However, Spark Streaming should always be used with checkpoint enabled if you are using at least `updateStateByKey` or `reduceByKeyAndWindow` and you don't want to lose data, or miscalculate results. I'm not sure why foxish tagged this as 2.4.0 when reported the issue, probably because we were already in 2.3.0-rc2, but if there's going to be another RC (which it seems per the latest vote in spark-dev) then I'm in favor of the backport.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org