Github user ssaavedra commented on the issue:
https://github.com/apache/spark/pull/20383
However, Spark Streaming should always be used with checkpoint enabled if
you are using at least `updateStateByKey` or `reduceByKeyAndWindow` and you
don't want to lose data, or miscalculate results.
I'm not sure why foxish tagged this as 2.4.0 when reported the issue,
probably because we were already in 2.3.0-rc2, but if there's going to be
another RC (which it seems per the latest vote in spark-dev) then I'm in favor
of the backport.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
