For example in the simplest word count example, I want to update the count in memory and always have the same word getting updated by the same task - not use any distributed memstore.
I know that updateStateByKey should guarantee that, but how do you approach this problem outside of spark streaming? Thanks, Michael ----- Michael Vogiatzis @mvogiatzis -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Does-spark-guarantee-that-the-same-task-will-process-the-same-key-over-time-tp23753.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
