Re: UpdateStateByKey - How to improve performance?

2014-08-06 Thread Tathagata Das
ective > members > or are we missing some concepts here? > > I think updateStateByKey may be causing lot of performance degradation in > our app as we keep doing this again and again for every batch. Please let > us > know if my thought process is correct here. > > &g

Re: UpdateStateByKey - How to improve performance?

2014-08-06 Thread Michael Malak
ontext: http://apache-spark-user-list.1001560.n3.nabble.com/UpdateStateByKey-How-to-improve-performance-tp11575.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spa

UpdateStateByKey - How to improve performance?

2014-08-06 Thread Venkat Subramanian
n3.nabble.com/UpdateStateByKey-How-to-improve-performance-tp11575.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e