Re: How to initialize StateDStream

2014-09-13 Thread Soumitra Kumar
you need use this version of > updateFunction: "updateFunc: (Iterator[(K, Seq[V], Option[S])]) => > Iterator[(K, S)]", which make key available to the update function. > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.

Re: How to initialize StateDStream

2014-09-13 Thread qihong
ke key available to the update function. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-initialize-StateDStream-tp14113p14176.html Sent from the Apache Spark User List mailing list archive at Nabble.com. -

Re: How to initialize StateDStream

2014-09-13 Thread Soumitra Kumar
PM, qihong wrote: > there's no need to initialize StateDStream. Take a look at example > StatefulNetworkWordCount.scala, it's part of spark source code. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/How-to-initiali

Re: How to initialize StateDStream

2014-09-12 Thread qihong
there's no need to initialize StateDStream. Take a look at example StatefulNetworkWordCount.scala, it's part of spark source code. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-initialize-StateDStream-tp14113p14146.html Sent from the Ap

How to initialize StateDStream

2014-09-12 Thread Soumitra Kumar
Hello, How do I initialize StateDStream used in updateStateByKey? -Soumitra.