Re: [Spark Streaming] How do we reset the updateStateByKey values.

2015-10-22 Thread Sander van Dijk
I don't think it is possible in the way you try to do it. It is important to remember that the statements you mention only set up the stream stages, before the stream is actually running. Once it's running, you cannot change, remove or add stages. I am not sure how you determine your condition

Schema for type is not supported

2015-06-29 Thread Sander van Dijk
Hey all, I try to make a DataFrame by inspection (using Spark 1.4.0), but run into a parameter of my case class not being supported. Minimal example: val sqlContext = new org.apache.spark.sql.SQLContext(sc) import sqlContext.implicits._ import com.vividsolutions.jts.geom.Coordinate case class