Hi Ravi, 2014-09-10 15:55 GMT+02:00 Ravi Sharma <raviprincesha...@gmail.com>: > > > I'm using spark streaming as for kafka consumer. I want to do the CEP by spark. So as for that I need to store my sequence of events. so that I cant detect some pattern. >
Depending on what you're trying to accomplish, you might implement this using Spark Streaming only, by using the updateStateByKey transformation. [1] This will allow you to maintain global states that you can combine with other streaming operations. We have successfully used this approach to detect patterns in log sequences with Spark Streaming. [1] http://spark.apache.org/docs/latest/streaming-programming-guide.html#transformations Best, -- Santiago M. Mola sm...@stratio.com
