Re: Valid spark streaming use case?

2014-04-20 Thread xargsgrep
Great, this should give me enough to go on. Appreciate the help! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Valid-spark-streaming-use-case-tp4410p4507.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Valid spark streaming use case?

2014-04-18 Thread Tathagata Das
m" : ("09:00:00 user-one foo.com", "09:09:00 > user-one foo.com", "09:18:00 user-one foo.com"), "user-two:bar.com" : > ("09:15:00 user-two bar.com", "09:25:00 user-two bar.com") } > > Now let's assume no more data come

Re: Valid spark streaming use case?

2014-04-18 Thread xargsgrep
one:foo.com" should be flushed after 9:48 and "user-two:bar.com" should be flushed after 9:55. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Valid-spark-streaming-use-case-tp4410p4455.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Valid spark streaming use case?

2014-04-17 Thread Tathagata Das
ion allow me to do > this somehow? > > Any help would be appreciated. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Valid-spark-streaming-use-case-tp4410.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Valid spark streaming use case?

2014-04-17 Thread xargsgrep
certain amount of time. Would the updateStateByKey function allow me to do this somehow? Any help would be appreciated. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Valid-spark-streaming-use-case-tp4410.html Sent from the Apache Spark User List mailing list archive at Nabble.com.