Amit Sela created BEAM-84:
-----------------------------
Summary: Add support for Session Windows - Beam Sessions
Key: BEAM-84
URL: https://issues.apache.org/jira/browse/BEAM-84
Project: Beam
Issue Type: New Feature
Reporter: Amit Sela
Implement Beam Sessions, or Session Windows, by maintaining the session state.
Spark 1.6 presents mapWithState as an improvement to updateStateByKey so It'd
be better to use it.
See "Session Windows" in Dataflow documentation here:
https://cloud.google.com/dataflow/model/windowing#Functions
Also, this blog post from Databricks would be a good place to start:
https://databricks.com/blog/2016/02/01/faster-stateful-stream-processing-in-spark-streaming.html
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)