Michael Armbrust created SPARK-19067:
----------------------------------------

             Summary: mapWithState Style API
                 Key: SPARK-19067
                 URL: https://issues.apache.org/jira/browse/SPARK-19067
             Project: Spark
          Issue Type: New Feature
          Components: Structured Streaming
            Reporter: Michael Armbrust
            Priority: Critical


Right now the only way to do stateful operations with with Aggregator or UDAF.  
However, this does not give users control of emission or expiration of state 
making it hard to implement things like sessionization.  We should add a more 
general construct (probably similar to {{mapWithState}}) to structured 
streaming.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to