[
https://issues.apache.org/jira/browse/SPARK-10816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16645720#comment-16645720
]
Jungtaek Lim commented on SPARK-10816:
--------------------------------------
[~zsxwing] [~tdas]
{quote}In addition, it's better to also discuss the compatibility, such as if
we decide to use a new approach to implement session window but need to change
the state format in the state store, do we have enough version information to
identity the old and new formats?
{quote}
No for now, but we can address it when we would like to have it, via wrapping
current with state manager and give the version as 1. We have two cases of
divergence on state versions (stateful aggregation,
map/flatMapGroupsWithState), and we didn't consider state versions to be
compatible with each other, but just made sure each query leverages only one
state version for lifecycle.
> EventTime based sessionization
> ------------------------------
>
> Key: SPARK-10816
> URL: https://issues.apache.org/jira/browse/SPARK-10816
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Reporter: Reynold Xin
> Priority: Major
> Attachments: SPARK-10816 Support session window natively.pdf, Session
> Window Support For Structure Streaming.pdf
>
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
