[
https://issues.apache.org/jira/browse/SPARK-16738?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15627148#comment-15627148
]
Michael Armbrust commented on SPARK-16738:
------------------------------------------
You can already query the state store today, if you write the results of a
{{complete}} mode streaming query into the {{memory}} sink. Now, this does
require collecting all of the result to the driver, so might no work for your
use case. Eitherway, it would be helpful to understand what you are trying to
accomplish a little bit better so we can make sure we build the right
interfaces.
> Queryable state for Spark State Store
> -------------------------------------
>
> Key: SPARK-16738
> URL: https://issues.apache.org/jira/browse/SPARK-16738
> Project: Spark
> Issue Type: New Feature
> Components: Structured Streaming
> Affects Versions: 2.0.0
> Reporter: Mark Sumner
> Labels: features
>
> Spark 2.0 will introduce the new State Store to allow state managment outside
> the RDD model (see: SPARK-13809)
> This proposal seeks to include a mechanism (in a future release) to expose
> this internal store to external applications for querying.
> This would then make it possible to interact with aggregated state without
> needing to synchronously write (and read) to/from an external store.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
