L. C. Hsieh created SPARK-33816:
-----------------------------------
Summary: Make stateful operations reuse previous state store
Key: SPARK-33816
URL: https://issues.apache.org/jira/browse/SPARK-33816
Project: Spark
Issue Type: Improvement
Components: Structured Streaming
Affects Versions: 3.2.0
Reporter: L. C. Hsieh
Assignee: L. C. Hsieh
Currently Spark SS can schedule stateful operations to active state store
locations. For some reasons, Spark might not be able to schedule tasks to
active state store locations. In the case, we should be able to schedule the
tasks to sub-optimal locations.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
