Burak Yavuz created SPARK-17921:
-----------------------------------
Summary: checkpointLocation being set in memory streams fail after
restart. Should fail fast
Key: SPARK-17921
URL: https://issues.apache.org/jira/browse/SPARK-17921
Project: Spark
Issue Type: Bug
Components: SQL, Streaming
Affects Versions: 2.0.1, 2.0.0
Reporter: Burak Yavuz
The checkpointLocation option in memory streams in StructuredStreaming is not
used during recovery. However, it can use this location if it is being set.
However, during recovery, if this location was set, we get an exception saying
that we will not use this location for recovery, please delete it.
It's better to just fail before you start the stream in the first place
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
