Apache Spark commented on SPARK-17921:

User 'brkyvz' has created a pull request for this issue:

> checkpointLocation being set in memory streams fail after restart. Should 
> fail fast
> -----------------------------------------------------------------------------------
>                 Key: SPARK-17921
>                 URL: https://issues.apache.org/jira/browse/SPARK-17921
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL, Streaming
>    Affects Versions: 2.0.0, 2.0.1
>            Reporter: Burak Yavuz
> The checkpointLocation option in memory streams in StructuredStreaming is not 
> used during recovery. However, it can use this location if it is being set. 
> However, during recovery, if this location was set, we get an exception 
> saying that we will not use this location for recovery, please delete it. 
> It's better to just fail before you start the stream in the first place

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to