Burak Yavuz created SPARK-17921:

             Summary: checkpointLocation being set in memory streams fail after 
restart. Should fail fast
                 Key: SPARK-17921
                 URL: https://issues.apache.org/jira/browse/SPARK-17921
             Project: Spark
          Issue Type: Bug
          Components: SQL, Streaming
    Affects Versions: 2.0.1, 2.0.0
            Reporter: Burak Yavuz

The checkpointLocation option in memory streams in StructuredStreaming is not 
used during recovery. However, it can use this location if it is being set. 
However, during recovery, if this location was set, we get an exception saying 
that we will not use this location for recovery, please delete it. 

It's better to just fail before you start the stream in the first place

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to