Sanford Ryza created SPARK-54280:
------------------------------------
Summary: Require pipeline checkpoint storage location to be an
absolute path
Key: SPARK-54280
URL: https://issues.apache.org/jira/browse/SPARK-54280
Project: Spark
Issue Type: Improvement
Components: Declarative Pipelines
Affects Versions: 4.1.0
Reporter: Sanford Ryza
Streaming checkpoint locations are required to be absolute paths. This helps
avoid accidentally losing checkpoints when running with a different working
directory. We should require the same for the pipeline directory that contains
checkpoints for all the pipeline's flows.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
