Fengyu Cao created SPARK-26389:
----------------------------------
Summary: temp checkpoint folder at executor should be deleted on
graceful shutdown
Key: SPARK-26389
URL: https://issues.apache.org/jira/browse/SPARK-26389
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 2.4.0
Reporter: Fengyu Cao
spark-submit --master mesos://<mesos> --conf
spark.streaming.stopGracefullyOnShutdown=true <structured streaming framework>
CTRL-C, framework shutdown
18/12/18 10:27:36 ERROR MicroBatchExecution: Query [id =
f512e17a-df88-4414-a5cd-a23550cf1e7f, runId =
24d99723-8d61-48c0-beab-af432f7a19d3] terminated with error
org.apache.spark.SparkException: Writing job aborted.
/tmp/temporary-<uuid> on executor not deleted due to
`org.apache.spark.SparkException: Writing job aborted.`, and this temp
checkpoint can't used to recovery.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
