GitHub user zsxwing opened a pull request:
https://github.com/apache/spark/pull/23060
[SPARK-26092][SS]Use CheckpointFileManager to write the streaming metadata
file
## What changes were proposed in this pull request?
Use CheckpointFileManager to write the streaming `metadata` file so that
the `metadata` file will never be a partial file.
## How was this patch tested?
Jenkins
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/zsxwing/spark SPARK-26092
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/spark/pull/23060.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #23060
commit 4cb6abe5cb44692075841c446aca8d9cf12b8968
Author: Shixiong Zhu
Date: 2018-11-16T06:26:43Z
Use CheckpointFileManager to write the streaming metadata file
---
-
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org
