[
https://issues.apache.org/jira/browse/FLINK-25405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Till Rohrmann updated FLINK-25405:
----------------------------------
Description: In order to make the BlobServer and BlobCache work together
with the local working directories, they have be able to detect corrupted blobs
(e.g. due to process crashes when downloading blobs) and delete them.
Therefore, I propose to let the BlobServer and BlobCache verify by recomputing
their checksums which blobs are valid and to delete those that did not pass.
(was: In order to make the BlobServer and BlobCache work together with the
local working directories, they have be able to detect corrupted blobs (e.g.
due to process crashes when downloading blobs) and delete them. Therefore, I
propose to let the BlobServer and BlobCache remember which blobs they have
verified (by recomputing their checksums) and to delete those that did not
pass.)
> Let BlobServer/BlobCache detect & delete corrupted blobs
> --------------------------------------------------------
>
> Key: FLINK-25405
> URL: https://issues.apache.org/jira/browse/FLINK-25405
> Project: Flink
> Issue Type: Sub-task
> Components: Runtime / Coordination
> Affects Versions: 1.15.0
> Reporter: Till Rohrmann
> Assignee: Till Rohrmann
> Priority: Major
> Fix For: 1.15.0
>
>
> In order to make the BlobServer and BlobCache work together with the local
> working directories, they have be able to detect corrupted blobs (e.g. due to
> process crashes when downloading blobs) and delete them. Therefore, I propose
> to let the BlobServer and BlobCache verify by recomputing their checksums
> which blobs are valid and to delete those that did not pass.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
