[
https://issues.apache.org/jira/browse/FLINK-4814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15742566#comment-15742566
]
ASF GitHub Bot commented on FLINK-4814:
---------------------------------------
Github user StephanEwen commented on the issue:
https://github.com/apache/flink/pull/2752
I think this is a very nice addition, but probably needs a bit refinement:
- I heard from various users that they would like to have a config option
for the checkpoint directory, over a configuration "in code"
- I would suggest to actually retain the `state.checkpoints.dir` config
parameter, and make every state backend respect it for externalized checkpoints
- State backends that write to a file system (FsStateBackend, RocksDB,
...) would respect that parameter (we might even want to deprecate their
specific checkpoint dir parameter)
- State backends that do not write to files will be fine with this
parameter being absent unless one chooses to enable externalized checkpoints
- The "in code" options overrides the config option, if both are set.
- The option to enable externalize checkpoints should be also present in
the configuration.
What would be nice is to merge the documentation, as far as it is
applicable to the current state.
> Remove extra storage location for externalized checkpoint metadata
> ------------------------------------------------------------------
>
> Key: FLINK-4814
> URL: https://issues.apache.org/jira/browse/FLINK-4814
> Project: Flink
> Issue Type: Sub-task
> Reporter: Ufuk Celebi
>
> Follow up for FLINK-4512.
> Store checkpoint meta data in checkpoint directory. That makes it simpler
> for users to track and clean up checkpoints manually, if they want to retain
> externalized checkpoints across cancellations and terminal failures.
> Every state backend needs to be able to provide a storage location for the
> checkpoint metadata. The memory state backend would hence not work with
> externalized checkpoints, unless one sets explicitly a parameter
> `setExternalizedCheckpointsLocation(uri)`.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
