[jira] [Commented] (FLINK-7167) Job can't set checkpoint meta directory to cover the system setting state.checkpoints.dir
[ https://issues.apache.org/jira/browse/FLINK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17336726#comment-17336726 ] Flink Jira Bot commented on FLINK-7167: --- This issue was labeled "stale-major" 7 ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Job can't set checkpoint meta directory to cover the system setting > state.checkpoints.dir > -- > > Key: FLINK-7167 > URL: https://issues.apache.org/jira/browse/FLINK-7167 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing >Affects Versions: 1.3.1 >Reporter: yuqi >Priority: Major > Labels: stale-major > > If we want to recover a failed job use checkpoint, till now, as all job > checkpoint meta data are in the same directory and do not have specific > identification, we have to traverse all file in the directory to find the > data of this job. this is rather troublesome. so seting this configuration > in the job level is preferable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-7167) Job can't set checkpoint meta directory to cover the system setting state.checkpoints.dir
[ https://issues.apache.org/jira/browse/FLINK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17328744#comment-17328744 ] Flink Jira Bot commented on FLINK-7167: --- This major issue is unassigned and itself and all of its Sub-Tasks have not been updated for 30 days. So, it has been labeled "stale-major". If this ticket is indeed "major", please either assign yourself or give an update. Afterwards, please remove the label. In 7 days the issue will be deprioritized. > Job can't set checkpoint meta directory to cover the system setting > state.checkpoints.dir > -- > > Key: FLINK-7167 > URL: https://issues.apache.org/jira/browse/FLINK-7167 > Project: Flink > Issue Type: Improvement > Components: Runtime / Checkpointing >Affects Versions: 1.3.1 >Reporter: yuqi >Priority: Major > Labels: stale-major > > If we want to recover a failed job use checkpoint, till now, as all job > checkpoint meta data are in the same directory and do not have specific > identification, we have to traverse all file in the directory to find the > data of this job. this is rather troublesome. so seting this configuration > in the job level is preferable. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (FLINK-7167) Job can't set checkpoint meta directory to cover the system setting state.checkpoints.dir
[
https://issues.apache.org/jira/browse/FLINK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16380246#comment-16380246
]
Stefan Richter commented on FLINK-7167:
---
[~StephanEwen] isn't this already covered by PR that introduced
{{CompletedCheckpointStorageLocation}}? If yes, can we close this?
> Job can't set checkpoint meta directory to cover the system setting
> state.checkpoints.dir
> --
>
> Key: FLINK-7167
> URL: https://issues.apache.org/jira/browse/FLINK-7167
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
>Affects Versions: 1.3.1
>Reporter: yuqi
>Assignee: Bowen Li
>Priority: Major
>
> If we want to recover a failed job use checkpoint, till now, as all job
> checkpoint meta data are in the same directory and do not have specific
> identification, we have to traverse all file in the directory to find the
> data of this job. this is rather troublesome. so seting this configuration
> in the job level is preferable.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (FLINK-7167) Job can't set checkpoint meta directory to cover the system setting state.checkpoints.dir
[ https://issues.apache.org/jira/browse/FLINK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16197144#comment-16197144 ] Aljoscha Krettek commented on FLINK-7167: - Thanks for pointing this out, [~phoenixjiangnan]. There is actually a (very outdated) PR that also tries to tackle this issue: https://github.com/apache/flink/pull/3522. I think the solution we will go for in the end is to get rid of this configuration parameter, this should make things easier. > Job can't set checkpoint meta directory to cover the system setting > state.checkpoints.dir > -- > > Key: FLINK-7167 > URL: https://issues.apache.org/jira/browse/FLINK-7167 > Project: Flink > Issue Type: Improvement > Components: State Backends, Checkpointing >Affects Versions: 1.3.1 >Reporter: yuqi >Assignee: Bowen Li > > If we want to recover a failed job use checkpoint, till now, as all job > checkpoint meta data are in the same directory and do not have specific > identification, we have to traverse all file in the directory to find the > data of this job. this is rather troublesome. so seting this configuration > in the job level is preferable. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7167) Job can't set checkpoint meta directory to cover the system setting state.checkpoints.dir
[ https://issues.apache.org/jira/browse/FLINK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196523#comment-16196523 ] Bowen Li commented on FLINK-7167: - Hi [~aljoscha], I feel this is partly related to discussions in FLINK-4814. What do you think about this ticket? Do you want to take this as a quick fix, or as part of [this documented effort|https://docs.google.com/document/d/1Q8hkpl2VVXrbEaJkQNe88kuus0F5wFFiebub9hqrg1s/edit#]? > Job can't set checkpoint meta directory to cover the system setting > state.checkpoints.dir > -- > > Key: FLINK-7167 > URL: https://issues.apache.org/jira/browse/FLINK-7167 > Project: Flink > Issue Type: Improvement > Components: State Backends, Checkpointing >Affects Versions: 1.3.1 >Reporter: yuqi >Assignee: Bowen Li > > If we want to recover a failed job use checkpoint, till now, as all job > checkpoint meta data are in the same directory and do not have specific > identification, we have to traverse all file in the directory to find the > data of this job. this is rather troublesome. so seting this configuration > in the job level is preferable. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Commented] (FLINK-7167) Job can't set checkpoint meta directory to cover the system setting state.checkpoints.dir
[
https://issues.apache.org/jira/browse/FLINK-7167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16196456#comment-16196456
]
Bowen Li commented on FLINK-7167:
-
I've been looking forward to such an improvement too. Not only just having
{{state.checkpoints.dir}} per job but also setting
{{state.backend.fs.checkpointdir}} per job
> Job can't set checkpoint meta directory to cover the system setting
> state.checkpoints.dir
> --
>
> Key: FLINK-7167
> URL: https://issues.apache.org/jira/browse/FLINK-7167
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
>Affects Versions: 1.3.1
>Reporter: yuqi
>Assignee: Bowen Li
>
> If we want to recover a failed job use checkpoint, till now, as all job
> checkpoint meta data are in the same directory and do not have specific
> identification, we have to traverse all file in the directory to find the
> data of this job. this is rather troublesome. so seting this configuration
> in the job level is preferable.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
