[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2023-02-23 Thread xy (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17692580#comment-17692580 ] xy commented on FLINK-21250: [~jiangjiguang0719] can you tell me the detail of your problem，we can

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread jiangjiguang0719 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17279252#comment-17279252 ] jiangjiguang0719 commented on FLINK-21250: -- I got it, and [~trohrmann] you can close the issue,

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278812#comment-17278812 ] Till Rohrmann commented on FLINK-21250: --- This is not a viable solution because Flink utilizes the

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread jiangjiguang0719 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278784#comment-17278784 ] jiangjiguang0719 commented on FLINK-21250: -- [~roman_khachatryan]   Of course there are two

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread Roman Khachatryan (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278778#comment-17278778 ] Roman Khachatryan commented on FLINK-21250: --- Sorry for the late response. I agree with 

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread jiangjiguang0719 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278738#comment-17278738 ] jiangjiguang0719 commented on FLINK-21250: -- [~trohrmann]  My solution is:  Extend the

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278736#comment-17278736 ] Till Rohrmann commented on FLINK-21250: --- Then this is the problem. Flink needs an HA service

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread jiangjiguang0719 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278727#comment-17278727 ] jiangjiguang0719 commented on FLINK-21250: -- [~trohrmann] I am not using HA service, I just set

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278721#comment-17278721 ] Till Rohrmann commented on FLINK-21250: --- Which HA service are you using [~jiangjiguang0719]? >

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread jiangjiguang0719 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278718#comment-17278718 ] jiangjiguang0719 commented on FLINK-21250: -- I have got it !!! My test scenario is: my

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-04 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278709#comment-17278709 ] Till Rohrmann commented on FLINK-21250: --- Are you using Flink's HA services? Flink can only

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread jiangjiguang0719 (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278630#comment-17278630 ] jiangjiguang0719 commented on FLINK-21250: -- I have reproduced this problem，When jobmanager has

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread zhuxiaoshang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278512#comment-17278512 ] zhuxiaoshang commented on FLINK-21250: -- latest progress, we find the checkpoint id is cyclic, from

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread zhuxiaoshang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278495#comment-17278495 ] zhuxiaoshang commented on FLINK-21250: -- [~trohrmann] [~roman_khachatryan],Could you offer some

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread zhuxiaoshang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278490#comment-17278490 ] zhuxiaoshang commented on FLINK-21250: -- [~trohrmann],it's not convenient to open debug log in

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17278017#comment-17278017 ] Till Rohrmann commented on FLINK-21250: --- Have you tried upgrading to the latest Flink version?

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread zhuxiaoshang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277927#comment-17277927 ] zhuxiaoshang commented on FLINK-21250: -- [~trohrmann] [~hauler] Thx for your reply.These jobs have

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread liuguiru (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277921#comment-17277921 ] liuguiru commented on FLINK-21250: -- I'm responsible for the 400+ Flink tasks. I've moved them from

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread Till Rohrmann (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277881#comment-17277881 ] Till Rohrmann commented on FLINK-21250: --- Thanks for reporting this issue [~liufangliang]. Could

[jira] [Commented] (FLINK-21250) Failure to finalize checkpoint due to org.apache.hadoop.fs.FileAlreadyExistsException: /user/flink/checkpoints/9e36ed4ec2f6685f836e5ee5395f5f2e/chk-11096/_metadata fo

2021-02-03 Thread Fangliang Liu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-21250?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17277849#comment-17277849 ] Fangliang Liu commented on FLINK-21250: --- Hi [~trohrm...@apache.org], looking forward to your