[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776440#comment-17776440 ] Xin Chen commented on FLINK-33288: -- [~mapohl][~Zhanghao Chen] Thank you for your discussion. I'll move

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776183#comment-17776183 ] Zhanghao Chen commented on FLINK-33288: --- HI [~mapohl], thanks for joining the discussion here. +1

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Matthias Pohl (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776158#comment-17776158 ] Matthias Pohl commented on FLINK-33288: --- Hi [~xinchen147], thanks for reporting this issue and

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776124#comment-17776124 ] Xin Chen commented on FLINK-33288: -- yeah,I see now. [~Zhanghao Chen] I have incorporated your

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776113#comment-17776113 ] Zhanghao Chen commented on FLINK-33288: --- [~xinchen147] you are right. But since the path to job

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776081#comment-17776081 ] Xin Chen commented on FLINK-33288: -- [~Zhanghao Chen] Yes, and I'm still a bit confused. You can see

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776077#comment-17776077 ] Zhanghao Chen commented on FLINK-33288: --- [~xinchen147] Indeed, it seems that the job result store

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776065#comment-17776065 ] Zhanghao Chen commented on FLINK-33288: --- Job Result Store is added in Flink 1.15. Check

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776064#comment-17776064 ] Xin Chen commented on FLINK-33288: -- Thank you very much! [~Zhanghao Chen]. I have hardly heard of

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776058#comment-17776058 ] Zhanghao Chen commented on FLINK-33288: --- [~xinchen147] Yes, the solution proposed in FLINK-30513

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776054#comment-17776054 ] Xin Chen commented on FLINK-33288: -- Hi [~Zhanghao Chen] , so 'Broking the job result store feature' is

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Zhanghao Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776050#comment-17776050 ] Zhanghao Chen commented on FLINK-33288: --- Hi [~xinchen147], thanks for reporting it, this is the

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776047#comment-17776047 ] Xin Chen commented on FLINK-33288: -- In the code, it can be seen that after the task is completed, there

[jira] [Commented] (FLINK-33288) Empty directory residue with appid name in HA(highly-available) related directory of hdfs, not cleaned

2023-10-17 Thread Xin Chen (Jira)
[ https://issues.apache.org/jira/browse/FLINK-33288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17776041#comment-17776041 ] Xin Chen commented on FLINK-33288: -- This is a serious bug. Specifically, when adding the following