[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-03 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125109#comment-17125109 ] Arvid Heise commented on FLINK-17918: - The ticket originally was "[FLINK-17918] Jobs with two input

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-03 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124941#comment-17124941 ] Piotr Nowojski commented on FLINK-17918: I think [~jark] you are right, we have also checked the

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-02 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123696#comment-17123696 ] Jark Wu commented on FLINK-17918: - No, all the failed join tests do not use watermarks. > Blink Jobs

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-02 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123503#comment-17123503 ] Arvid Heise commented on FLINK-17918: - I fear that these errors are independent, but could be

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-02 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123491#comment-17123491 ] Jark Wu commented on FLINK-17918: - [~pnowojski] Oh, sorry I didn't notice the inner LIMIT in the query

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-02 Thread Yun Tang (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123447#comment-17123447 ] Yun Tang commented on FLINK-17918: -- As far as I know, most users would choose RocksDB as state backend

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-02 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123385#comment-17123385 ] Arvid Heise commented on FLINK-17918: - Yes, the root cause is {{LIMIT}} swallowing up some tail

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-02 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123375#comment-17123375 ] Piotr Nowojski commented on FLINK-17918: [~jark] {quote} But I think this maybe another issue,

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Yu Li (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121532#comment-17121532 ] Yu Li commented on FLINK-17918: --- Thanks [~jark], I was about to add the same comments, that the observed

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Jark Wu (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121526#comment-17121526 ] Jark Wu commented on FLINK-17918: - Thanks [~pnowojski] and [~AHeise] for the investigating. After

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121031#comment-17121031 ] Piotr Nowojski commented on FLINK-17918: I think [~AHeise] is right. We are mutating the list

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120974#comment-17120974 ] Arvid Heise commented on FLINK-17918: - Btw see this

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Arvid Heise (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120968#comment-17120968 ] Arvid Heise commented on FLINK-17918: - Yes [~ykt836] . I'm suspecting that during [updating the

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Kurt Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120903#comment-17120903 ] Kurt Young commented on FLINK-17918: >From above comment, it seems that the problem is caused by

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Kurt Young (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120902#comment-17120902 ] Kurt Young commented on FLINK-17918: cc [~jark]    > Blink Jobs are loosing data on recovery >

[jira] [Commented] (FLINK-17918) Blink Jobs are loosing data on recovery

2020-06-01 Thread Piotr Nowojski (Jira)
[ https://issues.apache.org/jira/browse/FLINK-17918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120870#comment-17120870 ] Piotr Nowojski commented on FLINK-17918: Some status update. [~AHeise] has added quite a big of