[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17139963#comment-17139963 ] Mateusz Jadczyk commented on KAFKA-9891: LGTM thanks for looking into it and making sure that

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138942#comment-17138942 ] Matthias J. Sax commented on KAFKA-9891: PR [https://github.com/apache/kafka/pull/8890] for

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138091#comment-17138091 ] Matthias J. Sax commented on KAFKA-9891: [~mateuszjadczyk] [~bchen225242]: I think I was able to

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128646#comment-17128646 ] Matthias J. Sax commented on KAFKA-9891: I am not 100% sure. But even if not, it might be severe

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17128389#comment-17128389 ] John Roesler commented on KAFKA-9891: - Hi [~mjsax] and [~bchen225242] , I see you're just added this

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125457#comment-17125457 ] Boyang Chen commented on KAFKA-9891: [~mateuszjadczyk] I see, glad you guys have a workaround. I

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124787#comment-17124787 ] Mateusz Jadczyk commented on KAFKA-9891: [~bchen225242] well, it shouldn't occur for either of

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17124296#comment-17124296 ] Boyang Chen commented on KAFKA-9891: [~mateuszjadczyk] that's right, so we should only check

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123544#comment-17123544 ] Mateusz Jadczyk commented on KAFKA-9891: The reason we need at least one materialized key is that

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17123542#comment-17123542 ] Mateusz Jadczyk commented on KAFKA-9891: [~bchen225242] yes, it should be materialized. Duplicate

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17121149#comment-17121149 ] Boyang Chen commented on KAFKA-9891: [~mateuszjadczyk] If we commit keyOne, then it *should* be

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120333#comment-17120333 ] Mateusz Jadczyk commented on KAFKA-9891: On trunk I can't seem to reproduce this particular

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120253#comment-17120253 ] Mateusz Jadczyk commented on KAFKA-9891: I think I wanted to be sure that keyOne is committed

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119899#comment-17119899 ] Boyang Chen commented on KAFKA-9891: [~mateuszjadczyk] I ran your example again, and could see that

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117509#comment-17117509 ] Mateusz Jadczyk commented on KAFKA-9891: [~mjsax] If I'm not mistaken, these logs indicate a bug,

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117158#comment-17117158 ] Matthias J. Sax commented on KAFKA-9891: Even if two instances run on the same server and use the

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115954#comment-17115954 ] Mateusz Jadczyk commented on KAFKA-9891: [~mjsax] if this is true  > _Restart instance one; it

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115366#comment-17115366 ] Mateusz Jadczyk commented on KAFKA-9891: Maybe this could make this test more reliable

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115352#comment-17115352 ] Mateusz Jadczyk commented on KAFKA-9891: BTW in this test (_failedtest3_) it also turns out to be

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115324#comment-17115324 ] Mateusz Jadczyk commented on KAFKA-9891: I think I reproduce it in 

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17115006#comment-17115006 ] Matthias J. Sax commented on KAFKA-9891: Why not create two instances with one thread each? This

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17114862#comment-17114862 ] Boyang Chen commented on KAFKA-9891: I made another attempt to reproduce the issue on local.

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17111343#comment-17111343 ] Boyang Chen commented on KAFKA-9891: Sorry I was oncall last week. Will take another look this week.

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17110947#comment-17110947 ] Mateusz Jadczyk commented on KAFKA-9891: [~bchen225242] have you had time to look some more into

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102668#comment-17102668 ] Mateusz Jadczyk commented on KAFKA-9891: Maybe I didn't. You can now find them in attachments.  I

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17102271#comment-17102271 ] Boyang Chen commented on KAFKA-9891: I don't see the full log for 3 nodes you mentioned, where did

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100156#comment-17100156 ] Boyang Chen commented on KAFKA-9891: [~mateuszjadczyk] Lol, no worry, thanks a lot for the insight

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100135#comment-17100135 ] Mateusz Jadczyk commented on KAFKA-9891: I don't think I have enough knowledge to propose a fix,

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100021#comment-17100021 ] Boyang Chen commented on KAFKA-9891: [~mateuszjadczyk] on the other hand, if you are willing to work

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17100020#comment-17100020 ] Boyang Chen commented on KAFKA-9891: We had some offline discussion, and plan to revise the

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17099743#comment-17099743 ] Mateusz Jadczyk commented on KAFKA-9891: [~bchen225242] Hi, is any follow-up planned for this? >

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17094313#comment-17094313 ] Mateusz Jadczyk commented on KAFKA-9891: Thanks for looking into it. I looked into the test (see

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17092295#comment-17092295 ] Boyang Chen commented on KAFKA-9891: I made a try to replicate the scenario with integration test,

[jira] [Commented] (KAFKA-9891) Invalid state store content after task migration with exactly_once and standby replicas

[ https://issues.apache.org/jira/browse/KAFKA-9891?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17088044#comment-17088044 ] Boyang Chen commented on KAFKA-9891: Thanks for the report, will take a look this week. > Invalid