Re: Transactions, delivery timeout and changing transactional producer behavior

2022-10-22 Thread Urbán Dániel
Hi everyone, I would like to bump this transactional producer bug again:https://issues.apache.org/jira/browse/KAFKA-14053 Which already has an open PR: https://github.com/apache/kafka/pull/12392 There is a not-so-frequent, but - in my opinion - critical bug in transactional producers. If the

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-09-13 Thread Chris Egerton
Hi Colt, You can certainly review PRs, but you cannot merge them. Reviews are still valuable as they help lighten the workload on committers and, to some degree, provide a signal of how high-priority a change is to the community. Cheers, Chris On Sun, Sep 11, 2022 at 12:19 PM Colt McNealy

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-09-11 Thread Colt McNealy
Hi all— I'm not a committer so I can't review this PR (or is that not true?). However, I'd like to bump this as well. I believe that I've encountered this bug during chaos testing with the transactional producer. I can sometimes produce this error when killing a broker during a long-running

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-09-09 Thread Dániel Urbán
Hi all, I would like to bump this and bring some attention to the issue. This is a nasty bug in the transactional producer, would be nice if I could get some feedback on the PR: https://github.com/apache/kafka/pull/12392 Thanks in advance, Daniel Viktor Somogyi-Vass ezt írta (időpont: 2022.

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-07-25 Thread Viktor Somogyi-Vass
Hi Luke & Artem, We prepared the fix, would you please help in getting a committer-reviewer to get this issue resolved? Thanks, Viktor On Fri, Jul 8, 2022 at 12:57 PM Dániel Urbán wrote: > Submitted a PR with the fix: https://github.com/apache/kafka/pull/12392 > In the PR I tried keeping the

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-07-08 Thread Dániel Urbán
Submitted a PR with the fix: https://github.com/apache/kafka/pull/12392 In the PR I tried keeping the producer in a usable state after the forced bump. I understand that it might be the cleanest solution, but the only other option I know of is to transition into a fatal state, meaning that the

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-07-07 Thread Dániel Urbán
Thanks for the feedback, I created https://issues.apache.org/jira/browse/KAFKA-14053 and started working on a PR. Luke, for the workaround, we used the transaction admin tool released in 3.0 to "abort" these hanging batches manually. Naturally, the cluster health should be stabilized. This issue

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-07-06 Thread Luke Chen
Hi Daniel, Thanks for reporting the issue, and the investigation. I'm curious, so, what's your workaround for this issue? I agree with Artem, it makes sense. Please file a bug in JIRA. And looking forward to your PR! :) Thank you. Luke On Thu, Jul 7, 2022 at 3:07 AM Artem Livshits wrote: >

Re: Transactions, delivery timeout and changing transactional producer behavior

2022-07-06 Thread Artem Livshits
Hi Daniel, What you say makes sense. Could you file a bug and put this info there so that it's easier to track? -Artem On Wed, Jul 6, 2022 at 8:34 AM Dániel Urbán wrote: > Hello everyone, > > I've been investigating some transaction related issues in a very > problematic cluster. Besides