my energy elsewhere.
Kind regards,
Erik.
Op 24-07-2023 om 18:12 schreef Erik van Oosten:
Hello Xiangyuan LI,
I am not familiar with coroutines, nor with Kotlin. You will have to
work with the documentation:
https://kotlinlang.org/docs/coroutines-overview.html
However, I am familiar
/confluence/display/KAFKA/KIP-983%3A+Full+speed+async+processing+during+rebalance
--
Erik van Oosten
e.vanoos...@grons.nl
https://day-to-day-stuff.blogspot.com
n't really a problem but how would you
change work in case of async offset commits? There can be a few caveats
there as you may not know whether a commit is finished or not until your
callback is called.
Thanks,
Viktor
On Sat, Sep 23, 2023 at 4:00 PM Erik van Oosten
wrote:
Hi all,
n. Is async
processing not something that the kafka client wants to support?
Kind regards,
Erik.
Op 25-09-2023 om 18:17 schreef Erik van Oosten:
Hi Viktor,
Good questions!
1. Auto-commits would only work with approach 1 in the KIP. Any async
solution is incompatible with auto-commits. D
reviewing the KIP, but I also have
not forgotten about it!
In general, KIP review process can be lengthy, so I think mailing list is
the best bet to get the committer's attention.
P
On Fri, Oct 13, 2023 at 10:55 AM Erik van Oosten
wrote:
Hi client developers,
The text is updated so that it is
. 2023 à 20:44, Erik van Oosten
a écrit :
Thanks Philip,
No worries, I am not in a hurry. Knowing this is not forgotten is enough
for me. If there is anything I can do to help the process please let me
know.
Kind regards,
Erik.
Op 13-10-2023 om 20:29 schreef Philip Nee:
Hi Erik,
Sorry for
Thanks - I am still reading to KIP and your previous KIP to see if I can
make more constructive suggestions here.
P
On Fri, Oct 13, 2023 at 11:54 PM Erik van Oosten
wrote:
Hello David,
Thanks, I am happy to hear we agree on the problem. All the tiny details
of an implementation are less imp
would be very happy to hear
about that because it means I do not have to wait for a release cycle.
If you agree these arguments are sound, I would be happy to make the
pull request mergable again.
Curious to your thoughts and kind regards,
Erik.
--
Erik van Oosten
e.vanoos...@grons.nl
with the rebalancing,
which leads to my second comment/question. is it your concern that we
currently don't have a way to invoke the callback, and the user won't
be to
correctly handle these failed/successful async commits?
Thanks,
P
On Tue, May 2, 2023 at 12:22 PM Erik van Oosten
wrote:
If I were to rebase the old pull request and re-open KAFKA-10337, would
it be considered for merging?
Kind regards,
Erik.
Op 03-05-2023 om 09:21 schreef Erik van Oosten:
Hi Philip,
Firstly, could you explain the situation
in that you would prefer to invoke commitAsync over commitSync
Is that an acceptable
change?
Kind regards,
Erik.
Op 05-05-2023 om 20:20 schreef Philip Nee:
Hey Eric,
Maybe its more straightforward to open a new PR.
Thanks!
P
On Fri, May 5, 2023 at 9:36 AM Erik van Oosten wrote:
If I were to rebase the old pull request and re-open KAFKA-10337, w
Dear Kafka developers,
I submitted https://github.com/apache/kafka/pull/13914 to fix a long
standing problem that the Kafka consumer on the JVM is not usable from
asynchronous runtimes such as Kotlin co-routines and ZIO.
Your review is much appreciated.
Kind regards,
Erik.
--
Erik van
Dear reader,
I would like to create a KIP and understand I need to request
permissions for that.
my wiki username: e.vanoos...@chello.nl (note, this is /not/ my email
address)
my Jira username: erikvanoosten
Kind regards,
Erik.
--
Erik van Oosten
e.vanoos...@grons.nl
https://day-to
the current behavior. Any help in this
area would be appreciated.
Kind regards,
Erik.
--
Erik van Oosten
e.vanoos...@grons.nl
https://day-to-day-stuff.blogspot.com
It seems KIP-941 was already taken. Updated to: KIP-944.
Op 28-06-2023 om 10:11 schreef Erik van Oosten:
Hello developers of the Java based consumer,
I submitted https://github.com/apache/kafka/pull/13914 to fix a long
standing problem that the Kafka consumer on the JVM is not usable from
section. As far as I
am aware there are no tests for the current behavior. Any help in this
area would be appreciated.
Kind regards,
Erik.
--
Erik van Oosten
e.vanoos...@grons.nl
https://day-to-day-stuff.blogspot.com
Hello all,
I'd like to call a vote on KIP-944 Support async runtimes in consumer.
It has has been 'under discussion' for 7 days now. 'Under discussion'
between quotes, because there were 0 comments so far. I hope the KIP is
clear!
KIP description: https://cwiki.apache.org/confluence/x/chw0Dw
-2023 om 11:38 schreef Erik van Oosten:
Hello all,
I'd like to call a vote on KIP-944 Support async runtimes in consumer.
It has has been 'under discussion' for 7 days now. 'Under discussion'
between quotes, because there were 0 comments so far. I hope the KIP
is clear!
essentially the latter.
I do understand that it's frustrating to not get a quick response. However,
overall I think this one needs a lot more discussion before getting anywhere
near a vote. I will leave a -1 just as a procedural step. Maybe some of the
people working in the client area c
he other threads.
Please consider the context which is that we are running inside the
callback of the rebalance listener. The only way to execute something
and also have a timeout on it is to run the something on another thread.
Kind regards,
Erik.
Op 08-07-2023 om 19:17 schreef Colin McCabe:
ut involving the other threads.
Please consider the context which is that we are running inside the
callback of the rebalance listener. The only way to execute something
and also have a timeout on it is to run the something on another thread.
Kind regards,
Erik.
Op 08-07-2023 om 19:17 sc
-Threadsafety
Kind regards,
Erik.
Op 12-07-2023 om 13:24 schreef Erik van Oosten:
Thanks Philip,
> I think this can be demonstrated via diagrams and some code in the KIP.
There are some diagrams in KIP-944. How can they be improved?
I will add some code to address the concerns around mem
-944) because, concurrent
invocations are simply no longer needed. (Of course, if backward
compatibility is a goal, not all of these things can be done.)
Curious to your thoughts and kind regards,
Erik.
--
Erik van Oosten
e.vanoos...@grons.nl
https://day-to-day-stuff.blogspot.com
er different use cases to demonstrate it doesn't
cause any unsafe access. I think this can be demonstrated via diagrams and
some code in the KIP.
Thanks,
P
On Sat, Jul 8, 2023 at 12:28 PM Erik van Oosten
wrote:
Hello Colin,
>> In KIP-944, the callback thread can only delegat
tests that
are described in the KIP.
Kind regards,
Erik.
Op 30-06-2023 om 07:56 schreef Erik van Oosten:
[This is a resend with the correct KIP number.]
Hello developers of the Java based consumer,
I submitted https://github.com/apache/kafka/pull/13914 to fix a long
standing problem
ation over the radio silence. It gets
like that sometimes, and I apologize for my lack of feedback.
I’d personally like to see this lively exchange move over to the
DISCUSS thread you’d created before.
Thanks,
Kirk
On Jul 14, 2023, at 1:33 AM, Erik van Oosten
wrote:
Hi Colin,
The way I
possible for subclasses to
implement the proposal in KIP-944, without any KIPs or other changes to the
official Java clients library.
Best,
Chris
On Sat, Jul 22, 2023 at 4:24 AM Erik van Oosten
wrote:
Hi Matthias,
I am getting a bit frustrated here. All the concerns and questions I
have seen
mer::release methods. If we upgraded the visibility of these
methods from private to protected, it would be possible for subclasses to
implement the proposal in KIP-944, without any KIPs or other changes to the
official Java clients library.
Best,
Chris
On Sat, Jul 22, 2023 at 4:24 AM Erik van Oosten
w
Colin, Matthias, Chris,
I have expanded the use case description in KIP-944. I hope it is more
clear what we're trying to achieve.
https://cwiki.apache.org/confluence/x/chw0Dw
Kind regards,
Erik.
Op 22-07-2023 om 17:23 schreef Erik van Oosten:
Hello Chris,
Thanks for elabor
wiki page for KIP-957 contains more details
https://cwiki.apache.org/confluence/x/lY6zDw
This is a call for discussion. If possible I would like to include this
change in Kafka 3.6.
Any questions, comments, ideas and other additions are welcome!
Kind regards,
Erik.
--
Erik van Oosten
KIP based on the discussion.
Le sam. 22 juil. 2023 à 18:34, Erik van Oosten
a écrit :
Colin, Matthias, Chris,
I have expanded the use case description in KIP-944. I hope it is more
clear what we're trying to achieve.
https://cwiki.apache.org/confluence/x/chw0Dw
Kind regards,
Erik.
it. Maybe you need a more elaborate description
to demonstrate how coroutine code run.
Erik van Oosten 于2023年7月23日周日 17:47写道:
Hi David,
> Could you elaborate a bit more on why the callbacks must be ran in
another thread vs in the invoker thread?
I have been thinking on how to explain thi
[
https://issues.apache.org/jira/browse/KAFKA-14972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Erik van Oosten resolved KAFKA-14972.
-
Resolution: Won't Fix
> Make KafkaConsumer usable in async
Erik van Oosten created KAFKA-14972:
---
Summary: Make KafkaConsumer usable in async runtimes
Key: KAFKA-14972
URL: https://issues.apache.org/jira/browse/KAFKA-14972
Project: Kafka
Issue Type
[
https://issues.apache.org/jira/browse/KAFKA-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194883#comment-14194883
]
Erik van Oosten commented on KAFKA-960:
---
Fixing the issue where Mbean names
[
https://issues.apache.org/jira/browse/KAFKA-960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14194990#comment-14194990
]
Erik van Oosten commented on KAFKA-960:
---
If 2.20 and 2.1.5 are indeed bi
36 matches
Mail list logo