Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1801

2023-04-26 Thread Apache Jenkins Server
See

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

2023-04-26 Thread Luke Chen
Hi Colin, Some comments: 1. I agree we should set "top-level" errors for metadata response 2. In the "brokers" field of metadata response from controller, it'll respond with "Controller endpoint information as given in controller.quorum.voters", instead of the "alive" controllers(voters). That

[jira] [Resolved] (KAFKA-14944) Reduce CompletedFetch#parseRecord() memory copy

2023-04-26 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14944. --- Fix Version/s: 3.6.0 Resolution: Fixed > Reduce CompletedFetch#parseRecord() memory copy >

[jira] [Reopened] (KAFKA-14945) Add Serializer#serializeToByteBuffer() to reduce memory copying

2023-04-26 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen reopened KAFKA-14945: --- > Add Serializer#serializeToByteBuffer() to reduce memory copying >

[jira] [Resolved] (KAFKA-14945) Add Serializer#serializeToByteBuffer() to reduce memory copying

2023-04-26 Thread Luke Chen (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Chen resolved KAFKA-14945. --- Fix Version/s: 3.6.0 Resolution: Fixed > Add Serializer#serializeToByteBuffer() to reduce

[jira] [Created] (KAFKA-14945) Add Serializer#serializeToByteBuffer() to reduce memory copying

2023-04-26 Thread LinShunkang (Jira)
LinShunkang created KAFKA-14945: --- Summary: Add Serializer#serializeToByteBuffer() to reduce memory copying Key: KAFKA-14945 URL: https://issues.apache.org/jira/browse/KAFKA-14945 Project: Kafka

[jira] [Created] (KAFKA-14944) Reduce CompletedFetch#parseRecord() memory copy

2023-04-26 Thread LinShunkang (Jira)
LinShunkang created KAFKA-14944: --- Summary: Reduce CompletedFetch#parseRecord() memory copy Key: KAFKA-14944 URL: https://issues.apache.org/jira/browse/KAFKA-14944 Project: Kafka Issue Type:

Re: KIP-919: Allow AdminClient to Talk Directly with the KRaft Controller Quorum

2023-04-26 Thread Colin McCabe
On Tue, Apr 25, 2023, at 04:59, Divij Vaidya wrote: > Thank you for the KIP Colin. > > In general, I like the idea of having the ability to interact directly with > the controllers. I agree with your observation that it helps in situations > where you would want to get data directly from the

[jira] [Created] (KAFKA-14943) Fix ClientQuotaControlManager validation

2023-04-26 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-14943: Summary: Fix ClientQuotaControlManager validation Key: KAFKA-14943 URL: https://issues.apache.org/jira/browse/KAFKA-14943 Project: Kafka Issue Type: Bug

[jira] [Created] (KAFKA-14942) CopyOnWriteMap implements ConcurrentMap but does not implement required default methods

2023-04-26 Thread Steven Schlansker (Jira)
Steven Schlansker created KAFKA-14942: - Summary: CopyOnWriteMap implements ConcurrentMap but does not implement required default methods Key: KAFKA-14942 URL: https://issues.apache.org/jira/browse/KAFKA-14942

[jira] [Created] (KAFKA-14941) Document which configuration options are applicable only to processes with broker role or controller role

2023-04-26 Thread Jakub Scholz (Jira)
Jakub Scholz created KAFKA-14941: Summary: Document which configuration options are applicable only to processes with broker role or controller role Key: KAFKA-14941 URL:

Re: Test failures

2023-04-26 Thread Ismael Juma
Thanks! Ismael On Wed, Apr 26, 2023, 9:12 AM Sagar wrote: > Hi, > > FYI the pr which fixes the flaky test for connect is merged to trunk > > Sagar. > > On Wed, 26 Apr 2023 at 2:45 AM, Manyanda Chitimbo < > manyanda.chiti...@gmail.com> wrote: > > > HI Ismail, > > > > There is a PR to fix the

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1800

2023-04-26 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-14940) Refactor ApiMessageAndVersion/Record

2023-04-26 Thread David Jacot (Jira)
David Jacot created KAFKA-14940: --- Summary: Refactor ApiMessageAndVersion/Record Key: KAFKA-14940 URL: https://issues.apache.org/jira/browse/KAFKA-14940 Project: Kafka Issue Type: Sub-task

Re: Test failures

2023-04-26 Thread Sagar
Hi, FYI the pr which fixes the flaky test for connect is merged to trunk Sagar. On Wed, 26 Apr 2023 at 2:45 AM, Manyanda Chitimbo < manyanda.chiti...@gmail.com> wrote: > HI Ismail, > > There is a PR to fix the failure in > https://github.com/apache/kafka/pull/13634 > > On Tue, Apr 25, 2023 at

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread Bruno Cadonna
Thanks a lot, Luke! +1 Best, Bruno On 26.04.23 16:11, Bill Bejeck wrote: Thanks for volunteering! +1 On Wed, Apr 26, 2023 at 8:33 AM Mickael Maison wrote: Thanks Luke +1 On Wed, Apr 26, 2023 at 2:12 PM Chia-Ping Tsai wrote: +1 to Luke! David Jacot 於 2023年4月26日 下午6:44 寫道: +1

Re: [DISCUSS] KIP-921 OpenJDK CRaC support

2023-04-26 Thread Mickael Maison
Hi Radim, Thanks for the KIP! CRaC is an interesting project and it could be a useful feature in Kafka clients. The KIP is pretty vague in terms of the expected behavior of clients when checkpointing and restoring. For example: 1. A consumer may have pre-fetched records in memory. When it is

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread Ismael Juma
+1 Thanks for volunteering! Ismael On Wed, Apr 26, 2023 at 3:37 AM Luke Chen wrote: > Hi all, > > I'd like to volunteer as release manager for the Apache > Kafka 3.4.1 release. > If there are no objections, I'll start building a release plan in the > wiki in the next couple of days. > > Thank

[jira] [Created] (KAFKA-14939) Only expose ZkMigrationState metric if metadata.version supports it

2023-04-26 Thread David Arthur (Jira)
David Arthur created KAFKA-14939: Summary: Only expose ZkMigrationState metric if metadata.version supports it Key: KAFKA-14939 URL: https://issues.apache.org/jira/browse/KAFKA-14939 Project: Kafka

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread Bill Bejeck
Thanks for volunteering! +1 On Wed, Apr 26, 2023 at 8:33 AM Mickael Maison wrote: > Thanks Luke > +1 > > On Wed, Apr 26, 2023 at 2:12 PM Chia-Ping Tsai wrote: > > > > +1 to Luke! > > > > > David Jacot 於 2023年4月26日 下午6:44 寫道: > > > > > > +1 Thanks, Luke! > > > > > >> Le mer. 26 avr. 2023 à

Re: [DISCUSS] KIP-858: Handle JBOD broker disk failure in KRaft

2023-04-26 Thread Igor Soarez
Thank you for another review Ziming, much appreciated! 1. and 2. You are correct, it would be a big and perhaps strange difference. Since our last exchange of emails, the proposal has changed and now it does follow your suggestion to bump metadata.version. The KIP mentions it under

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread Mickael Maison
Thanks Luke +1 On Wed, Apr 26, 2023 at 2:12 PM Chia-Ping Tsai wrote: > > +1 to Luke! > > > David Jacot 於 2023年4月26日 下午6:44 寫道: > > > > +1 Thanks, Luke! > > > >> Le mer. 26 avr. 2023 à 12:37, Luke Chen a écrit : > >> > >> Hi all, > >> > >> I'd like to volunteer as release manager for the

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread Chia-Ping Tsai
+1 to Luke! > David Jacot 於 2023年4月26日 下午6:44 寫道: > > +1 Thanks, Luke! > >> Le mer. 26 avr. 2023 à 12:37, Luke Chen a écrit : >> >> Hi all, >> >> I'd like to volunteer as release manager for the Apache >> Kafka 3.4.1 release. >> If there are no objections, I'll start building a release

[jira] [Created] (KAFKA-14938) Flaky test org.apache.kafka.connect.integration.ExactlyOnceSourceIntegrationTest#testConnectorBoundary

2023-04-26 Thread Sagar Rao (Jira)
Sagar Rao created KAFKA-14938: - Summary: Flaky test org.apache.kafka.connect.integration.ExactlyOnceSourceIntegrationTest#testConnectorBoundary Key: KAFKA-14938 URL: https://issues.apache.org/jira/browse/KAFKA-14938

Re: [DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread David Jacot
+1 Thanks, Luke! Le mer. 26 avr. 2023 à 12:37, Luke Chen a écrit : > Hi all, > > I'd like to volunteer as release manager for the Apache > Kafka 3.4.1 release. > If there are no objections, I'll start building a release plan in the > wiki in the next couple of days. > > Thank you. > Luke >

[DISCUSS] Apache Kafka 3.4.1 release

2023-04-26 Thread Luke Chen
Hi all, I'd like to volunteer as release manager for the Apache Kafka 3.4.1 release. If there are no objections, I'll start building a release plan in the wiki in the next couple of days. Thank you. Luke

Consumer offset value -Apache kafka 3.2.3

2023-04-26 Thread Kafka Life
Dear Kafka Experts How can we check for a particular offset number in Apache kafka 3.2.3 version.Could you please share some light. The kafka_console_consumer tool is throwing class not found error. ./kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --topic your-topic --group

Re: Consumer Lag Metrics/ Topic level metrics

2023-04-26 Thread Kafka Life
Many thanks Samuel. Will go thru this. On Tue, Apr 25, 2023 at 9:03 PM Samuel Delepiere < samuel.delepi...@celer-tech.com> wrote: > Hi, > > I use a combination of the Prometheus JMX exporter ( > https://github.com/prometheus/jmx_exporter) and the Prometheus Kafka > exporter

Re: [DISCUSS] KIP-921 OpenJDK CRaC support

2023-04-26 Thread Radim Vansa
Hi all, I haven't seen much reactions on this proposal. Is there any general policy regarding dependencies, or a prior decision that would hint on this? Thanks! Radim On 21. 04. 23 10:10, Radim Vansa wrote: Caution: This email originated from outside of the organization. Do not click