Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1185

See

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Hi José , I found a potential regression in the new Sticky Partitioner logic, details are here https://issues.apache.org/jira/browse/KAFKA-14156. I've added a draft PR, will add unit tests soon. I think we should include the fix into 3.3.0. -Artem On Mon, Aug 29, 2022 at 1:17 PM Colin McCabe

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

Hi, I am favour of discarding the sugar for broadcasting and leave the broadcasting to the implementation as Chris suggests. I think that is the cleanest option. Best, Bruno On 29.08.22 19:50, Chris Egerton wrote: Hi all, I think it'd be useful to be more explicit about broadcasting to

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

Thanks Bruno/Chris, Even I agree that might be better to keep it simple like the way Chris suggested. I have updated the KIP accordingly. I made couple of minor changes to the KIP: 1) One of them being the change of return type of partitions method from List to Set. This is to ensure that in

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1186

See Changes: -- [...truncated 425040 lines...] [2022-08-30T09:47:02.320Z] > Task :connect:json:generateMetadataFileForMavenJavaPublication [2022-08-30T09:47:02.320Z] >

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1188

See Changes: -- [...truncated 504599 lines...] [2022-08-30T20:14:55.068Z] [2022-08-30T20:14:55.068Z] StreamsAssignmentScaleTest >

[jira] [Resolved] (KAFKA-14187) kafka-features.sh: add support for --metadata

[ https://issues.apache.org/jira/browse/KAFKA-14187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-14187. -- Resolution: Fixed > kafka-features.sh: add support for --metadata >

[jira] [Resolved] (KAFKA-14170) KRaft Controller: Possible NPE when we remove topics with any offline partitions in the cluster

[ https://issues.apache.org/jira/browse/KAFKA-14170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akhilesh Chaganti resolved KAFKA-14170. --- Resolution: Fixed > KRaft Controller: Possible NPE when we remove topics with any

Database Performnce

Hello, I am working on a Project that uses Kafka's JDBC Connector to consume messages from an IBM Business Process Manager (BPM) Oracle Database and I am concerned about whether the Kafka consumption affects the source database's performance and if so can you elaborate more what is its

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

Hi Sagar, Thank you for the updates! I do not intend to prolong this vote thread more than needed, but I still have some points. The deprecated partition method can return null if the default partitioning logic of the producer should be used. With the new method partitions() it seems that

Database Performance

Hello, I am working on a Project that uses Kafka's JDBC Connector to consume messages from an IBM Business Process Manager (BPM) Oracle Database and I am concerned about whether the Kafka consumption affects the source database's performance and if so can you elaborate more what is its effect

[jira] [Created] (KAFKA-14189) reuse connection of coordinator and leader in KafkaConsumer

Junyang Liu created KAFKA-14189: --- Summary: reuse connection of coordinator and leader in KafkaConsumer Key: KAFKA-14189 URL: https://issues.apache.org/jira/browse/KAFKA-14189 Project: Kafka

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1187

See Changes: -- [...truncated 504490 lines...] [2022-08-30T12:17:12.862Z] [INFO] --- maven-resources-plugin:2.6:resources (default-resources) @ streams.examples ---

Re: [VOTE] KIP-837 Allow MultiCasting a Result Record.

+1 to Bruno's concerns about backward compatibility. Do we actually need support for dropping records in the partitioner? It doesn't seem necessary based on the motivation for the KIP. If we remove that feature, we could handle null and/or empty lists by using the default partitioning, equivalent

[jira] [Created] (KAFKA-14190) Corruption of Topic IDs with pre-2.8.0 admin clients

Alexandre Dupriez created KAFKA-14190: - Summary: Corruption of Topic IDs with pre-2.8.0 admin clients Key: KAFKA-14190 URL: https://issues.apache.org/jira/browse/KAFKA-14190 Project: Kafka

[jira] [Created] (KAFKA-14191) Add end-to-end latency metrics to Connectors

Jorge Esteban Quilcate Otoya created KAFKA-14191: Summary: Add end-to-end latency metrics to Connectors Key: KAFKA-14191 URL: https://issues.apache.org/jira/browse/KAFKA-14191 Project:

Re: [DISCUSS] KIP-862: Implement self-join optimization

Hi Guozhang, That's an excellent idea, I will make the changes. I was also going back and forth with having a specific config for each optimization or not but I feel your approach has the best of both worlds. Thank you, Vicky On Sun, Aug 28, 2022 at 6:20 AM Guozhang Wang wrote: > Hello Vicky,

Re: [DISCUSS] KIP-703: Add a metrics for reporting idle connections closed

Hi Pere, Thanks for the KIP. I think this would be a useful addition. Best, -- Igor On Thu, Jan 14, 2021, at 12:11 PM, Rajini Sivaram wrote: > Hi Pere, > > Thanks for the KIP, it is a useful metric. Btw, in the `Public Interfaces` > section, can we just document the metric names since the

[DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

Hi all, I'd like to start a discussion thread on KIP-864: Add End-To-End Latency Metrics to Connectors. This KIP aims to improve the metrics available on Source and Sink Connectors to measure end-to-end latency, including source and sink record conversion time, and sink record e2e latency

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1189

See Changes: -- [...truncated 505021 lines...] [2022-08-31T02:29:51.040Z] [2022-08-31T02:29:51.040Z] StreamsAssignmentScaleTest >

Re: [DISCUSS] Apache Kafka 3.3.0 Release

Thanks Artem and Colin for identifying and fixing the issues KAFKA-14156 and KAFKA-14187. I have marked both of them as blocker for this release. I also don't think that these issues should block testing other parts of the release. Thanks José