[GitHub] [kafka-site] VikasGite opened a new pull request, #462: Dream11 powered by Apache Kafka section added

2022-11-29 Thread GitBox
VikasGite opened a new pull request, #462: URL: https://github.com/apache/kafka-site/pull/462 Hello Team, Please review changes made to powered-by page. Have added Dream11 section in it. -- This is an automated message from the Apache Git Service. To respond to the message, please

Jenkins build is unstable: Kafka » Kafka Branch Builder » 3.3 #128

2022-11-29 Thread Apache Jenkins Server
See

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1386

2022-11-29 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-11-29 Thread Luke Chen
Thanks for the reply. Yes, I think adding a section in Rejected Alternatives to explain the rationale why we don't support combined mode upgrade in this KIP is helpful. Thank you. Luke On Wed, Nov 30, 2022 at 8:47 AM Jun Rao wrote: > Hi, David, > > Thanks for the reply. No other comments from

Re: [VOTE] KIP-866 ZooKeeper to KRaft Migration

2022-11-29 Thread Jun Rao
Hi, David, Thanks for the KIP. +1 Jun On Tue, Nov 22, 2022 at 3:43 PM Jason Gustafson wrote: > Thanks, +1 from me. I suspect we might be in for at least one surprise with > the re-implemented controller RPCs, but I agree the alternative has risks > as well. > > Best, > Jason > > On Mon, Nov

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-11-29 Thread Jun Rao
Hi, David, Thanks for the reply. No other comments from me. Jun On Tue, Nov 29, 2022 at 2:57 PM David Arthur wrote: > Jun, > > 51. You're right, I missed that in the latest update. It's fixed now. > > 54. I was thinking we could update meta.properties to v1 as the brokers > were being

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1385

2022-11-29 Thread Apache Jenkins Server
See Changes: -- [...truncated 514987 lines...] [2022-11-30T00:46:28.342Z] > Task :connect:api:testJar [2022-11-30T00:46:28.342Z] > Task :connect:api:testSrcJar

[jira] [Created] (KAFKA-14424) Cancellation of an ongoing replica reassignment should have sanity checks

2022-11-29 Thread Lucas Wang (Jira)
Lucas Wang created KAFKA-14424: -- Summary: Cancellation of an ongoing replica reassignment should have sanity checks Key: KAFKA-14424 URL: https://issues.apache.org/jira/browse/KAFKA-14424 Project: Kafka

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-11-29 Thread David Arthur
Jun, 51. You're right, I missed that in the latest update. It's fixed now. 54. I was thinking we could update meta.properties to v1 as the brokers were being restarted in KRaft mode without the migration config set. However, as you mentioned, it is still possible to downgrade even then (as long

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1384

2022-11-29 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-11-29 Thread Jun Rao
Hi, David, Thanks for the reply. 51. Is this reflected in the KIP? It seems that ZkMigrationState still has the None value. 54. Supporting both v0 and v1 indefinitely in a KRaft broker could be a bit confusing and may complicate future upgrades. Another approach is to let KRaft broker write the

Re: [DISCUSS] KIP-883: Add delete callback method to Connector API

2022-11-29 Thread Chris Egerton
Hi Hector, Thanks for the KIP! Here are my initial thoughts: 1. I like the simplicity of an overloaded stop method, but there is some asymmetry between stopping a connector and deleting one. If a connector is stopped (for rebalance, to be reconfigured, etc.) and a failure occurs then, the

Re: [DISCUSS] KIP-877: Mechanism for plugins and connectors to register metrics

2022-11-29 Thread Chris Egerton
Hi Mickael, Thanks for the KIP! This seems especially useful to reduce the implementation cost and divergence in behavior for connectors that choose to publish their own metrics. My initial thoughts: 1. Are you certain that the default implementation of the "metrics" method for the various

Re: [DISCUSS] KIP-890 Server Side Defense

2022-11-29 Thread Justine Olshan
Hi Artem and Jeff, Thanks for taking a look and sorry for the slow response. You both mentioned the change to handle UNKNOWN_PRODUCER_ID errors. To be clear — this error code will only be sent again when the client's request version is high enough to ensure we handle it correctly. The current

Re: [DISCUSS] KIP-864: Add End-To-End Latency Metrics to Connectors

2022-11-29 Thread Chris Egerton
Hi Jorge, Thanks! What were your thoughts on the possible benchmarking and/or downgrading of per-record metrics to DEBUG? Cheers, Chris On Thu, Nov 24, 2022 at 8:20 AM Jorge Esteban Quilcate Otoya < quilcate.jo...@gmail.com> wrote: > Thanks Chris! I have updated the KIP with "transform"

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1383

2022-11-29 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-866 ZooKeeper to KRaft Migration

2022-11-29 Thread David Arthur
Jun, Thanks for the comments. Igor, please see 54 below for some additional discussion on the meta.properties 50.1 Yes, that field name sounds fine to me. 50.2 Ok, I'll add something to the KIP under the Controller section. To your other question, NoOpRecords are used as part of our liveness

Re: [DISCUSS] KIP-879: Multi-level Rack Awareness

2022-11-29 Thread Viktor Somogyi-Vass
Hi All, I'd like to bump this. I've also updated the KIP to incorporate the new KRaft changes (ReplicaPlacer). Luckily my proposals were quite similar to that, so mostly I've made some minor rewording, naming changes, etc. Again, the brief summary of the KIP: - expose replica placement

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.3 #127

2022-11-29 Thread Apache Jenkins Server
See Changes: -- [...truncated 500809 lines...] [2022-11-29T11:46:43.010Z] [2022-11-29T11:46:43.010Z] org.apache.kafka.streams.integration.TimeWindowedKStreamIntegrationTest

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #1382

2022-11-29 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-889 Versioned State Stores

2022-11-29 Thread Bruno Cadonna
Hi Victoria, Regarding >I notice that > there is code for validating topic configs and collecting validation errors > ( >