Re: [DISCUSS] KIP-429 : Smooth Auto-Scaling for Kafka Streams

Cool, will update the page. On Wed, May 22, 2019 at 9:38 PM Matthias J. Sax wrote: > SGTM. > > I think we should still document the behavior on the KIP and explain why > it's implemented that way. > > > -Matthias > > On 5/22/19 7:04 PM, Guozhang Wang wrote: > > Hello Matthias, > > > > I've

Build failed in Jenkins: kafka-trunk-jdk8 #3668

See Changes: [github] MINOR: Remove ControllerEventManager metrics on close (#6788) -- [...truncated 4.92 MB...] org.apache.kafka.trogdor.agent.AgentTest >

Re: [DISCUSS] KIP-429 : Smooth Auto-Scaling for Kafka Streams

SGTM. I think we should still document the behavior on the KIP and explain why it's implemented that way. -Matthias On 5/22/19 7:04 PM, Guozhang Wang wrote: > Hello Matthias, > > I've thought about that before, and the reason I did not include this as > part of the KIP-429 scope is that

Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol

+1 (binding) On 5/22/19 7:37 PM, Harsha wrote: > +1 (binding). Thanks for the KIP looking forward for this to be avaiable in > consumers. > > Thanks, > Harsha > > On Wed, May 22, 2019, at 12:24 AM, Liquan Pei wrote: >> +1 (non-binding) >> >> On Tue, May 21, 2019 at 11:34 PM Boyang Chen

Re: Kafka Streams Library for Go

Hi Jay, I'm not aware of a Go implementation of Kafka Streams in Apache Kafka. If anyone here knows something I don't, feel free to correct me. goka (https://github.com/lovoo/goka), while not part of Apache Kafka, seems to be pretty popular. You may also want to check out KSQL which, although

Re: [VOTE] 2.2.1 RC1

Bumping this thread to get some more votes, especially from committers, so we can hopefully make a decision on this RC by the end of the week. Thanks, --Vahid On Mon, May 13, 2019 at 8:15 PM Vahid Hashemian wrote: > Hello Kafka users, developers and client-developers, > > This is the second

Kafka Streams Library for Go

Do you have an estimate of when there will be a Kafka Streams library for Go? Thank you! Jay

Build failed in Jenkins: kafka-trunk-jdk11 #563

See Changes: [github] MINOR: Remove ControllerEventManager metrics on close (#6788) -- [...truncated 2.51 MB...] org.apache.kafka.connect.json.JsonConverterTest >

Build failed in Jenkins: kafka-2.3-jdk8 #8

See Changes: [wangguoz] KAFKA-8399: bring back internal.leave.group.on.close config for KStream -- [...truncated 2.83 MB...] kafka.log.ProducerStateManagerTest >

Build failed in Jenkins: kafka-trunk-jdk11 #562

See -- [...truncated 2.47 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldProcessRecordForTopic[Eos enabled = true] PASSED

[jira] [Resolved] (KAFKA-8389) Duplicated MockProcessorSupplier / MockProcessor in TopologyTestDriverTest

[ https://issues.apache.org/jira/browse/KAFKA-8389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-8389. -- Resolution: Won't Fix > Duplicated MockProcessorSupplier / MockProcessor in

[jira] [Created] (KAFKA-8410) Strengthen the types of Processors, at least in the DSL, maybe in the PAPI as well

John Roesler created KAFKA-8410: --- Summary: Strengthen the types of Processors, at least in the DSL, maybe in the PAPI as well Key: KAFKA-8410 URL: https://issues.apache.org/jira/browse/KAFKA-8410

Build failed in Jenkins: kafka-trunk-jdk11 #561

See Changes: [bbejeck] KAFKA-8399: bring back internal.leave.group.on.close config for KStream -- [...truncated 2.44 MB...] org.apache.kafka.connect.data.ValuesTest >

Build failed in Jenkins: kafka-2.3-jdk8 #7

See Changes: [manikumar] MINOR: Use `jps` cmd to find out the pid of TransactionalMessageCopier -- [...truncated 2.86 MB...] kafka.controller.ControllerChannelManagerTest >

[jira] [Created] (KAFKA-8409) Seperate controller thread/manager events from controller events

Jose Armando Garcia Sancio created KAFKA-8409: - Summary: Seperate controller thread/manager events from controller events Key: KAFKA-8409 URL: https://issues.apache.org/jira/browse/KAFKA-8409

Build failed in Jenkins: kafka-trunk-jdk8 #3667

See Changes: [bbejeck] KAFKA-8399: bring back internal.leave.group.on.close config for KStream -- [...truncated 2.45 MB...] > Task

[jira] [Created] (KAFKA-8408) Create one request purgator for all the controller requests

Jose Armando Garcia Sancio created KAFKA-8408: - Summary: Create one request purgator for all the controller requests Key: KAFKA-8408 URL: https://issues.apache.org/jira/browse/KAFKA-8408

Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol

+1 (binding). Thanks for the KIP looking forward for this to be avaiable in consumers. Thanks, Harsha On Wed, May 22, 2019, at 12:24 AM, Liquan Pei wrote: > +1 (non-binding) > > On Tue, May 21, 2019 at 11:34 PM Boyang Chen wrote: > > > Thank you Guozhang for all the hard work. > > > > +1

Build failed in Jenkins: kafka-trunk-jdk11 #560

See Changes: [manikumar] MINOR: Use `jps` cmd to find out the pid of TransactionalMessageCopier -- [...truncated 2.48 MB...]

Re: [VOTE] KIP-455: Create an Administrative API for Replica Reassignment

Hi George, Thanks for taking a look. I am working on getting a PR done as a proof-of-concept. I'll post it soon. Then we'll finish up the vote. best, Colin On Tue, May 21, 2019, at 17:33, George Li wrote: > Hi Colin,   > >  Great! Looking forward to these features.    +1 (non-binding) >

Re: [DISCUSS] KIP-429 : Smooth Auto-Scaling for Kafka Streams

Hello Matthias, I've thought about that before, and the reason I did not include this as part of the KIP-429 scope is that fetcher / coordinator may get quite complicated to return non-empty data if "updateAssignmentMetadataIfNeeded" returns false in KafkaConsumer. In addition, when there's a

Build failed in Jenkins: kafka-trunk-jdk8 #3666

See Changes: [manikumar] MINOR: Use `jps` cmd to find out the pid of TransactionalMessageCopier -- [...truncated 2.46 MB...]

[jira] [Created] (KAFKA-8407) Connector client overrides broken on client configs with type 'Class'

Chris Egerton created KAFKA-8407: Summary: Connector client overrides broken on client configs with type 'Class' Key: KAFKA-8407 URL: https://issues.apache.org/jira/browse/KAFKA-8407 Project: Kafka

Re: Unable to download apache kafka.

If this is still a problem, try contacting the Apache Infrastructure mailing list at us...@infra.apache.org. best, Colin On Sat, May 18, 2019, at 01:40, Arpan Roy wrote: > Hi, > > I'm unable to download apache kafka from https://kafka.apache.org/downloads. > The response I'm getting is timed

RE: Backup and Restore of kafka broker with zookeeper

Hi , Thanks for the reply. Is there a way to check when the zookeeper cluster has become stable. We are running in kubernetes cluster and kafka nodes are connected to zookeeper via service. The condition we are using to check if the zookeeper pod is up is "imok" = "$(echo ruok | nc -w 1

[jira] [Resolved] (KAFKA-8399) Add back `internal.leave.group.on.close` config for KStreams

[ https://issues.apache.org/jira/browse/KAFKA-8399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bill Bejeck resolved KAFKA-8399. Resolution: Fixed > Add back `internal.leave.group.on.close` config for KStreams >

Build failed in Jenkins: kafka-2.3-jdk8 #6

See Changes: [jason] MINOR: Set `replicaId` for OffsetsForLeaderEpoch from followers (#6775) [jason] HOTFIX: Fix recent protocol breakage from KIP-345 and KIP-392 (#6780) --

Re: [DISCUSS] KIP-429 : Smooth Auto-Scaling for Kafka Streams

Thanks to the KIP and starting the VOTE Guozhang. I am overall +1. One follow up thought: the KIP does not discuss in details, how `poll()` will behave after the change. It might actually be important to ensure that `poll()` behavior changes to be non-blocking to allow an application to process

Re: Backup and Restore of kafka broker with zookeeper

You have to get a consistent zookeeper cluster before adding your Kafka nodes - they will "mirror" the state in zookeeper. So restore all the files before starting anything. Then start zookeepers and wait for for it to stabilize. Finally start Kafka nodes. - ( with the data in place of course.)

Build failed in Jenkins: kafka-2.3-jdk8 #5

See Changes: [rhauch] KAFKA-8265: Fix override config name to match KIP-458. (#6776) [rhauch] KAFKA-8265: Fix config name to match KIP-458. (#6755) -- [...truncated 2.86

Build failed in Jenkins: kafka-trunk-jdk8 #3665

See Changes: [github] HOTFIX: Fix recent protocol breakage from KIP-345 and KIP-392 (#6780) -- [...truncated 2.50 MB...] kafka.zk.KafkaZkClientTest >

[jira] [Created] (KAFKA-8406) kafka-topics throws wrong error on invalid configuration with bootstrap-server and alter config

Stanislav Kozlovski created KAFKA-8406: -- Summary: kafka-topics throws wrong error on invalid configuration with bootstrap-server and alter config Key: KAFKA-8406 URL:

Build failed in Jenkins: kafka-trunk-jdk11 #559

See Changes: [github] HOTFIX: Fix recent protocol breakage from KIP-345 and KIP-392 (#6780) -- [...truncated 2.50 MB...] org.apache.kafka.connect.json.JsonConverterTest >

Backup and Restore of kafka broker with zookeeper

Hi All, We are trying to do a backup of kafka + zookeeper data and restore the same back for one of our application's use case. We are taking below steps for the same, 1. Take folder contents back up of data and log directories for kafka and zookeeper. 2. Delete the kafka zookeepers and

Re: Unable to build project in intelliji

Apache Kafka uses Gradle as build tool so: First create gradle wrapper using instructions here : https://github.com/apache/kafka#first-bootstrap-and-download-the-wrapper And then execute "gradlew idea" as mentioned here : https://github.com/apache/kafka#building-ide-project On Wed, May 22, 2019

Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol

+1 (non-binding) On Tue, May 21, 2019 at 11:34 PM Boyang Chen wrote: > Thank you Guozhang for all the hard work. > > +1 (non-binding) > > > From: Guozhang Wang > Sent: Wednesday, May 22, 2019 1:32 AM > To: dev > Subject: [VOTE] KIP-429: Kafka Consumer

Unable to build project in intelliji

Hi, I am unable to build project in intelliji with the following exception :- Could not find method annotationProcessor() for arguments [org.openjdk.jmh:jmh-generator-annprocess:1.21] on object of type org.gradle.api.internal.artifacts.dsl.dependencies.DefaultDependencyHandler. Branch which I am

Re: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol

Thank you Guozhang for all the hard work. +1 (non-binding) From: Guozhang Wang Sent: Wednesday, May 22, 2019 1:32 AM To: dev Subject: [VOTE] KIP-429: Kafka Consumer Incremental Rebalance Protocol Hello folks, I'd like to start the voting for KIP-429 now,