[jira] [Created] (KAFKA-8050) remove KafkaMbean when network close

limeng created KAFKA-8050: - Summary: remove KafkaMbean when network close Key: KAFKA-8050 URL: https://issues.apache.org/jira/browse/KAFKA-8050 Project: Kafka Issue Type: Bug Components:

[jira] [Created] (KAFKA-8051) remove KafkaMbean when network close

limeng created KAFKA-8051: - Summary: remove KafkaMbean when network close Key: KAFKA-8051 URL: https://issues.apache.org/jira/browse/KAFKA-8051 Project: Kafka Issue Type: Bug Components:

[jira] [Created] (KAFKA-8049) remove KafkaMbean when network close

limeng created KAFKA-8049: - Summary: remove KafkaMbean when network close Key: KAFKA-8049 URL: https://issues.apache.org/jira/browse/KAFKA-8049 Project: Kafka Issue Type: Bug Components:

[jira] [Created] (KAFKA-8048) remove KafkaMbean when network close

limeng created KAFKA-8048: - Summary: remove KafkaMbean when network close Key: KAFKA-8048 URL: https://issues.apache.org/jira/browse/KAFKA-8048 Project: Kafka Issue Type: Bug Components:

[jira] [Created] (KAFKA-8047) remove KafkaMbean when network close

limeng created KAFKA-8047: - Summary: remove KafkaMbean when network close Key: KAFKA-8047 URL: https://issues.apache.org/jira/browse/KAFKA-8047 Project: Kafka Issue Type: Bug Components:

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

Hi Viktor, >  2.: One follow-up question: if the reassignment cancellation gets >interrupted and a failover happens after step #2 but before step #3, how will >the new controller continue? At this stage Zookeeper would contain OAR + RAR, >however the brokers will have the updated

Build failed in Jenkins: kafka-2.2-jdk8 #44

See Changes: [jason] MINOR: Log exception thrown by consumer.poll() in VerifiableConsumer -- [...truncated 2.69 MB...] kafka.controller.PartitionStateMachineTest >

[jira] [Created] (KAFKA-8046) Shutdown broker because all log dirs in /tmp/kafka-logs have failed

jaren created KAFKA-8046: Summary: Shutdown broker because all log dirs in /tmp/kafka-logs have failed Key: KAFKA-8046 URL: https://issues.apache.org/jira/browse/KAFKA-8046 Project: Kafka Issue

[jira] [Created] (KAFKA-8045) Possible Flaky Test LogOffsetTest.testGetOffsetsBeforeNow

Bill Bejeck created KAFKA-8045: -- Summary: Possible Flaky Test LogOffsetTest.testGetOffsetsBeforeNow Key: KAFKA-8045 URL: https://issues.apache.org/jira/browse/KAFKA-8045 Project: Kafka Issue

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

>> I dont know how to range scan over a caching store, probably one had >> to open 2 iterators and merge them. That happens automatically. If you query a cached KTable, it ranges over the cache and the underlying RocksDB and performs the merging under the hood. >> Other than that, I still think

Re: Fluent Kafka Streams Test + Schema Registry Mock

Hello Arvid, Thanks for sharing! I've read your two blog posts and also the code repo and they are really interesting. Your observation is right that since schema registry is under Confluent schema registry the integration may not be contributed to AK. On the other hand, I think having this as

Re: [VOTE] 2.2.0 RC1

+1 I checked signatures, built from source and ran through quickstart It's probably worth mentioning KIP-377 in the short release summary as in many cloud environments access to zookeeper is disabled so many users will benefit from it. Also "- Added SSL support for custom principle name" -> "-

[jira] [Created] (KAFKA-8044) System Test Failure: ReassignPartitionsTest.test_reassign_partitions

Manikumar created KAFKA-8044: Summary: System Test Failure: ReassignPartitionsTest.test_reassign_partitions Key: KAFKA-8044 URL: https://issues.apache.org/jira/browse/KAFKA-8044 Project: Kafka

Re: [DISCUSS] KIP-415: Incremental Cooperative Rebalancing in Kafka Connect

Hi Guozhang, thanks for your detailed comments! I thought it'd be a good idea to have some code supporting my replies. The PR for KIP-415 was opened this week. It needs some cleanup but I think it can give some good hints on the things you've touched upon so far. I'm answering to your four

[jira] [Resolved] (KAFKA-8043) Host

[ https://issues.apache.org/jira/browse/KAFKA-8043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bolke de Bruin resolved KAFKA-8043. --- Resolution: Incomplete > Host > > > Key: KAFKA-8043 >

[jira] [Created] (KAFKA-8043) Host

Bolke de Bruin created KAFKA-8043: - Summary: Host Key: KAFKA-8043 URL: https://issues.apache.org/jira/browse/KAFKA-8043 Project: Kafka Issue Type: Bug Reporter: Bolke de Bruin

Re: [VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

Hey Kevin, Thanks for the KIP! +1 (binding) Thanks, Dong On Tue, Mar 5, 2019 at 9:38 AM Kevin Lu wrote: > Hi All, > > I would like to start the vote thread for KIP-427: Add AtMinIsr topic > partition category (new metric & TopicCommand option). > >

[jira] [Created] (KAFKA-8042) Kafka Streams creates many segment stores on state restore

Adrian McCague created KAFKA-8042: - Summary: Kafka Streams creates many segment stores on state restore Key: KAFKA-8042 URL: https://issues.apache.org/jira/browse/KAFKA-8042 Project: Kafka

[DISCUSS] KIP-438: Expose task, connector IDs in Connect API

Hey y'all, please consider the following small KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-438%3A+Expose+task%2C+connector+IDs+in+Connect+API Thanks! Ryanne

[VOTE] KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option)

Hi All, I would like to start the vote thread for KIP-427: Add AtMinIsr topic partition category (new metric & TopicCommand option). https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=103089398 Thanks! Regards, Kevin

Fluent Kafka Streams Test + Schema Registry Mock

Dear Kafka devs, we recently published a fluent kafka streams test library. https://github.com/bakdata/fluent-kafka-streams-tests https://medium.com/bakdata/fluent-kafka-streams-tests-e641785171ec We wanted to ask if there is any interest in us contributing the rather small wrapper around the

Fluent Kafka Streams Test + Schema Registry Mock

Dear Kafka devs, we recently published a fluent kafka streams test library. https://github.com/bakdata/fluent-kafka-streams-tests https://medium.com/bakdata/fluent-kafka-streams-tests-e641785171ec We wanted to ask if there is any interest in us contributing the rather small wrapper around the

Re: [DISCUSS] KIP-236 Interruptible Partition Reassignment

Hey George, Sorry for the delay. I'll answer point-by-point: 1.2: I think it's fine. As you say we presume that the client knows the state of the cluster before doing the reassignment, so we can presume the same for cancellation. 2.: One follow-up question: if the reassignment cancellation gets

Re: Apache Kafka Memory Leakage???

My questions about input parameters are mostly targeted at finding out whether your code enters the conditional block calling commit at the bottom of your code. Endless loop with 100ms poll duration is fine for everything else. Regarding the screenshot that seem to be a snaplogic gui again.

[VOTE] KIP-436 Add a metric indicating start time

Hey everybody, I'd like to start a vote thread about the lightweight KIP-436 KIP: KIP-436 JIRA: KAFKA-7992 Pull Request: 6318

Re: [DISCUSS] KIP-436 Add a metric indicating start time

Thanks for the discussion, folks. I'll be starting a vote thread now. Dongjin, thanks for updating the link to the discussion thread. Best, Stanislav On Sun, Mar 3, 2019 at 1:30 PM Manikumar wrote: > Hi Stanislav, > > I too don't have strong preference between both the metrics. > Adding

[jira] [Resolved] (KAFKA-7966) Flaky Test DynamicBrokerReconfigurationTest#testLogCleanerConfig

[ https://issues.apache.org/jira/browse/KAFKA-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajini Sivaram resolved KAFKA-7966. --- Resolution: Duplicate > Flaky Test DynamicBrokerReconfigurationTest#testLogCleanerConfig >

Re: Apache Kafka Memory Leakage???

I already shared the code snippet earlier. What do you mean by input params? I am just running the consumer in an infinite loop polling for new messages.Polling time is 100 millisecs. If the topic is empty, the memory consumption is gradually increasing over the time and reaching to about

Re: Apache Kafka Memory Leakage???

Hi Syed, the next step would be for someone else to be able to reproduce the issue. If you could give me the values for the input parameters that your code runs with (as per my last mail) then I am happy to run this again and take another look at memory consumption. I'll then upload the exact

Re: Apache Kafka Memory Leakage???

Sonke, I am not blaming apache-kafka for the tickets raised by our customers. I am saying there could be an issue in kafka-clients library causing resource/memory leak. If that issue is resolved, I can resolve my tickets as well automatically. I don't find any issue with the snaplogic code.

Re: KIP-213 - Scalable/Usable Foreign-Key KTable joins - Rebooted.

On 04.03.2019 19:14, Matthias J. Sax wrote: > Thanks Adam, > > *> Q) Range scans work with caching enabled, too. Thus, there is no > functional/correctness requirement to disable caching. I cannot > remember why Jan's proposal added this? It might be an > implementation detail though (maybe

Re: Apache Kafka Memory Leakage???

Hi Syed, Apache Kafka is an open source software that comes as is without any support attached to it. It may well be that this is a bug in the Kafka client library, though tbh I doubt that from what my tests have shown and since I think someone else would have noticed this as well. Even if this

Re: Apache Kafka Memory Leakage???

Sonke, This issue seems serious. Customers raised bug with our product. And I suspect the bug is in apache-kafka clients library. I executed the kafka reader without any snaplogic-specific code. There were hardly about twenty messages in the topics. The code consumed about 300MB of memory