RE: [DISCUSS] Streams DSL/StateStore Refactoring

I like more of a builder pattern even though others have voiced against it. The reason I like it is because it makes it clear to the user that a call to KGroupedStream#count will return a KTable not some intermediate class that I need to undetstand. When trying to program in the fluent API

[jira] [Created] (KAFKA-5535) Transformations - tranformations for value broken on tombsone events

Yelei Wu created KAFKA-5535: --- Summary: Transformations - tranformations for value broken on tombsone events Key: KAFKA-5535 URL: https://issues.apache.org/jira/browse/KAFKA-5535 Project: Kafka

[jira] [Resolved] (KAFKA-5521) Support replicas movement between log directories (KIP-113)

[ https://issues.apache.org/jira/browse/KAFKA-5521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dong Lin resolved KAFKA-5521. - Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/KAFKA-5163 > Support replicas

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

Ismael, Thanks for running this release! Guozhang On Wed, Jun 28, 2017 at 5:57 PM, Jun Rao wrote: > Hi, Ismael, > > Thanks a lot for running this release! > > Jun > > On Wed, Jun 28, 2017 at 5:52 PM, Ismael Juma wrote: > > > The Apache Kafka community is

[GitHub] kafka pull request #3334: MINOR: Fix ConsumerBounceTest to wait for consumer...

Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/3334 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #3303: KAFKA-5402: Avoid creating quota related metrics i...

GitHub user rajinisivaram reopened a pull request: https://github.com/apache/kafka/pull/3303 KAFKA-5402: Avoid creating quota related metrics if quotas not enabled You can merge this pull request into a Git repository by running: $ git pull

Re: [ANNOUNCE] Apache Kafka 0.11.0.0 Released

Hi, Ismael, Thanks a lot for running this release! Jun On Wed, Jun 28, 2017 at 5:52 PM, Ismael Juma wrote: > The Apache Kafka community is pleased to announce the release for Apache > Kafka 0.11.0.0. This is a feature release which includes the completion > of 32 KIPs, over

[ANNOUNCE] Apache Kafka 0.11.0.0 Released

The Apache Kafka community is pleased to announce the release for Apache Kafka 0.11.0.0. This is a feature release which includes the completion of 32 KIPs, over 400 bug fixes and improvements, and more than 700 pull requests merged. All of the changes in this release can be found in the release

[GitHub] kafka pull request #3303: KAFKA-5402: Avoid creating quota related metrics i...

Github user rajinisivaram closed the pull request at: https://github.com/apache/kafka/pull/3303 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

Re: [DISCUSS] Streams DSL/StateStore Refactoring

I played the current proposal a bit with https://github.com/dguy/kafka/ tree/dsl-experiment, and here are my observations: 1. Personally I prefer "stream.group(mapper) / stream.groupByKey()" than "stream.group().withKeyMapper(mapper) / stream.group()" Since 1) withKeyMapper is not

Re: [DISCUSS] Streams DSL/StateStore Refactoring

I see your point about "when to add the processor to the topology". That is indeed an issue. Not sure it we could allow "updates" to the topology... I don't see any problem with having all the withXX() in KTable interface -- but this might be subjective. However, I don't understand your

[GitHub] kafka pull request #3457: MINOR: Rename baseTimestamp to firstTimestamp to c...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3457 MINOR: Rename baseTimestamp to firstTimestamp to clarify usage You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka

[jira] [Created] (KAFKA-5534) KafkaConsumer offsetsForTimes should include partitions in result even if no offset could be found

Jason Gustafson created KAFKA-5534: -- Summary: KafkaConsumer offsetsForTimes should include partitions in result even if no offset could be found Key: KAFKA-5534 URL:

Build failed in Jenkins: kafka-trunk-jdk8 #1769

See Changes: [jason] KAFKA-5490; Cleaner should retain empty batch if needed to preserve [ismael] MINOR: Implement `toString` in some Validator instances --

[GitHub] kafka pull request #3456: KAFKA-5522: ListOffsets should bound timestamp sea...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/3456 KAFKA-5522: ListOffsets should bound timestamp search by LSO in read_committed You can merge this pull request into a Git repository by running: $ git pull

[GitHub] kafka pull request #3451: MINOR: Implement `toString` in some Validator inst...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3451 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3406: KAFKA-5490: Retain empty batch for last sequence o...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3406 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3441: MINOR: Enable the TransactionsBounceTest

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3441 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-168: Add TotalTopicCount metric per cluster

Hey Abhishek, GlobalTopicCount sounds good to me. Thanks, Dong On Wed, Jun 28, 2017 at 8:39 AM, Abhishek Mendhekar < abhishek.mendhe...@gmail.com> wrote: > Hi Joel, > > Thanks for your comments. > > To keep it consistent as well as clear my suggestion is to change the > TopicCount to

Re: [DISCUSS] KIP-168: Add TotalTopicCount metric per cluster

Hi Abhishek, Thanks for the KIP and sorry for posting late on this thread. The proposal looks good to me. I wonder if it would be useful to also add a partition count metric. It seems there is already an offline partition count metric in the controller, but no total partition count. Thanks.

Re: [DISCUSS] KIP-168: Add TotalTopicCount metric per cluster

Hi Joel, Thanks for your comments. To keep it consistent as well as clear my suggestion is to change the TopicCount to GlobalTopicCount. This makes it fairly consistent (if not completely) as well as makes it unambiguous in what it means. Dong, Let me know if this sounds good. Best, Abhishek

[jira] [Created] (KAFKA-5533) Timestamp-based log compaction

Eno Thereska created KAFKA-5533: --- Summary: Timestamp-based log compaction Key: KAFKA-5533 URL: https://issues.apache.org/jira/browse/KAFKA-5533 Project: Kafka Issue Type: New Feature

[GitHub] kafka pull request #3455: KAFKA-5379 - ProcessorContext.appConfigs() should ...

GitHub user twbecker opened a pull request: https://github.com/apache/kafka/pull/3455 KAFKA-5379 - ProcessorContext.appConfigs() should return parsed values. You can merge this pull request into a Git repository by running: $ git pull https://github.com/twbecker/kafka

[GitHub] kafka pull request #3454: MINOR: Compatibility and upgrade tests for 0.11.0....

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3454 MINOR: Compatibility and upgrade tests for 0.11.0.x You can merge this pull request into a Git repository by running: $ git pull https://github.com/ijuma/kafka test-upgrades-from-0.11.0.x

[GitHub] kafka pull request #3453: KAFKA-5532: Making bootstrap.servers property a fi...

GitHub user ppatierno opened a pull request: https://github.com/apache/kafka/pull/3453 KAFKA-5532: Making bootstrap.servers property a first citizen option for the ProducerPerformance Added bootstrap-server as option for specifying Kafka cluster to connect to You can merge this

[GitHub] kafka pull request #3452: KAFKA-5483: Shutdown of scheduler should come afte...

GitHub user mimaison opened a pull request: https://github.com/apache/kafka/pull/3452 KAFKA-5483: Shutdown of scheduler should come after LogManager Close the scheduler after all components using it have been shutdown @hachikuji Can you have a look ? You can merge this

Re: Is Kafka client 0.10.2.1 backward compatible

Hi Saurabh the 0.10.2.x client is backward compatible up to the 0.10.0.0 broker, not earlier. ciao Edo -- Edoardo Comar IBM Message Hub IBM UK Ltd, Hursley Park, SO21 2JN Tom Crayford wrote on 28/06/2017 15:21:04: >

Re: Is Kafka client 0.10.2.1 backward compatible

Kafka promises one thing and one thing only for backwards compatability, which is that brokers with newer versions will always support older clients. The inverse: old brokers with new clients is not true. On Wed, Jun 28, 2017 at 6:18 AM, saurabh mimani wrote: > I am

Is Kafka client 0.10.2.1 backward compatible

I am trying to use partitionsFor method of kafka client 2.11: 0.10.2.1 for topics published by Kafka 0.8.2.x, but it gives timeout. Following are more details: I have a small Java spark service which uses kafka client

[jira] [Created] (KAFKA-5532) Making bootstrap.servers property a first citizen option for the ProducerPerformance

Paolo Patierno created KAFKA-5532: - Summary: Making bootstrap.servers property a first citizen option for the ProducerPerformance Key: KAFKA-5532 URL: https://issues.apache.org/jira/browse/KAFKA-5532

[jira] [Created] (KAFKA-5531) Check exception handling in all streams tests

Eno Thereska created KAFKA-5531: --- Summary: Check exception handling in all streams tests Key: KAFKA-5531 URL: https://issues.apache.org/jira/browse/KAFKA-5531 Project: Kafka Issue Type:

Re: 0.11.0.0 RC2 Vote

Thanks Guozhang. I fixed the quickstart references to use a version variable. Ismael On Tue, Jun 27, 2017 at 11:57 PM, Guozhang Wang wrote: > My vote on the original VOTE thread somehow cannot show up, I have tried > several ways and nothing works. So I am sending it as a

[GitHub] kafka pull request #3055: KAFKA-5233 KIP-138: Change punctuate semantics

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/3055 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #3451: MINOR: Implement `toString` in some Validator inst...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/3451 MINOR: Implement `toString` in some Validator instances This is used in the generated config table. Also fix a couple of typos in the process. You can merge this pull request into a Git

Re: [DISCUSS] Streams DSL/StateStore Refactoring

> I also think that mixing optional parameters with configs is a bad idea. > Have not proposal for this atm but just wanted to mention it. Hope to > find some time to come up with something. > > Yes, i don't like the mix of config either. But the only real config here is the logging config - which

Re: [VOTE] KIP-161: streams deserialization exception handlers

+1 On Sat, Jun 24, 2017 at 1:38 AM, Matthias J. Sax wrote: > +1 > > On 6/23/17 9:45 AM, Guozhang Wang wrote: > > +1. > > > > On Fri, Jun 23, 2017 at 6:42 AM, Bill Bejeck wrote: > > > >> Thanks for the KIP! > >> > >> +1 > >> > >> -Bill > >> > >> On Fri,

[GitHub] kafka pull request #3450: KAFKA-5529 Use only KafkaProducer in ConsoleProduc...

GitHub user evis opened a pull request: https://github.com/apache/kafka/pull/3450 KAFKA-5529 Use only KafkaProducer in ConsoleProducer You can merge this pull request into a Git repository by running: $ git pull https://github.com/evis/kafka console-producer-remove-deprecated

[jira] [Created] (KAFKA-5530) Balancer is dancing with KStream all the time, and due to that Kafka cannot work :-)

Seweryn Habdank-Wojewodzki created KAFKA-5530: - Summary: Balancer is dancing with KStream all the time, and due to that Kafka cannot work :-) Key: KAFKA-5530 URL:

[jira] [Created] (KAFKA-5529) ConsoleProducer uses deprecated BaseProducer

Evgeny Veretennikov created KAFKA-5529: -- Summary: ConsoleProducer uses deprecated BaseProducer Key: KAFKA-5529 URL: https://issues.apache.org/jira/browse/KAFKA-5529 Project: Kafka Issue

Jenkins build is back to normal : kafka-trunk-jdk8 #1766

See