Re: [VOTE] 2.0.1 RC0

2018-11-02 Thread Ewen Cheslack-Postava
+1 -Ewen On Thu, Nov 1, 2018 at 10:10 AM Manikumar wrote: > We were waiting for the system test results. There were few failures: > KAFKA-7579, KAFKA-7559, KAFKA-7561 > they are not blockers for 2.0.1 release. We need more votes from > PMC/committers :) > > Thanks Stanislav! for the system

Re: Bemchmarks for KTable Joins and Queries

2018-11-02 Thread Matthias J. Sax
>> At a high level, KTables provide a capability to query for data. Can you elaborate? Do you refer to "Interactive Queries" feature? >> And I imagine latency/throughout of KTable queries depend on the number of >> consumers the query would have to touch to complete. Similar here. I am not

Re: consumer fetch multiple topic partitions committed offset

2018-11-02 Thread Matthias J. Sax
I am not sure why the API is this way. I agree, that it seems reasonable to do a single request for multiple topic partitions. I cc'ed Jason. He might know more. -Matthias On 11/2/18 3:31 AM, hacker win7 wrote: > Thanks for your reply, I want to know why new consumer did not add the >

Re: Deduplicating a topic in the face of producer crashes over a time window?

2018-11-02 Thread Andrew Wilcox
Looks great! Thank you Patrik. On Fri, Nov 2, 2018 at 2:38 AM Patrik Kleindl wrote: > Hi Andrew > > Did you take a look at > > https://github.com/confluentinc/kafka-streams-examples/blob/5.0.0-post/src/test/java/io/confluent/examples/streams/EventDeduplicationLambdaIntegrationTest.java > ? >

Re: Despite of log.retention.hours=168 the log files of messages sente yesterday are not present

2018-11-02 Thread Marco Ippolito
Thanks a lot Matthias Il gio 1 nov 2018, 21:19 Matthias J. Sax ha scritto: > /tmp/kafka-logs is just a convenient default, but not a reliable folder > to store data. /tmp/ might be cleared by the operation system. Note that > the quickstart is not designed to give "production ready"

Re: Bemchmarks for KTable Joins and Queries

2018-11-02 Thread Tom Szumowski
Thank you for the clarification. I understand they are fundamentally different underneath than a relational database, and may not be fair to compare directly. But how about benchmarks that aren't a comparison from other databases? At a high level, KTables provide a capability to query for data.

Re: Add company name on the Powered by page

2018-11-02 Thread Robin Moffatt
Hi Rohan, Please contact a...@confluent.io and she can arrange this. thanks, Robin. -- Robin Moffatt | Developer Advocate | ro...@confluent.io | @rmoff On Fri, 26 Oct 2018 at 18:26, Rohan Rasane wrote: > Hi, > What is the email address, if I want to add ServiceNow to the powered by >

Re: consumer fetch multiple topic partitions committed offset

2018-11-02 Thread hacker win7
Thanks for your reply, I want to know why new consumer did not add the committed(TopicPartitions)? Just modify the source in committed(TopicPartition, Duration) from ‘coordinator.fetchCommittedOffsets(Collections.single)’ to ‘coordinator.fetchCommittedOffsets(TopicPartitions)’. Besides, call

Re: kafka 0.9.0 is busy waiting when no message available

2018-11-02 Thread 杨珏吉
It was reported as KAFKA-3159 fixed in 0.9.0.1. Upgrading solves my problem. https://issues.apache.org/jira/browse/KAFKA-3159?attachmentSortBy=fileName 杨珏吉 于2018年11月1日周四 上午11:38写道: > > Hi Kafka experts > > I'm using kafka 0.9.0. I made sure that > Fetch.MinBytes(fetch.min.bytes) is set to be 1

one of the Kafka node slow

2018-11-02 Thread Shiuh Rong Yong
Hi there, We have a dev cluster with 3 nodes Hadoop and we have installed Kafka on them. However during ingestion from Mysql binlog, we notice that 2 of the nodes are a slower, between the 2 nodes, one node has the lowest byte out to consumer. We can see that in the grafana graph in our

Re: Deduplicating a topic in the face of producer crashes over a time window?

2018-11-02 Thread Patrik Kleindl
Hi Andrew Did you take a look at https://github.com/confluentinc/kafka-streams-examples/blob/5.0.0-post/src/test/java/io/confluent/examples/streams/EventDeduplicationLambdaIntegrationTest.java ? We are using this for a case like you described. Growth should be limited with this approach. Best