Topic UI not Displaying Any Topic

2018-01-18 Thread Bunty Ray
Hi, Does anyone aware of this issue. The Topic UI does not displays the Topic Names, its only shows the number of Brokers and Number of Topic. Regards, Bunty Ray

??????I would like to increase the bandwidth by binding each broker to each network card in one machine. Is this feasible?

2018-01-18 Thread ??????
you are right, it is feasible. -- -- ??: "??";; : 2018??1??17??(??) 9:21 ??: "users"; : I would like to increase the bandwidth by binding each broker to each network

Re: What's the use of timestamp in ProducerRecord?

2018-01-18 Thread Matthias J. Sax
The timestamp has many different purposes. As mentioned already, it used to expired data via retention time. It's also used for stream processing via Streams API. All processing is based on those timestamps for windowing and joining of streams. -Matthias On 1/18/18 7:57 PM, Stephen Powis wrote:

Re: What's the use of timestamp in ProducerRecord?

2018-01-18 Thread Stephen Powis
A common use case is for calculating a "processing lag time" comparing the record's timestamp (when it was published/persisted) against the current time that the consumer 'consumed' it. In theory, the delta is 'how far behind' the consumer is, tho you can come up with a variety of reasons why

Re: What's the use of timestamp in ProducerRecord?

2018-01-18 Thread 1095193...@qq.com
kafka does not delete message when message is consumed, it will purge message when this message is expired. I guess this timeStamp is for checking whether message is expired. 1095193...@qq.com From: Jake Yoon Date: 2018-01-19 11:46 To: users Subject: What's the use of timestamp in

What's the use of timestamp in ProducerRecord?

2018-01-18 Thread Jake Yoon
Hi, I am very new to Kafka. And I have a very basic question. Kafka doc says, *ProducerRecord * (String

Re: __consumer_offsets too big

2018-01-18 Thread Shravan R
Thanks for your response Bret. I was able to do something similar to resolve the issue but I did not upgrade the cluster. I got lucky and did not ran into edge cases that are on 0.9. On Wed, Jan 17, 2018 at 5:16 PM, Brett Rann wrote: > There are several bugs in 0.9

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

2018-01-18 Thread Jun Rao
Congratulations, Rajini ! Jun On Wed, Jan 17, 2018 at 10:48 AM, Gwen Shapira wrote: > Dear Kafka Developers, Users and Fans, > > Rajini Sivaram became a committer in April 2017. Since then, she remained > active in the community and contributed major patches, reviews and

Re: [VOTE] KIP-247: Add public test utils for Kafka Streams

2018-01-18 Thread Matthias J. Sax
I added the new method to the KIP and also updated the PR. -Matthias On 1/18/18 10:48 AM, Guozhang Wang wrote: > @Matthias > > This comes to me while reviewing another using the test driver: could we > add a `Map allStateStores()` to the > `TopologyTestDriver` besides all

Re: One type of event per topic?

2018-01-18 Thread Damian Guy
This might be a good read for you: https://www.confluent.io/blog/put-several-event-types-kafka-topic/ On Thu, 18 Jan 2018 at 20:57 Maria Pilar wrote: > Hi everyone, > > I´m working in the configuration of the topics for the integration between > one API and Data platform

One type of event per topic?

2018-01-18 Thread Maria Pilar
Hi everyone, I´m working in the configuration of the topics for the integration between one API and Data platform system. We have created topic for each entity that they would need to integrate in to the datawarehouse. My question and I hope you can help me is, each entity will have diferent

Error sink parse Json

2018-01-18 Thread Maria Pilar
Hi everyone, I trying to send events from the topic This is the sink json configuration I’ve used: { "name":"CPSConnector", "config":{ "connector.class":"com.google.pubsub.kafka.sink.CloudPubSubSinkConnector", "tasks.max":"1", "topics":"STREAM-CUSTOMER-ACCOUNTS",

Re: [ANNOUNCE] New committer: Matthias J. Sax

2018-01-18 Thread Matthias J. Sax
Thanks a lot everyone! It's a real pleasure to work with all of you :) -Matthias On 1/17/18 3:38 AM, Satish Duggana wrote: > Congratulations Mathias! > > On Tue, Jan 16, 2018 at 11:52 AM, Becket Qin wrote: > >> Congrats, Matthias! >> >> On Mon, Jan 15, 2018 at 9:54 PM,

Enable Kafka Authentication on 0.9

2018-01-18 Thread Sunil Parmar
We're using Kafka 0.9 ( CDH ) but it's unsecured now and we want to enable authentication ( authorization is nice to have ) . Any documentation / blog/ suggestion on how to do it on active cluster ? Is Kerberoes the only way to do it ? Our OPS is not a big fan of Kerberoes and prefers something

Re: Kafka Streams topology does not replay correctly

2018-01-18 Thread Dmitry Minkovsky
> however the question remains, what to do when one partition does not have any data (ie, your are in the real-time case processing at the head of the topics)? Just process (with the risk that we get the order wrong?) or block until we get data for all partitions (But for how long to block/delay?

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

2018-01-18 Thread James Cheng
Congrats Rajini! -James Sent from my iPhone > On Jan 17, 2018, at 10:48 AM, Gwen Shapira wrote: > > Dear Kafka Developers, Users and Fans, > > Rajini Sivaram became a committer in April 2017. Since then, she remained > active in the community and contributed major

Re: [VOTE] KIP-247: Add public test utils for Kafka Streams

2018-01-18 Thread James Cheng
+1 (non-binding) -James Sent from my iPhone > On Jan 17, 2018, at 6:09 PM, Matthias J. Sax wrote: > > Hi, > > I would like to start the vote for KIP-247: > https://cwiki.apache.org/confluence/display/KAFKA/KIP-247%3A+Add+public+test+utils+for+Kafka+Streams > > >

Re: [VOTE] KIP-247: Add public test utils for Kafka Streams

2018-01-18 Thread Damian Guy
+1 On Thu, 18 Jan 2018 at 15:14 Bill Bejeck wrote: > Thanks for the KIP. > > +1 > > -Bill > > On Wed, Jan 17, 2018 at 9:09 PM, Matthias J. Sax > wrote: > > > Hi, > > > > I would like to start the vote for KIP-247: > >

Re: [VOTE] KIP-247: Add public test utils for Kafka Streams

2018-01-18 Thread Bill Bejeck
Thanks for the KIP. +1 -Bill On Wed, Jan 17, 2018 at 9:09 PM, Matthias J. Sax wrote: > Hi, > > I would like to start the vote for KIP-247: > https://cwiki.apache.org/confluence/display/KAFKA/KIP- > 247%3A+Add+public+test+utils+for+Kafka+Streams > > > -Matthias > >

Re: [VOTE] KIP-247: Add public test utils for Kafka Streams

2018-01-18 Thread Ted Yu
+1 Original message From: Guozhang Wang Date: 1/17/18 10:38 PM (GMT-08:00) To: users@kafka.apache.org Subject: Re: [VOTE] KIP-247: Add public test utils for Kafka Streams +1 (binding). On Wed, Jan 17, 2018 at 6:09 PM, Matthias J. Sax

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

2018-01-18 Thread Viktor Somogyi
Congratulations! :) On Thu, Jan 18, 2018 at 10:38 AM, Rajini Sivaram wrote: > Thanks everyone! > > Regards, > > Rajini > > On Thu, Jan 18, 2018 at 8:53 AM, Damian Guy wrote: > > > Congratulations Rajini! > > > > On Thu, 18 Jan 2018 at 00:57 Hu Xi

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

2018-01-18 Thread Rajini Sivaram
Thanks everyone! Regards, Rajini On Thu, Jan 18, 2018 at 8:53 AM, Damian Guy wrote: > Congratulations Rajini! > > On Thu, 18 Jan 2018 at 00:57 Hu Xi wrote: > > > Congratulations, Rajini Sivaram. Very well deserved! > > > > > >

Re: [ANNOUNCE] New Kafka PMC Member: Rajini Sivaram

2018-01-18 Thread Damian Guy
Congratulations Rajini! On Thu, 18 Jan 2018 at 00:57 Hu Xi wrote: > Congratulations, Rajini Sivaram. Very well deserved! > > > > 发件人: Konstantine Karantasis > 发送时间: 2018年1月18日 6:23 > 收件人: d...@kafka.apache.org >