Re: Kafka mirror maker help

2018-04-26 Thread Amrit Jangid
You should share related info, such source-destination Kafka versions, sample Config or error if any. FYI, Go through https://kafka.apache.org/documentation/#basic_ops_mirror_maker

Kafka mirror maker help

2018-04-26 Thread saravanan kannappan
Hello, I'm setting up mirror maker for kafka however it doesn't help can you guide me some steps or else share the model shell script to execute the mirror maker ? highly appreciated your help. Thanks Sara

Re: Monitoring and Alerting

2018-04-26 Thread Arunkumar
Hi All Thank you for your time and effort. All have suggested my to look at Prometheus etc... I am not looking for a solution. I need metrics on which I can do alerting. We are implementing custom alerting mechanism. I am using JMX to get all the metrics but as many of you suggested I do not

Re: kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread dizzy0ny
That function doesn't throw the exception.  It returns an empty store list.  That function is called by QueryableStateProvider.getStore(), which will throw InvalidStateStoreException if the list is empty. The function I provided, is iterating over the StreamTasks, but is not able to find the

Re: Broker cannot start switch to Java9 - weird file system issue ?

2018-04-26 Thread Ismael Juma
Thanks, I updated it. On Thu, Apr 26, 2018 at 4:09 AM, Enrico Olivelli wrote: > Here it is ! > > https://issues.apache.org/jira/browse/KAFKA-6828 > > Thank you > > Enrico > > 2018-04-24 20:53 GMT+02:00 Ismael Juma : > > > A JIRA ticket would be

Re: kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread Guozhang Wang
Hello, Thanks for reporting this issue, did you know which line gets fired and throw the InvalidStateStoreException since you listed two places here? 1) if (!streamThread.isRunningAndNotRebalancing()) 2) if (!store.isOpen()) >From the description that "the above code is not finding the store

Re: Re: kafka steams with TimeWindows ,incorrect result

2018-04-26 Thread Guozhang Wang
Using a control message to flush results to downstream (in your case to the result db) looks good to me as well. On Thu, Apr 26, 2018 at 10:49 AM, Guozhang Wang wrote: > If you're talking about which store to use in your transform function, it > should be a windowed store. >

Re: Re: kafka steams with TimeWindows ,incorrect result

2018-04-26 Thread Guozhang Wang
If you're talking about which store to use in your transform function, it should be a windowed store. You can create such a store with the `Stores` factory, and suppose your old code has `windowedBy(TimeWindows.of(6))`, then you can do ` windows = TimeWindows.of(6);

Re: Write access required to Confluence wiki

2018-04-26 Thread Piyush Vijay
Ping :) Piyush Vijay On Wed, Apr 25, 2018 at 7:45 PM, Piyush Vijay wrote: > > I want to open a JIRA and a KIP. Can someone please grant me the necessary > permissions? > My username is *piyushvijay*. > > Thank you > Piyush Vijay > >

kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread mahendra.b.singh
My stream app produces streams by subscribing to changes from our database by using confluent connect, does some calculation and then publishes their own stream/topic. When starting the app, i attempt to get each of the stream store the app publishes. This code simply tries to get the store

kafka error after upgrading to 1.1.0: “the state store…may have migrated to another instance”

2018-04-26 Thread dizzy0ny
My stream app produces streams by subscribing to changes from our database by using confluent connect, does some calculation and then publishes their own stream/topic. When starting the app, i attempt to get each of the stream store the app publishes. This code simply tries to get the store

Re: Re: kafka steams with TimeWindows ,incorrect result

2018-04-26 Thread 杰 杨
I return back . Which StateStore could I use for this problem? and another idea .I can send 'flush' message into this topic . when received this message could update results to db. I don't know it's work? funk...@live.com From: Guozhang

Re: Broker cannot start switch to Java9 - weird file system issue ?

2018-04-26 Thread Enrico Olivelli
Here it is ! https://issues.apache.org/jira/browse/KAFKA-6828 Thank you Enrico 2018-04-24 20:53 GMT+02:00 Ismael Juma : > A JIRA ticket would be appreciated. :) > > Ismael > > On Sat, Apr 21, 2018 at 12:51 AM, Enrico Olivelli > wrote: > > > Il sab 21

Re: How do I specify jdbc connection porperites in kafka-jdbc-connector

2018-04-26 Thread Niels Ull Harremoes
I am using confluent and configuring the connector in distributed mode  using REST. I am setting the connector parameters as follows - but the connector params do not include anything like connection.jdbcproperties, so I cannot set oracle.jdbc.timezoneAsRegion=false. Appending it to the