RE: join 2 topic streams --> to another topic

You're right Matthias, I will take your suggestion of KTable-KTable join  I suppose so that meant I don't need windowing ? -Adrien De : Matthias J. Sax Envoyé : lundi 9 avril 2018 20:15:17 À : users@kafka.apache.org Objet : Re: join 2

Re: Kafka Mirrormaker issue

We had trouble with batch expired produce errors for high (not really that high, maybe 400 msgs/sec) volume topic partitions. We solved these by increasing `request.timeout.ms` and all increasing `batch.size` (which reduced the total number of waiting batches in MirrorMaker). More context here:

Re: Kafka-streams: mix Processor API with windowed grouping

Thanks again, yeah we saw that example for sure :) Ok, gonna try low-level Transformer and see how it goes. On Mon, Apr 9, 2018 at 9:17 PM, Matthias J. Sax wrote: > For (1), no. > > If you want to do manual put/get you should use a Transformer and > implement a custom

Re: Kafka-streams: mix Processor API with windowed grouping

For (1), no. If you want to do manual put/get you should use a Transformer and implement a custom operator. Btw: here is an example of TopN: https://github.com/confluentinc/kafka-streams-examples/blob/4.0.0-post/src/main/java/io/confluent/examples/streams/TopArticlesExampleDriver.java

Re: Kafka Mirrormaker issue

We've been stable all weekend with the following settings: ExecStart=/usr/bin/kafka-mirror-maker --abort.on.send.failure true --new.consumer --num.streams 6 --offset.commit.interval.ms 6 --consumer.config /etc/kafka/mirrormaker/telem_mm/consumer.properties --producer.config

Re: Apache Kafka / Spark Integration - Exception - The server disconnected before a response was received.

Hi Folks: Just wanted to see if anyone has any suggestions on this issue. Thanks On Monday, March 26, 2018, 11:04:02 AM PDT, M Singh wrote: Hi Ted: Here is the exception trace (Note - The exception is occuring in the kafka spark writer class). I will

Re: subscribe kafka user group

See https://kafka.apache.org/contact Original message From: "vinly.zhao" Date: 4/9/18 5:21 AM (GMT-08:00) To: users@kafka.apache.org Subject: subscribe kafka user group Thanks, *Vincent Zhao*

subscribe kafka user group

Thanks, *Vincent Zhao*

Re: Kafka-streams: mix Processor API with windowed grouping

Hi Matthias, thanks clarifications below: 1. .aggregate( () -> .. , (k, v, agg) -> { //Can i access KV store here for manual put/get? }); 2. TopN is not hard, we using pretty much same approach you describe, just with

RE: Issue deleting topic on Windows

Hi Lawrence, Thanks for that! I'll take a look at your patches. Hopefully they can be merged into a future release Ben -Original Message- From: Lawrence Craft [mailto:lawrence.cr...@gmail.com] Sent: 22 March 2018 19:27 To: users@kafka.apache.org Subject: Re: Issue deleting topic on

RE: join 2 topic streams --> to another topic

Hello Matthias, thank for your response. I will try to read the blog post today. For the keys, not really, In fact, keys are always the same "symbol" of a STOCK example "YHOO", "INTC" and they never change. Do you with I need to use another key ? Or add a timestamp to the key ? For single