Re: Trying to use Kafka Stream

Hi Eno, Great finding! You were right! I had to change KAFKA_ADVERTISED_LISTENERS to be PLAINTEXT://$(docker-machine ip ): to make it work from IDE. Step 2 (pointing to : in my stream app) was already done. Later, I'll try using CLI as mentioned here https://github.com/

Re: Trying to use Kafka Stream

Ah, I see. > However, running the program (e.g. https://github.com/ confluentinc/examples/blob/3.2.x/kafka-streams/src/main/ java/io/confluent/examples/streams/WordCountLambdaExample.java#L178-L181) in my IDE was not and still is not working. Another thing to try is to run the program above from

Re: Trying to use Kafka Stream

Hi Michael, I was aware that the output should be written in a kafka topic not the console. To understand if streams can reach the kafka as Eno asked in earlier email I found http://docs.confluent.io/3.2.0/streams/quickstart.html #goal-of-this-quickstart and went through the steps mentioned and

Re: Trying to use Kafka Stream

Hi Mina, It might be that you need to set this property on the Kafka broker config file (server.properties): advertised.listeners=PLAINTEXT://your.host.name:9092 The problem might be this: within docker you run Kafka and Kafka’s address is localhost:9092. Great. Then say you have another

Re: Trying to use Kafka Stream

Mina, in your original question you wrote: > However, I do not see the word count when I try to run below example. Looks like that it does not connect to Kafka. The WordCount demo example writes its output to Kafka only -- it *does not* write any results to the console/STDOUT. >From what I

Re: Trying to use Kafka Stream

Hi, I just checked streams-wordcount-output topic using below command docker run \ --net=host \ --rm \ confluentinc/cp-kafka:3.2.0 \ kafka-console-consumer --bootstrap-server localhost:9092 \ --topic streams-wordcount-output \ --from-beginning \

Re: Trying to use Kafka Stream

I even tried http://docs.confluent.io/3.2.0/streams/quickstart.html#goal-of-this-quickstart and in docker-machine ran /usr/bin/kafka-run-class org.apache.kafka.streams.examples.wordcount.WordCountDemo Running docker run --net=host --rm confluentinc/cp-kafka:3.2.0 kafka-console-consumer

Re: Trying to use Kafka Stream

Hi, I forgot to add in my previous email 2 questions. To setup my env, shall I use https://raw.githubusercontent.com/confluentinc/cp-docker-images/master/examples/kafka-single-node/docker-compose.yml instead or is there any other docker-compose.yml (version 2 or 3) which is suggested to setup

Re: Trying to use Kafka Stream

And the port for kafka is 29092 and for zookeeper 32181. On Tue, Mar 14, 2017 at 9:06 PM, Mina Aslani wrote: > Hi, > > I forgot to add in my previous email 2 questions. > > To setup my env, shall I use https://raw.githubusercontent.com/ >

Re: Trying to use Kafka Stream

Hi Eno, Sorry! That is a typo! I have a docker-machine with different containers (setup as directed @ http://docs.confluent.io/3.2.0/cp-docker-images/docs/quickstart.html) docker ps --format "{{.Image}}: {{.Names}}" confluentinc/cp-kafka-connect:3.2.0: kafka-connect

Re: Trying to use Kafka Stream

Hi there, I noticed in your example that you are using localhost:9092 to produce but localhost:29092 to consume? Or is that a typo? Is zookeeper, kafka, and the Kafka Streams app all running within one docker container, or in different containers? I just tested the WordCountLambdaExample and

Re: Trying to use Kafka Stream

Any book, document and provides information on how to use kafka stream? On Tue, Mar 14, 2017 at 2:42 PM, Mina Aslani wrote: > I reset and still not working! > > My env is setup using http://docs.confluent.io/3.2.0/cp-docker-images/ > docs/quickstart.html > > I just tried

Re: Trying to use Kafka Stream

I reset and still not working! My env is setup using http://docs.confluent.io/3.2.0/cp-docker-images/docs/quickstart.html I just tried using https://github.com/confluentinc/examples/blob/3.2.x/kafka-streams/src/main/java/io/confluent/examples/streams/WordCountLambdaExample.java#L178-L181 with

Re: Trying to use Kafka Stream

>> So, when I check the number of messages in wordCount-input I see the same >> messages. However, when I run below code I do not see any message/data in >> wordCount-output. Did you reset your application? Each time you run you app and restart it, it will resume processing where it left off.

Re: Trying to use Kafka Stream

Hi Matthias, Thank you for the quick response, appreciate it! I created the topics wordCount-input and wordCount-output. Pushed some data to wordCount-input using docker exec -it $(docker ps -f "name=kafka\\." --format "{{.Names}}") /bin/kafka-console-producer --broker-list localhost:9092

Re: Trying to use Kafka Stream

Maybe you need to reset your application using the reset tool: http://docs.confluent.io/current/streams/developer-guide.html#application-reset-tool Also keep in mind, that KTables buffer internally, and thus, you might only see data on commit. Try to reduce commit interval or disable caching by