Re: Trying to use Kafka Stream

Hi Eno, Great finding! You were right! I had to change KAFKA_ADVERTISED_LISTENERS to be PLAINTEXT://$(docker-machine ip ): to make it work from IDE. Step 2 (pointing to : in my stream app) was already done. Later, I'll try using CLI as mentioned here https://github.com/

Re: Trying to use Kafka Stream

Ah, I see. > However, running the program (e.g. https://github.com/ confluentinc/examples/blob/3.2.x/kafka-streams/src/main/ java/io/confluent/examples/streams/WordCountLambdaExample.java#L178-L181) in my IDE was not and still is not working. Another thing to try is to run the program above from

Re: Trying to use Kafka Stream

Hi Michael, I was aware that the output should be written in a kafka topic not the console. To understand if streams can reach the kafka as Eno asked in earlier email I found http://docs.confluent.io/3.2.0/streams/quickstart.html #goal-of-this-quickstart and went through the steps mentioned and

Re: Trying to use Kafka Stream

Hi Mina, It might be that you need to set this property on the Kafka broker config file (server.properties): advertised.listeners=PLAINTEXT://your.host.name:9092 The problem might be this: within docker you run Kafka and Kafka’s address is localhost:9092. Great. Then say you have another

Re: Trying to use Kafka Stream

Mina, in your original question you wrote: > However, I do not see the word count when I try to run below example. Looks like that it does not connect to Kafka. The WordCount demo example writes its output to Kafka only -- it *does not* write any results to the console/STDOUT. >From what I

Re: Trying to use Kafka Stream

Hi, I just checked streams-wordcount-output topic using below command docker run \ --net=host \ --rm \ confluentinc/cp-kafka:3.2.0 \ kafka-console-consumer --bootstrap-server localhost:9092 \ --topic streams-wordcount-output \ --from-beginning \

Re: Trying to use Kafka Stream

I even tried http://docs.confluent.io/3.2.0/streams/quickstart.html#goal-of-this-quickstart and in docker-machine ran /usr/bin/kafka-run-class org.apache.kafka.streams.examples.wordcount.WordCountDemo Running docker run --net=host --rm confluentinc/cp-kafka:3.2.0 kafka-console-consumer

Re: Trying to use Kafka Stream

Hi, I forgot to add in my previous email 2 questions. To setup my env, shall I use https://raw.githubusercontent.com/confluentinc/cp-docker-images/master/examples/kafka-single-node/docker-compose.yml instead or is there any other docker-compose.yml (version 2 or 3) which is suggested to setup

Re: Trying to use Kafka Stream

And the port for kafka is 29092 and for zookeeper 32181. On Tue, Mar 14, 2017 at 9:06 PM, Mina Aslani wrote: > Hi, > > I forgot to add in my previous email 2 questions. > > To setup my env, shall I use https://raw.githubusercontent.com/ >

Re: Trying to use Kafka Stream

Hi Eno, Sorry! That is a typo! I have a docker-machine with different containers (setup as directed @ http://docs.confluent.io/3.2.0/cp-docker-images/docs/quickstart.html) docker ps --format "{{.Image}}: {{.Names}}" confluentinc/cp-kafka-connect:3.2.0: kafka-connect

Re: Trying to use Kafka Stream

Hi there, I noticed in your example that you are using localhost:9092 to produce but localhost:29092 to consume? Or is that a typo? Is zookeeper, kafka, and the Kafka Streams app all running within one docker container, or in different containers? I just tested the WordCountLambdaExample and

Re: Trying to use Kafka Stream

Any book, document and provides information on how to use kafka stream? On Tue, Mar 14, 2017 at 2:42 PM, Mina Aslani wrote: > I reset and still not working! > > My env is setup using http://docs.confluent.io/3.2.0/cp-docker-images/ > docs/quickstart.html > > I just tried

Re: Trying to use Kafka Stream

I reset and still not working! My env is setup using http://docs.confluent.io/3.2.0/cp-docker-images/docs/quickstart.html I just tried using https://github.com/confluentinc/examples/blob/3.2.x/kafka-streams/src/main/java/io/confluent/examples/streams/WordCountLambdaExample.java#L178-L181 with

Re: Trying to use Kafka Stream

>> So, when I check the number of messages in wordCount-input I see the same >> messages. However, when I run below code I do not see any message/data in >> wordCount-output. Did you reset your application? Each time you run you app and restart it, it will resume processing where it left off.

Re: Trying to use Kafka Stream

Hi Matthias, Thank you for the quick response, appreciate it! I created the topics wordCount-input and wordCount-output. Pushed some data to wordCount-input using docker exec -it $(docker ps -f "name=kafka\\." --format "{{.Names}}") /bin/kafka-console-producer --broker-list localhost:9092

Re: Trying to use Kafka Stream

Maybe you need to reset your application using the reset tool: http://docs.confluent.io/current/streams/developer-guide.html#application-reset-tool Also keep in mind, that KTables buffer internally, and thus, you might only see data on commit. Try to reduce commit interval or disable caching by

Trying to use Kafka Stream

Hi, This is the first time that am using Kafka Stream. I would like to read from input topic and write to output topic. However, I do not see the word count when I try to run below example. Looks like that it does not connect to Kafka. I do not see any error though. I tried my localhost kafka as