Re: Kafka Streams - not able to see the text in console consumer

Hi, Karan, It looks like you need to add a property 'value.deserializer' to kafka-console-consumer.sh. For example: $ bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic kstreams4 --from-beginning \ --property print.key=true \ --property print.value=true \

Kafka Streams - not able to see the text in console consumer

Hello All - i've a basic word count Kafka streams code, which reads data from the input topic, splits the data (per the separator) and outputs the data into the output topic. I've a console producer, which is putting data into the input topic (kstreams3), and a console consumer which is reading

Re: Kafka Connect Sink Connector for multiple JDBC sinks

Hi Jan, Forgive my ignorance, but I am slightly confused here. *"You should be able to get everything running on Windows anyhow"* - Confluent quickstart for JDBC Connector/Sink Connector requires Schema Registry up and running - currently Confluent does not provide any windows batch script list

Re: Improving Kafka State Store performance

@James, I will enable the monitoring metrics and try out. But I seriously think the performance degradation was due to rocks DB. As soon as I switched to in Memory State Store all my problems disappeared. @Sabarish, Only my kafka instances are on T2 Instance. My application instances are on M4

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

Is there anything abnormal in network performance for your Kafka brokers ec2 instances and Kafka stream processor ec2 instances? Is the network link getting saturated? If so you might want to upgrade Kafka brokers to an instance type with more network bandwidth. I would also go check the memory

Re: Kafka Streams application Unable to Horizontally scale and the application on other instances refusing to start.

>From StreamThread100.log : DEBUG | 13:35:32 | clients.NetworkClient (NetworkClient.java:760) - Initiating connection to node 1 at emspproximitykafka5102.mydomain.com:9092. Can you take a look at the log on emspproximitykafka5102 to see if there was some clue around the time of disconnection ?

Re: Improving Kafka State Store performance

T2 instances are credit based instances that do not provide constant throughout in cpu and io. You would want to reconsider using t2. That said we too face issues with scaling rocksdb. Although I don't remember the performance benchmark numbers but I do remember it was at least 3x slower when

Re: Improving Kafka State Store performance

In addition to the measurements that you are doing yourself, Kafka Streams also has its own metrics. They are exposed via JMX, if you have that enabled: http://kafka.apache.org/documentation/#monitoring If you set