?????? kafka configure problem

2017-12-26 Thread G~D~Lunatic
controller.log.2017-12-27-07 [2017-12-27 07:54:51,777] DEBUG [Controller 0]: topics not in preferred replica Map() (kafka.controller.KafkaController) [2017-12-27 07:54:51,777] TRACE [Controller 0]: leader imbalance ratio for broker 0 is 0.00 (kafka.controller.KafkaController) [2017-12-27 07:5

Schema Registry

2017-12-26 Thread Nishanth S
Hi All, What is the best way to add schemas to schema registry ?. I am using confluent platform and our data is in avro . We use confluent kafka avro serializers and I read that using this would register the schema in schema registry automatically .We also use the same schemas for downstrea

Problem about compact

2017-12-26 Thread 冯 少华
Hi: I hava a confuse about the policy of log compact, I hava 15 partitions, my server.properties like this: log.cleanup.policy=compact compression.type=gzip log.retention.hours=168 #log.retention.bytes=1073741824 log.segment.bytes=1073741824 log.retention.check.interval.ms=30 a week later, o

Re: Kafka SSL error

2017-12-26 Thread Martin Gainty
possible you are either not connecting (someone is blocking/redirecting) or possibly you are not authenticating with your security configuration parameters: are your redirecting to other IP's or Ports by intervening proxys? can you ping all the IP addresses in the cluster? can u post the resul

using long polling for Kafka Producer and Consumer

2017-12-26 Thread 刘林
Hi, We designed a unified REST gateway to post data to kafka and get data from kafka, then how can I send and consume the kafka data using long polling for effieiency. I do not want to new KafkaConsumer/KafkaProducer every time and close it. Properties props = kafkaSettings.getDefaultProd

using long polling for Kafka Producer and Consumer

2017-12-26 Thread 刘林
Hi, We designed a unified REST gateway to post data to kafka and get data from kafka, then how can I send and consume the kafka data using long polling for effieiency. I do not want to new KafkaConsumer/KafkaProducer every time and close it. Properties props = kafkaSettings.getDefaultProdu

Kafka Producer and Consumer long polling for efficiency

2017-12-26 Thread 刘林
Hi, We designed a unified REST gateway to post data to kafka and get data from kafka, then how can I send and consume the kafka data efficiency using long polling. I do not want to new KafkaConsumer/KafkaProducer and close it every time. Is there any ways to realize it? Thanks!

Re: kafka configure problem

2017-12-26 Thread Ted Yu
What you mentioned is a DEBUG log from KafkaController.scala Can you pastebin relevant log so that we can have better idea of what happened ? Cheers On Mon, Dec 25, 2017 at 9:46 PM, G~D~Lunatic <747620...@qq.com> wrote: > in controller.log.-XX > topics not in preferred replica Map() (kafka.

Problem in SimpleProducer.java

2017-12-26 Thread Nitin Bisht
Sir I have been recently working on Kafka. I was running the SimpleProducer.java file for creating a producer but its showing me following error: *SimpleProducer.java:2: error: package org.apache.kafka.clients.producer does not exist* Please help how to solve the [roblem