YolandaMDavis edited a comment on issue #3854: NIFI-6819: Add KafkaRecordSink implementations for Kafka 1 and 2 URL: https://github.com/apache/nifi/pull/3854#issuecomment-548423670 @mattyb149 Happened to run across an interesting error (which I think is unrelated to PR and may be an knwon issue with Kafka api). My test cluster was initially misconfigured where I had a replication factor of 3 set for the test topic yet only had one broker configured. The Kafka Sink appeared to send data, according to debug, however Consume Kafka Record and the command line consumer could not retrieve any messages. Looking into the error log I saw the issue, however I was surprised that this didn't appear in NiFi logs upon sending of the record: This error can be ignored if the cluster is starting up and not all brokers are up yet. 2019-10-31 14:16:45,149 ERROR kafka.server.KafkaApis: [KafkaApi-72] Number of alive brokers '1' does not meet the required replication factor '3' for the offsets topic (configured via 'offsets.topic.replication.factor'). This error can be ignored if the cluster is starting up and not all brokers are up yet. There is a JIRA I believe is related here: https://issues.apache.org/jira/browse/KAFKA-5666 but just want to confirm if this is a potential issue that can be ignored or documented?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
