Hi guys, We are using Flink 1.0-SNAPSHOT with Kafka 0.9 Consumer and we have not been able to retrieve data from our Kafka Cluster. The DEBUG data reports the following:
10:53:24,365 DEBUG org.apache.kafka.clients.NetworkClient - Sending metadata request ClientRequest(expectResponse=true, callback=null, request=RequestSend(header={api_key=3,api_version=0,correlation_id=1673,client_id=flink_test}, body={topics=[stream_test_3]}), isInitiatedByNetworkClient, createdTimeMs=1455702804364, sendTimeMs=0) to node 35 10:53:24,398 DEBUG org.apache.kafka.clients.Metadata - Updated cluster metadata version 838 to Cluster(nodes = [Node(41, ip-XXXX.eu-west-1.compute.internal, 9092), Node(35, ip-XXXX.eu-west-1.compute.internal, 9092), Node(87, ip-XXXX.eu-west-1.compute.internal, 9092)], partitions = [Partition(topic = stream_test_3, partition = 0, leader = 87, replicas = [87,41,35,], isr = [87,41,35,], Partition(topic = stream_test_3, partition = 1, leader = 35, replicas = [35,41,87,], isr = [35,41,87,], Partition(topic = stream_test_3, partition = 4, leader = 87, replicas = [87,41,35,], isr = [87,41,35,], Partition(topic = stream_test_3, partition = 3, leader = 35, replicas = [35,87,41,], isr = [35,87,41,], Partition(topic = stream_test_3, partition = 2, leader = 41, replicas = [41,87,35,], isr = [41,87,35,]]) 10:53:24,398 DEBUG org.apache.kafka.clients.consumer.internals.AbstractCoordinator - Issuing group metadata request to broker 35 10:53:24,432 DEBUG org.apache.kafka.clients.consumer.internals.AbstractCoordinator - Group metadata response ClientResponse(receivedTimeMs=1455702804432, disconnected=false, request=ClientRequest(expectResponse=true, callback=org.apache.kafka.clients.consumer.internals.ConsumerNetworkClient$RequestFutureCompletionHandler@63b68d94, request=RequestSend(header={api_key=10,api_version=0,correlation_id=1674,client_id=flink_test}, body={group_id=test}), createdTimeMs=1455702804398, sendTimeMs=1455702804398), responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}) We receive this message all the time. What we don't know understand is this "responseBody={error_code=15,coordinator={node_id=-1,host=,port=-1}}", as we see an error_code we suppose there was a problem. Our Kafka cluster works and we have some clients extracting data from it, so we don't know if this could be a Kafka issue or a Flink issue. Does anyone know, or understand, this response we are getting from Kafka? Thanks.