Deepak Goyal created KAFKA-6976: ----------------------------------- Summary: Kafka Streams instances going in to DEAD state Key: KAFKA-6976 URL: https://issues.apache.org/jira/browse/KAFKA-6976 Project: Kafka Issue Type: New Feature Components: streams Reporter: Deepak Goyal
We are using Kafka 0.10.2.0, kafka streams 1.1.0. We have Kafka Cluster of 16 machines, and topic that is being consumed by Kafka Streams has 256 partitions. We spawned 400 instances of Kakfa Streams application. We see that all of the StreamThreads go in to DEAD state. {quote}{{[2018-05-25 05:59:29,282] INFO stream-thread [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7-StreamThread-1] State transition from PENDING_SHUTDOWN to DEAD (org.apache.kafka.streams.processor.internals.StreamThread) [2018-05-25 05:59:29,282] INFO stream-client [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7] State transition from REBALANCING to ERROR (org.apache.kafka.streams.KafkaStreams) [2018-05-25 05:59:29,282] WARN stream-client [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7] All stream threads have died. The instance will be in error state and should be closed. (org.apache.kafka.streams.KafkaStreams) [2018-05-25 05:59:29,282] INFO stream-thread [ksapp-19f923d7-5f9e-4137-b79f-ee20945a7dd7-StreamThread-1] Shutdown complete (org.apache.kafka.streams.processor.internals.StreamThread)}} {quote} Please note that when we have only 100 kafka instances, things are working as expected. We see that instances are consuming messages from topic. -- This message was sent by Atlassian JIRA (v7.6.3#76005)