[ https://issues.apache.org/jira/browse/KAFKA-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Boyang Chen resolved KAFKA-10011. --------------------------------- Resolution: Fixed > lockedTaskDirectories should be cleared when task gets closed dirty in > HandleLostAll > ------------------------------------------------------------------------------------ > > Key: KAFKA-10011 > URL: https://issues.apache.org/jira/browse/KAFKA-10011 > Project: Kafka > Issue Type: Bug > Reporter: Boyang Chen > Assignee: Boyang Chen > Priority: Major > > Tasks who get closed in handleLostAll don't clear out their position inside > lockedTaskDirectories, which causes an illegal state afterwards: > {code:java} > [2020-05-17T06:21:54-07:00] > (streams-soak-trunk-eos-beta_soak_i-0b021dbf00474b6aa_streamslog) [2020-05-17 > 13:21:54,127] ERROR > [stream-soak-test-150cf9ae-793b-4aac-bea0-0fb61d228b39-StreamThread-3] > stream-thread > [stream-soak-test-150cf9ae-793b-4aac-bea0-0fb61d228b39-StreamThread-3] > Encountered the following exception during processing and the thread is going > to shut down: (org.apache.kafka.streams.processor.internals.StreamThread) > [2020-05-17T06:21:54-07:00] > (streams-soak-trunk-eos-beta_soak_i-0b021dbf00474b6aa_streamslog) > org.apache.kafka.streams.errors.ProcessorStateException: task directory > [/mnt/run/streams/state/stream-soak-test/3_1] doesn't exist and couldn't be > created > at > org.apache.kafka.streams.processor.internals.StateDirectory.directoryForTask(StateDirectory.java:112) > at > org.apache.kafka.streams.processor.internals.StateDirectory.checkpointFileFor(StateDirectory.java:121) > at > org.apache.kafka.streams.processor.internals.TaskManager.getTaskOffsetSums(TaskManager.java:498) > at > org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor.subscriptionUserData(StreamsPartitionAssignor.java:239) > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.metadata(ConsumerCoordinator.java:222) > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.sendJoinGroupRequest(AbstractCoordinator.java:560) > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.initiateJoinGroup(AbstractCoordinator.java:495) > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded(AbstractCoordinator.java:417) > at > org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup(AbstractCoordinator.java:358) > at > org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll(ConsumerCoordinator.java:506) > at > org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded(KafkaConsumer.java:1265) > at > org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1231) > at > org.apache.kafka.clients.consumer.KafkaConsumer.poll(KafkaConsumer.java:1206) > at > org.apache.kafka.streams.processor.internals.StreamThread.pollRequests(StreamThread.java:770) > at > org.apache.kafka.streams.processor.internals.StreamThread.runOnce(StreamThread.java:630) > at > org.apache.kafka.streams.processor.internals.StreamThread.runLoop(StreamThread.java:550) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)