Boyang Chen created KAFKA-9618:
----------------------------------
Summary: Failed state store deletion could lead to task file not
found
Key: KAFKA-9618
URL: https://issues.apache.org/jira/browse/KAFKA-9618
Project: Kafka
Issue Type: Bug
Components: streams
Reporter: Boyang Chen
Assignee: Boyang Chen
A failed deletion of a stream task directory could later lead to the impression
that the task state is still there, thus causing file not found exception as
the directory was partially deleted.
{code:java}
[2020-02-26T22:08:05-08:00]
(streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog) [2020-02-27
06:08:04,394] WARN
[stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2]
stream-thread
[stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2] task
[2_2] Failed to wiping state stores for task 2_2
(org.apache.kafka.streams.processor.internals.StreamTask)
[2020-02-26T22:08:05-08:00]
(streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog) [2020-02-27
06:08:04,394] INFO
[stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2]
[Producer
clientId=stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-2-2_2-producer,
transactionalId=stream-soak-test-2_2] Closing the Kafka producer with
timeoutMillis = 9223372036854775807 ms.
(org.apache.kafka.clients.producer.KafkaProducer)
[2020-02-26T22:08:05-08:00]
(streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog) [2020-02-27
06:08:04,411] ERROR
[stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-1]
stream-thread
[stream-soak-test-b26adb53-07e2-4013-933a-0f4bcac84c04-StreamThread-1]
Encountered the following exception during processing and the thread is going
to shut down: (org.apache.kafka.streams.processor.internals.StreamThread)
[2020-02-26T22:08:05-08:00]
(streams-soak-trunk-eos_soak_i-04ebd21fd0e0da9bf_streamslog)
org.apache.kafka.streams.errors.ProcessorStateException: Error opening store
KSTREAM-AGGREGATE-STATE-STORE-0000000040 at location
/mnt/run/streams/state/stream-soak-test/2_2/rocksdb/KSTREAM-AGGREGATE-STATE-STORE-0000000040
at
org.apache.kafka.streams.state.internals.RocksDBTimestampedStore.openRocksDB(RocksDBTimestampedStore.java:87)
at
org.apache.kafka.streams.state.internals.RocksDBStore.openDB(RocksDBStore.java:191)
at
org.apache.kafka.streams.state.internals.RocksDBStore.init(RocksDBStore.java:230)
at
org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:48)
at
org.apache.kafka.streams.state.internals.ChangeLoggingKeyValueBytesStore.init(ChangeLoggingKeyValueBytesStore.java:44)
at
org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:48)
at
org.apache.kafka.streams.state.internals.CachingKeyValueStore.init(CachingKeyValueStore.java:58)
at
org.apache.kafka.streams.state.internals.WrappedStateStore.init(WrappedStateStore.java:48)
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
