Livia Zhu created SPARK-50163:
---------------------------------
Summary: Fix Streaming RocksDB AcquireLock double release
Key: SPARK-50163
URL: https://issues.apache.org/jira/browse/SPARK-50163
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 3.5.3
Reporter: Livia Zhu
The RocksDB implementation will run into a race condition with the acquireLock
due to the completion listener in the following scenario:
||Task 1||Task 2||
|load() - acquire| |
|commit() - release| |
| |load() - acquire()|
|completionListener - release| |
Now RocksDB is thread unsafe as task 2 believes it holds the lock though the
lock was released.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
