Yue Ma created FLINK-36186:
------------------------------
Summary: Speed up RocksDB close during manual compaction
Key: FLINK-36186
URL: https://issues.apache.org/jira/browse/FLINK-36186
Project: Flink
Issue Type: Bug
Components: Runtime / State Backends
Affects Versions: 2.0.0
Reporter: Yue Ma
Fix For: 2.0.0
After https://issues.apache.org/jira/browse/FLINK-26050, Flink RocksDB may
schedule manual compaction asynchronously, but if a failover occurs at this
time, RocksDB will need to wait for the manual comparison to complete before it
can close. This may result in a very long time for task cancellation, affecting
the time for task recovery.
{code:java}
// After this function call, CompactRange() or CompactFiles() will not
// run compactions and fail. Calling this function will tell outstanding
// manual compactions to abort and will wait for them to finish or abort
// before returning.
virtual void DisableManualCompaction() = 0; {code}
The solution is relatively simple. We can manually call _DisabManulCompaction_
during db close to abort the running ManulCompaction, which can accelerate db
close faster.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
