[
https://issues.apache.org/jira/browse/FLINK-36186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruan Hang updated FLINK-36186:
------------------------------
Fix Version/s: 2.3.0
(was: 2.2.0)
> Speed up RocksDB close during manual compaction
> ------------------------------------------------
>
> Key: FLINK-36186
> URL: https://issues.apache.org/jira/browse/FLINK-36186
> Project: Flink
> Issue Type: Bug
> Components: Runtime / State Backends
> Affects Versions: 2.1.0
> Reporter: Yue Ma
> Priority: Major
> Fix For: 2.3.0
>
>
> After https://issues.apache.org/jira/browse/FLINK-26050, Flink RocksDB may
> schedule manual compaction asynchronously, but if a failover occurs at this
> time, RocksDB will need to wait for the manual comparison to complete before
> it can close. This may result in a very long time for task cancellation,
> affecting the time for task recovery.
> {code:java}
> // After this function call, CompactRange() or CompactFiles() will not
> // run compactions and fail. Calling this function will tell outstanding
> // manual compactions to abort and will wait for them to finish or abort
> // before returning.
> virtual void DisableManualCompaction() = 0; {code}
> The solution is relatively simple. We can manually call
> _DisabManulCompaction_ during db close to abort the running ManulCompaction,
> which can accelerate db close faster.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
