[
https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16389179#comment-16389179
]
Sihua Zhou commented on FLINK-8845:
-----------------------------------
Event though, {{SstFileWriter}} could not help us to improve performance for
loading data into RocksDB, but the {{WriteBatch}} can do that, after a
benchmark, I found with using {{WriteBatch}}, it help us to get (30% ~ 50%)
outperformance than using {{RocksDB.put()}}. So, I would like to wipe this
issue and change it to "Using WriteBatch to improve performance for recovery in
RocksDB backend".
> Introduce `parallel recovery` mode for full checkpoint (savepoint)
> -------------------------------------------------------------------
>
> Key: FLINK-8845
> URL: https://issues.apache.org/jira/browse/FLINK-8845
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
> Affects Versions: 1.5.0
> Reporter: Sihua Zhou
> Assignee: Sihua Zhou
> Priority: Major
> Fix For: 1.6.0
>
>
> Base on {{ingestExternalFile()}} and {{SstFileWriter}} provided by RocksDB,
> we can restore from fully checkpoint (savepoint) in parallel. This can also
> be extended to incremental checkpoint easily, but for the sake of simple, we
> do this in two separate tasks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
