[jira] [Updated] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend
[
https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Till Rohrmann updated FLINK-8845:
-
Fix Version/s: (was: 1.5.1)
(was: 1.6.0)
1.5.0
> Use WriteBatch to improve performance for recovery in RocksDB backend
> -
>
> Key: FLINK-8845
> URL: https://issues.apache.org/jira/browse/FLINK-8845
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
>Affects Versions: 1.5.0
>Reporter: Sihua Zhou
>Assignee: Sihua Zhou
>Priority: Major
> Fix For: 1.5.0
>
>
> Base on {{WriteBatch}} we could get 30% ~ 50% performance lift when loading
> data into RocksDB.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend
[
https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sihua Zhou updated FLINK-8845:
--
Description: Base on {{WriteBatch}} we could get 30% ~ 50% performance lift
when loading data into RocksDB. (was: Base on {{ingestExternalFile()}} and
{{SstFileWriter}} provided by RocksDB, we can restore from fully checkpoint
(savepoint) in parallel. This can also be extended to incremental checkpoint
easily, but for the sake of simple, we do this in two separate tasks.)
> Use WriteBatch to improve performance for recovery in RocksDB backend
> -
>
> Key: FLINK-8845
> URL: https://issues.apache.org/jira/browse/FLINK-8845
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
>Affects Versions: 1.5.0
>Reporter: Sihua Zhou
>Assignee: Sihua Zhou
>Priority: Major
> Fix For: 1.6.0
>
>
> Base on {{WriteBatch}} we could get 30% ~ 50% performance lift when loading
> data into RocksDB.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (FLINK-8845) Use WriteBatch to improve performance for recovery in RocksDB backend
[
https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sihua Zhou updated FLINK-8845:
--
Summary: Use WriteBatch to improve performance for recovery in RocksDB
backend (was: Introduce `parallel recovery` mode for full checkpoint
(savepoint))
> Use WriteBatch to improve performance for recovery in RocksDB backend
> -
>
> Key: FLINK-8845
> URL: https://issues.apache.org/jira/browse/FLINK-8845
> Project: Flink
> Issue Type: Improvement
> Components: State Backends, Checkpointing
>Affects Versions: 1.5.0
>Reporter: Sihua Zhou
>Assignee: Sihua Zhou
>Priority: Major
> Fix For: 1.6.0
>
>
> Base on {{ingestExternalFile()}} and {{SstFileWriter}} provided by RocksDB,
> we can restore from fully checkpoint (savepoint) in parallel. This can also
> be extended to incremental checkpoint easily, but for the sake of simple, we
> do this in two separate tasks.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
