[ 
https://issues.apache.org/jira/browse/FLINK-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sihua Zhou updated FLINK-8845:
------------------------------
    Description: Base on {{WriteBatch}} we could get 30% ~ 50% performance lift 
when loading data into RocksDB.  (was: Base on {{ingestExternalFile()}} and 
{{SstFileWriter}} provided by RocksDB, we can restore from fully checkpoint 
(savepoint) in parallel. This can also be extended to incremental checkpoint 
easily, but for the sake of simple, we do this in two separate tasks.)

> Use WriteBatch to improve performance for recovery in RocksDB backend
> ---------------------------------------------------------------------
>
>                 Key: FLINK-8845
>                 URL: https://issues.apache.org/jira/browse/FLINK-8845
>             Project: Flink
>          Issue Type: Improvement
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.5.0
>            Reporter: Sihua Zhou
>            Assignee: Sihua Zhou
>            Priority: Major
>             Fix For: 1.6.0
>
>
> Base on {{WriteBatch}} we could get 30% ~ 50% performance lift when loading 
> data into RocksDB.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to