[ 
https://issues.apache.org/jira/browse/FLINK-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sihua Zhou updated FLINK-8602:
------------------------------
    Description: 
Currently, when enable incremental checkpoint, if user change the parallelism 
then ```hasExtraKeys``` may be ```true```. If this occur, flink will loop all 
rocksdb instance and iterator all data to fetch the data that fails into 
current ```KeyGroupRange````, this can be improved because

 if a state handle's ```KeyGroupRange``` is fully covered by the current 
```KeyGroupRange```, we can open the rocksdb it corresponds to directly.

 

  was:
Currently, when enable incremental checkpoint, if user change the parallelism 
then ```hasExtraKeys``` may be ```true```. If this occur, flink will loop all 
rocksdb instance and iterator all data to fetch the data that fails into 
current ```KeyGroupRange````, this can be improved because

 if a state handle's ```KeyGroupRange``` is fully covered by the current 
```KeyGroupRange```, we can open the rocksdb it corresponded directly.

 


> Accelerate recover from failover when use incremental checkpoint
> ----------------------------------------------------------------
>
>                 Key: FLINK-8602
>                 URL: https://issues.apache.org/jira/browse/FLINK-8602
>             Project: Flink
>          Issue Type: Improvement
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.4.0
>            Reporter: Sihua Zhou
>            Assignee: Sihua Zhou
>            Priority: Major
>
> Currently, when enable incremental checkpoint, if user change the parallelism 
> then ```hasExtraKeys``` may be ```true```. If this occur, flink will loop all 
> rocksdb instance and iterator all data to fetch the data that fails into 
> current ```KeyGroupRange````, this can be improved because
>  if a state handle's ```KeyGroupRange``` is fully covered by the current 
> ```KeyGroupRange```, we can open the rocksdb it corresponds to directly.
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to