[ 
https://issues.apache.org/jira/browse/FLINK-21688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17311244#comment-17311244
 ] 

xiaogang zhou commented on FLINK-21688:
---------------------------------------

[~yunta] Thx for explanation, will try to send mail to user-mailing list first 
in the future.

 

As I mentioned above, when restore with rescaling, the "high thread " of the 
rocksdb is always can slow down the iteration process. because the 
setIncreaseParallelism set the thread number to 1. Do we need to do some work 
on it?

> we use setIncreaseParallelism function, can cause slow flush in restore
> -----------------------------------------------------------------------
>
>                 Key: FLINK-21688
>                 URL: https://issues.apache.org/jira/browse/FLINK-21688
>             Project: Flink
>          Issue Type: Improvement
>          Components: Runtime / State Backends
>    Affects Versions: 1.11.3
>            Reporter: xiaogang zhou
>            Priority: Major
>
> we use setIncreaseParallelism function, can cause slow flush in restore 
> rescaling case. As this function limits the HIGH threads to 1.
>  
> Why not set the MAX jobs to 40, which will offer more flush thread to enable 
> a fast recovery



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to