Jark Wu commented on FLINK-13707:

Hi [~stukid], just want to make sure the logic of default max parallelism. I 
find the default max parallelism is computed [in this 

MathUtils.roundUpToPowerOfTwo(operatorParallelism + (operatorParallelism / 2)),

The max parallelism is {{roundUpToPowerOfTwo(1.5 * operatorParallelism)}}, so 
we have a safe range to increase the parallelism. 

Whatever,  I think it makes sense to have a global default max parallelism 

> Make  max parallelism configurable
> ----------------------------------
>                 Key: FLINK-13707
>                 URL: https://issues.apache.org/jira/browse/FLINK-13707
>             Project: Flink
>          Issue Type: New Feature
>          Components: API / DataStream
>            Reporter: xuekang
>            Priority: Minor
> For now, if a user set parallelism larger than 128, and does not set max 
> parallelism explicitly, the system will compute a max parallelism, which is 
> 1.5 * parallelism.  When the job changes the parallelism and recover from a 
> savepoint, there may be some problem when restoring states from the 
> savepoint, as the number of key groups changed.
> To avoid this problem, and trying not to modify the code of existing jobs,  
> we want to configure the default max parallelism in flink-conf.yaml, but it 
> is not configurable now.
> Should we make it configurable? Any comments would be appreciated.

This message was sent by Atlassian JIRA

Reply via email to