[ 
https://issues.apache.org/jira/browse/FLINK-16903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072891#comment-17072891
 ] 

Timo Walther commented on FLINK-16903:
--------------------------------------

[~lzljs3620320] Thanks for elaborating. I understand your use cases. The 
question is who would read such a {{sink.parallelism}} property?  The planner 
(=globally the same property for all sinks) or table sink factory? Or we should 
we have a special {{SupportsCustomParallelism}} ability? 

> Add sink.parallelism for file system factory
> --------------------------------------------
>
>                 Key: FLINK-16903
>                 URL: https://issues.apache.org/jira/browse/FLINK-16903
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table SQL / Runtime
>            Reporter: Jingsong Lee
>            Priority: Major
>             Fix For: 1.11.0
>
>
> A single task may be writing multiple files at the same time. If the 
> parallelism is too high, it may lead to a large number of small files. If the 
> parallelism is too small, the performance is not enough. This requires that 
> the user can specify parallelism.
>  * Default is the same as upstream transformation
>  * Users can specify parallelism too.
> |‘connector.sink.parallelism’ = ...|



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to