[ 
https://issues.apache.org/jira/browse/FLINK-15526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jingsong Lee updated FLINK-15526:
---------------------------------
        Parent: FLINK-17778
    Issue Type: Sub-task  (was: Bug)

> Add RollingPolicy to PartitionWriters
> -------------------------------------
>
>                 Key: FLINK-15526
>                 URL: https://issues.apache.org/jira/browse/FLINK-15526
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Table SQL / Runtime
>            Reporter: Jingsong Lee
>            Priority: Major
>             Fix For: 1.11.0
>
>
> Now our partition writers will write a whole file in a checkpoint if there is 
> no partition change.
> Sometimes this file is too big, it is better to add a RollingPolicy for 
> controlling file size.
> We can just add policy controlled by file size and record number.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to