?????? flink-1.11 ddl ????json ??????????hdfs????

Fri, 17 Jul 2020 02:27:28 -0700 

tks??????????????????????????????30m,??????????????????m??????????






------------------ ???????? ------------------
??????:                                                                         
                                               "user-zh"                        
                                                            
<[email protected]&gt;;
????????:&nbsp;2020??7??17??(??????) ????4:57
??????:&nbsp;"user-zh"<[email protected]&gt;;

????:&nbsp;Re: flink-1.11 ddl ????json ??????????hdfs????



Hi,

????[1]??????????????csv??json??????????????rolling????????????????????????????checkpoint????rolling????

NOTE: For row formats (csv, json), you can set the parameter
sink.rolling-policy.file-size or sink.rolling-policy.rollover-interval in
the connector properties and parameter execution.checkpointing.interval in
flink-conf.yaml together if you don??t want to wait a long period before
observe the data exists in file system. For other formats (avro, orc), you
can just set parameter execution.checkpointing.interval in flink-conf.yaml.

??????????????????????rolling????????????sink.rolling-policy.rollover-interval??sink.rolling-policy.check-interval

[1]
https://ci.apache.org/projects/flink/flink-docs-master/dev/table/connectors/filesystem.html#rolling-policy

Best,
Jingsong

On Fri, Jul 17, 2020 at 4:25 PM kcz <[email protected]&gt; wrote:

&gt; ????????
&gt;
&gt; 
https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/table/connectors/filesystem.html#full-example
&gt; 
??parquet??????json??????chk??????????????????????????in-progress????????????????????????????
&gt; parquet??????????success????



-- 
Best, Jingsong Lee

回复