?????? flink??mysql????

Tue, 26 Oct 2021 01:56:46 -0700 

??????????????
?????????????????????????????????????????????? flush ?? mysql ????????


????????1.11.2??????flink 
sql????????????????????????????????BufferReduceStatementExecutor????????????????????????????????????????????????flush??????????????????GenericJdbcSinkFunction
????????????????????????????????????????????????




------------------ ???????? ------------------
??????:                                                                         
                                               "user-zh"                        
                                                            
<[email protected]&gt;;
????????:&nbsp;2021??10??26??(??????) ????10:31
??????:&nbsp;"flink??????????"<[email protected]&gt;;

????:&nbsp;Re: flink??mysql????



Hi??

?????????????????????????????????????????????? flush ?? mysql ??????


JdbcDynamicTableSink ?????????? sink function
?????????????????????? GenericJdbcSinkFunction???????? snapshotState ???? 
snapshot ??????????????
jdbc ???????????????? sql ?????? batch ?????????????????????? 
JdbcBatchStatementExecutor ??????????

?? mysql ?? qps ????????????????????


jdbc connector ?????? with ???????????? flush ???????????? 
sink.buffer-flush.interval
?????????????????????? flush?????????????? 
100?????????????????????????????????????????????????????? [1]??

???????? sum ?????????????? 1000??/s??????????????????????????????????


checkpoint ???????????????????????????????????????????????? sink ???????????? 
checkpoint
???????????????????????????????? checkpoint ?????????????????????????? gc 
?????????????????????????????? sql ??????

[1]
https://ci.apache.org/projects/flink/flink-docs-master/zh/docs/connectors/table/jdbc/#sink-buffer-flush-max-rows

a <[email protected]&gt; ??2021??10??26?????? ????9:49??????

&gt;
&gt; 
????????????????flink??mysql????????????sink????????JdbcDynamicTableSink??????????????????????????checkpoint??????????????????????????1.??????????????????????????????????????????????flush??mysql??????
&gt;
&gt; 
2.??????????mysql??qps??????????????????????????????sum??????????????1000??/s????????????????????????????????????????????????????????????

回复