[GitHub] [iceberg] WenfengJ opened a new issue #2693: flink sink to iceberg with different data

Mon, 14 Jun 2021 00:17:46 -0700 


WenfengJ opened a new issue #2693:
URL: https://github.com/apache/iceberg/issues/2693


   Hi,
   I use  Flinksink to iceberg table,if data are offline data,the table is ok, 
but if data is realtime ,for example .
   kafka,mysql cdc.....,the table created ,but data not commit . 
   
   
   
![微信截图_20210611135925](https://user-images.githubusercontent.com/34698232/121638628-dc626e00-cabd-11eb-821f-ec7f5f5786d3.png)
   
   
![2](https://user-images.githubusercontent.com/34698232/121638623-da001400-cabd-11eb-9fff-5e56e4f878f0.png)
   
![3](https://user-images.githubusercontent.com/34698232/121638624-db314100-cabd-11eb-8090-9dbe33799e67.png)
   
![4](https://user-images.githubusercontent.com/34698232/121638627-dbc9d780-cabd-11eb-9d0b-96cca1756dd9.png)
   
   
   ```
      env.setStreamTimeCharacteristic(TimeCharacteristic.EventTime);
           env.enableCheckpointing(6000);
           env.setMaxParallelism(1);
   
   ......   (source is realtime data or offline data )
   
        FlinkSink.
                   forRow(source, SimpleDataUtil.FLINK_SCHEMA)
                   .table(table)
                   .tableLoader(tableLoader)
                   .overwrite(false)
                   .tableSchema(SimpleDataUtil.FLINK_SCHEMA)
                   .writeParallelism(1)
                   .build();  
   ```
   As shown in the figure:


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to