openinx opened a new issue #1403:
URL: https://github.com/apache/iceberg/issues/1403


   In this patch, we have several minor issues to follow up for flink sink 
connector:
   
   * Support multiple iceberg sinks in the same flink job. 
[discussion](https://github.com/apache/iceberg/pull/1185/files#r479448928).
   * provide a method to set user-provided write parallelism in 
FlinkSink#Builder. 
   * The netflix team have improved their flink sink by buffering all the 
uncommitted data files in a separate manifest file to reduce the state size.  
It would be really helpful if users put their data files and metstore in two 
different cloud region, because we could keep the job going even if  we fail to 
commit to iceberg sometimes.  
[discussion](https://github.com/apache/iceberg/pull/1185/files#r478772412)


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to