openinx commented on issue #2172: URL: https://github.com/apache/iceberg/issues/2172#issuecomment-771324860
Yes, the flink sink will commit those files for every checkpoint interval actually. If you can not see the newly committed data files in S3, then I guess it should have some problems. Did you recover the flink job from a savepoint ? There's a bug that will cause the similar issue, you might want to read the issue: https://github.com/apache/iceberg/issues/2033#issue-779721770, and the current solution (before release the next flink) is here: https://github.com/apache/iceberg/issues/2033#issuecomment-769952948 If not the case, do you have some logs that could help to dig into this problem? Java stacktrace ? Thanks. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
