Aireed opened a new issue, #9753:
URL: https://github.com/apache/iceberg/issues/9753
### Apache Iceberg version
1.1.0
### Query engine
Flink
### Please describe the bug 🐞
In SnapshotProducer::commit call， if `ops.refresh()` failed, table's
metadata won't be refresh to latest although new snapshot has been commited.
In this situation, we will lost the data in this commit.
Wouldn't it be better to throw the exception of `ops.current()` and make
this commit fail?
@openinx PTAL
The situation in which I encountered problems is as follows:
1、in checkpoint 5 stage, iceberg commit a new snapshot with sequence number
5.
2、in checkpoint 6 stage, iceberg commit a new snapshot with sequence number
6, and ops.refresh() failed, but flink task doesn't failover and continue to
execute.
3、in checkpoint 7 stage, iceberg still commit a new snapshot with **sequence
number 6**。
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
