openinx commented on issue #3112: URL: https://github.com/apache/iceberg/issues/3112#issuecomment-964921835
> The problem is that TestFlinkIcebergSink.testTwoSinksInDisjointedDAG has two disjointed pipelines. The extra +2 checkpoints waiting broke in this situation where part of the DAG has finished. If only one of the two iceberg pipelines has finished the checkpoint state process (while the another haven't), shouldn't it wait another pipeline to finish its checkpoint ? and once all of them finished then trigger the operator's `notifyCheckpointComplete`. Finally, the two pipelines should increment its `numCheckpointsComplete` to the target value in my thought. So did I miss something or misunderstand the case ? @stevenzwu , could you explain more details about the root cause that make it flakey ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
