Hi, Assume I have a source, stateful operator and a sink operator:
Source -> Batch data and upload -> Push message to sink -> Sink runs insert / merges into a data warehouse. I am wondering, what would happen in case the data is uploaded from the stateful operator, and has not yet reached the sink and a crash happens for various reasons. Does Flink snapshot internal buffers periodically with checkpoints? Would messages in flight in internal buffers be restored? -- Best Regards, Yuval Itzchakov.