ifndef-SleePy commented on PR #8671: URL: https://github.com/apache/paimon/pull/8671#issuecomment-5200052014
One more addition: the most important reason coordinator commit introduces end input is for testability. In most of PIP-30's scenarios, end input is never triggered, so increasing the complexity of the main logic just to support end input doesn't seem worthwhile. Based on our internal practice, without end input support it's fairly hard to implement the failover IT cases: while injecting random task failover and global failover, we need to verify that both the Flink and Paimon jobs recover normally and that data consistency holds against a fixed dataset. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
