spetz commented on issue #2940: URL: https://github.com/apache/iggy/issues/2940#issuecomment-4085167060
This is a typical challenge, quite often solved by introducing some sort of outbox pattern, however, in case of the connectors, I think that we could have some sort of error callback and/or retry configuration on what to do when such things happens. From the configuration perspective, the user could decide whether the partial success should just log an error and move on, stop the processing, retry it etc. and this would be applied to both, sink & sources if possible. If we were to introduce an error callback, it could be additionally implemented per specific connector with even more advanced configuration for dealing with failures. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
