GitHub user Susmit07 added a comment to the discussion: Pekko Connector Fault Tolerance Processing
Yes I am going to take s3 route, will have a marker file per directory level, which will have all files metadata IN_PROGRESS, COMPLETED, FAILED GitHub link: https://github.com/apache/pekko-connectors/discussions/834#discussioncomment-10776378 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
