SEZ9 commented on issue #9511: URL: https://github.com/apache/seatunnel/issues/9511#issuecomment-5155772093
Confirmed: the MongoDB-CDC connector was not honoring the startup mode option, forcing an initial snapshot. This has been fixed in the dev branch (label: fixed-in-dev) and will be included in the next release. As a workaround until the release, you can build SeaTunnel from the dev branch, or deduplicate downstream (e.g., upsert by _id in the sink) to mitigate duplicates from the forced snapshot. Note: 'snapshot.mode = never' is not a documented MongoDB-CDC option; 'scan.startup.mode = latest_offset' is the correct setting. Please verify against the MongoDB-CDC connector docs once the fix is released. <!-- streview-comment:39 --> -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
