tusharagrahari opened a new pull request, #3568: URL: https://github.com/apache/iggy/pull/3568
Which issue does this PR address? Relates to #3445 Rationale MySQL is a widely used relational database with no existing Iggy source connector. This adds incremental table polling so users can stream MySQL rows into Iggy topics without CDC infrastructure. What changed? Before this PR, there was no way to source data from MySQL into Iggy. This adds a mysql_source connector plugin supporting incremental table polling via a configurable tracking column. Rows are streamed as JSON, raw bytes, or text depending on the configured payload format. Post-processing options (delete after read, mark as processed) and custom SQL queries with parameter substitution are also supported. CDC (binlog-based) is out of scope and planned as a follow-up. Local Execution - Passed - Pre-commit hooks ran AI Usage 1. Tools: Claude (Claude Code) 2. Scope: Writing unit and integration tests, thinking through edge cases, and pair-programming during development. 3. Verification: Ran all tests locally against a real MySQL container, validated end-to-end polling flow, and ran the full pre-commit hook suite. 4. Yes, I can explain every line of code if asked. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
