DanielLeens commented on issue #11472: URL: https://github.com/apache/seatunnel/issues/11472#issuecomment-5009051442
Thanks for the extra validation across both Kafka -> JDBC and JDBC -> JDBC, and for separating worker failover from master-only failover. That makes the scope much clearer. This looks like a real Zeta metrics bug rather than a source-specific issue. After checking the REST aggregation path, the finished-job metrics endpoint is still fundamentally summing task metric snapshots, while your reproductions show the successful final data is correct but the finished counts still include work from canceled / retried task attempts. That matches the symptom very well: `SinkCommittedCount` reflects the real completed result, but `SourceReceivedCount`, `SinkWriteCount`, and `IntermediateQueueSize` remain inflated after worker-attempt replacement. So the likely problem is in metrics aggregation / stale task-attempt cleanup after worker failover, not in Kafka source semantics. This is worth keeping open as a confirmed bug. We've labeled this as `help wanted` — contributions are very welcome. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
