JNSimba opened a new pull request, #64310:
URL: https://github.com/apache/doris/pull/64310

   ## Proposed changes
   
   `JdbcSourceOffsetProvider.onTaskCommitted` set `hasMoreData = false` 
whenever a task committed 0 rows / 0 bytes. A 0-row task does not mean the 
source is caught up — e.g. a large upstream transaction is still being buffered 
on the cdc_client side and a single task legitimately reads nothing. Latching 
`hasMoreData = false` there makes the scheduler believe there is no more data 
and stop dispatching tasks, which can freeze streaming for a long time until 
something else flips the flag.
   
   This removes the override. The interface default 
`SourceOffsetProvider.onTaskCommitted` is already a no-op, so behavior is 
unchanged apart from dropping the faulty latch. `hasMoreData` is still advanced 
correctly by:
   - `fetchRemoteMeta()` — sets it true when the end offset advances;
   - `hasMoreDataToConsume()` — recomputes it via `compareOffset(endOffset, 
currentOffset)`.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to