zhangshenghang opened a new pull request, #11486:
URL: https://github.com/apache/seatunnel/pull/11486

   ## What does this PR do?
   
   Fixes #11471.
   
   This change completes a batch Kafka split when the consumer position reaches 
its stopping offset, including when Kafka has advanced the position through 
transaction control records that are not returned by `poll()`.
   
   ## Why is this change needed?
   
   The previous completion check only examined the last record returned by 
`poll()`. For transactional topics, a control record can advance the Kafka 
position without appearing in that record list, leaving the batch job running 
after all visible records are processed.
   
   ## How was this tested?
   
   - Added a regression test for a consumer position advanced past a 
transaction control record.
   - `./mvnw -q -pl seatunnel-connectors-v2/connector-kafka 
-Dtest=KafkaPartitionSplitReaderTest,KafkaSourceSplitEnumeratorTest test`
   - `./mvnw -q -DskipTests verify`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to