Abacn opened a new pull request, #37689:
URL: https://github.com/apache/beam/pull/37689
Part of #28248
Resolves crash loop when worker restart (same pipeline).
* Move startTime recording into setup to fix NPE in restarted worker
* Fix DebeziumIO poll loop not exiting when record list isn't empty
* Make pollTimeout configurable
**Please** add a meaningful description for your change here
Tested on Dataflow runner with following error injection procedure:
After pipeline started consuming data, ssh into worker machine and kill java
process
logs seen:
```
DEFAULT 2026-02-23T21:24:32.670187985Z
--------------{"metadata":{"connector":"postgresql","version":"3.1.3.Final","name":"beam-debezium-connector","database":"test","schema":"public","table":"test_table"},"before":null,"after":{"fields":{"name":"abc","id":1}}}------------
DEFAULT 2026-02-23T21:24:32.671735590Z
--------------{"metadata":{"connector":"postgresql","version":"3.1.3.Final","name":"beam-debezium-connector","database":"test","schema":"inventory","table":"customers"},"before":null,"after":{"fields":{"last_name":"Thomas","id":1001,"first_name":"Sally","email":"[email protected]"}}}------------
...
WARNING 2026-02-23T21:25:33.613167Z [severity: WARNING] Completing Logging
stream for SDK harness sdk-0-0. This indicates sdk issues unless the job is
being terminated.
CRITICAL 2026-02-23T21:25:33.613200197Z [severity: CRITICAL] Java exited:
exit status 143
CRITICAL 2026-02-23T21:25:33.613255955Z [severity: CRITICAL] Completing
background processes before exiting...
...
DEFAULT 2026-02-23T21:25:51.338688576Z SDK Fn Harness started
```
confirmed worker does not read from the beginning again. Then add some rows,
see it is consumed:
```
DEFAULT 2026-02-23T21:26:48.739887663Z
--------------{"metadata":{"connector":"postgresql","version":"3.1.3.Final","name":"beam-debezium-connector","database":"test","schema":"public","table":"test_table"},"before":null,"after":{"fields":{"name":"def","id":2}}}------------
INFO 2026-02-23T21:26:49.405Z Debezium ServiceRegistry stopped.
...
DEFAULT 2026-02-23T21:27:44.665167369Z
--------------{"metadata":{"connector":"postgresql","version":"3.1.3.Final","name":"beam-debezium-connector","database":"test","schema":"public","table":"test_table"},"before":null,"after":{"fields":{"name":"ghi","id":3}}}------------
INFO 2026-02-23T21:27:45.298Z Debezium ServiceRegistry stopped.
```
------------------------
Thank you for your contribution! Follow this checklist to help us
incorporate your contribution quickly and easily:
- [ ] Mention the appropriate issue in your description (for example:
`addresses #123`), if applicable. This will automatically add a link to the
pull request in the issue. If you would like the issue to automatically close
on merging the pull request, comment `fixes #<ISSUE NUMBER>` instead.
- [ ] Update `CHANGES.md` with noteworthy changes.
- [ ] If this contribution is large, please file an Apache [Individual
Contributor License Agreement](https://www.apache.org/licenses/icla.pdf).
See the [Contributor Guide](https://beam.apache.org/contribute) for more
tips on [how to make review process
smoother](https://github.com/apache/beam/blob/master/CONTRIBUTING.md#make-the-reviewers-job-easier).
To check the build health, please visit
[https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md](https://github.com/apache/beam/blob/master/.test-infra/BUILD_STATUS.md)
GitHub Actions Tests Status (on master branch)
------------------------------------------------------------------------------------------------
[](https://github.com/apache/beam/actions?query=workflow%3A%22Build+python+source+distribution+and+wheels%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Python+Tests%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Java+Tests%22+branch%3Amaster+event%3Aschedule)
[](https://github.com/apache/beam/actions?query=workflow%3A%22Go+tests%22+branch%3Amaster+event%3Aschedule)
See [CI.md](https://github.com/apache/beam/blob/master/CI.md) for more
information about GitHub Actions CI or the [workflows
README](https://github.com/apache/beam/blob/master/.github/workflows/README.md)
to see a list of phrases to trigger workflows.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
