mutianf opened a new pull request, #39820:
URL: https://github.com/apache/beam/pull/39820

   **Stacked on #39792** — please review/merge that PR first. Until #39792 
merges into master, the diff below includes its user-agent commit as well; only 
the second commit (`Require google-cloud-bigtable>=2.42.0 and test write error 
surfacing`) belongs to this PR.
   
   ### What
   - Bump the minimum `google-cloud-bigtable` to `>=2.42.0,<3`. 2.42.0 improves 
`MutationsBatcher` error handling so that errors raised during async flushes 
are surfaced instead of swallowed.
   - Add `_BigTableWriteFn` write tests asserting that batch errors are 
surfaced (and thus fail the bundle, so the runner retries) from:
     - the async flush path,
     - the buffered-row flush at `finish_bundle()`/`close()`,
     - `close()` itself.
   
   ### Why
   Previously a batch-level failure during an asynchronous flush could be 
dropped without failing the bundle. Requiring 2.42.0 and adding these 
regression tests guards the error-surfacing behavior end-to-end through Beam.
   
   ### Note
   The new tests require `google-cloud-bigtable>=2.42.0` to be resolvable, so 
this should land once 2.42.0 is released.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to