lostluck commented on issue #29213: URL: https://github.com/apache/beam/issues/29213#issuecomment-1789810026
The Go SDK automatically asserts a Splittable DoFn that returns a ProcessContinuation to be unbounded. But only SplittableDoFns. https://beam.apache.org/documentation/programming-guide/#user-initiated-checkpoint It's unclear if it's a good idea to allow non-splitable DoFns to be able to self checkpoint. The SDK would need execution side changes to enable it. But from the Beam Portability FnAPI layer, the concepts are tightly related. So at best it would be a convenience layer to things under the hood. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
