kennknowles commented on pull request #16773: URL: https://github.com/apache/beam/pull/16773#issuecomment-1040683079
One problem here is that there is no batch implementation for `UnboundedSource` and also batch execution of an unbounded splittable `DoFn` (where each element may produce unbounded output. This is an example where finite != bounded. It is up to the IO to produce a bounded PCollection, and the runner to figure out how to execute it. But batch Dataflow will never be able to evaluate an unbounded PCollection. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
