je-ik commented on PR #39249: URL: https://github.com/apache/beam/pull/39249#issuecomment-4923048095
> There is a bit misunderstanding how Read works. The flow is: a) call source.split b) shuffle the splits so that we read in parallel c) call createReader only on the split sources > > From the implementation point, the initial source.split can be driven by preceding Impulse. We can then fan-out all Impulses together so that we need only single "fake" topic. Ah! I see, we plan to add the splitting in follow-up issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
