Hi, part of our work that needs to be done to create tests for Core Apache Beam operations is to enable both batch and streaming testing scenarios in all SDKs (not only Java, so lot's of portability usage here). I gathered some thoughts on how (I think) this could be done at the current state of Beam:
https://s.apache.org/portable-load-tests I added some questions at the end of the doc but I will paste them here too for visibility: - What is the status of Cross Language Support for Go SDK? Is it non-trivial to enable such support (if it doesn't exist yet)? - According to other contributors knowledge/experience: I noticed that streaming with KafkaIO is currently supported by wrapping the ExternalTransform in Python SDK. Do you think that streaming pipelines will "just work" with the current state of portability if I do the same for UnboundedSyntheticSource or is there something else missing? BTW: great to see Cross Language Support happening. Thanks for doing this! :) Thanks, Łukasz
