Hi folks, we have a pipeline for Dataflow and our Google cloud environment has a private network (where the pipeline should run, this network interconnect via an IP-sec to an AWS environment where the Kafka brokers are running).
We have found that in order to be able to submit the pipeline we have to do it from a machine that has access to the Kafka brokers. Is there a way to avoid that? Why KafkaIO cannot defer the communication to the brokers after the pipeline its on the worker node? Thanks and regards, JC
