The Apache Flink runner does not yet support executing non Java Apache Beam pipelines. There is work[1] underway to make it so that Apache Flink can run Apache Beam pipelines written in any Apache Beam SDK.
1: https://issues.apache.org/jira/browse/BEAM-2889 On Mon, Jan 15, 2018 at 9:42 AM, Sreeram Boyapati < [email protected]> wrote: > Hello, > > > I have used python sdk to write my beam pipelines. I am using celery as a > wrapper over direct runner. > I want to use flink runner to parallelise my load. > > As per the documentation, you need to give your job as a jar file for > flink runner. > > Can you point me to any resources where I can use both apache beam python > sdk and apache flink? > Any samples? >
