Hey As far as I know you can generate a dataflow template out of your beam code by specifying an option on command line? I am running this CMD and once template is generated I kick off a dflow job via console by pointing at it
python -m edgar_main --runner=dataflow --project=datascience-projets --template_location=gs://<your bucket> Hth On Sat, Apr 4, 2020, 9:52 AM Xander Song <[email protected]> wrote: > I am attempting to write a custom Dataflow Template using the Apache Beam > Python SDK, but am finding the documentation difficult to follow. Does > anyone have a minimal working example of how to write and deploy such a > template? > > Thanks in advance. >
