Hello,
I'm starting to learn Beam. I took Java SDK and play with
WordCount/Starter.
I'm able to run pipeline in embedded Flink via --runner=FlinkRunner
INFO: Starting Flink Mini Cluster
However passing --flinkMaster=localhost:8081 doesn't really work due to
java.lang.IllegalArgumentException: Class
interface WordCountOptions missing a property named 'flinkMaster'.
It somewhat reasonable because
interface WordCountOptions extends PipelineOptions {
I can call withoutStrictParsing() that just bypasses check, but doesn't
pass flinkMaster argument to FlinkRunner and I've got Flink Mini Cluster
again.
Another way is to extends my custom options from FlinkPipelineOptions it
makes it work on remote cluster. Fine.
Here I'm missing something, it seems like I can't run this pipeline by
another runner, let's say Dataflow without changing the code.
How can I build a runner agnostic pipeline?
Sorry for asking a dummy question.-- Sincerely yours Mikhail Khludnev
