At this point in time I would recommend that you build a runner that executes pipelines using only the portability layer like Flink/Samza/Spark [1,2,3].
1: https://github.com/apache/beam/blob/master/runners/flink/src/main/java/org/apache/beam/runners/flink/FlinkPortablePipelineTranslator.java 2: https://github.com/apache/beam/blob/master/runners/samza/src/main/java/org/apache/beam/runners/samza/translation/SamzaPortablePipelineTranslator.java 3: https://github.com/apache/beam/blob/master/runners/spark/src/main/java/org/apache/beam/runners/spark/translation/SparkBatchPortablePipelineTranslator.java On Sat, Aug 15, 2020 at 12:50 PM Saikat Maitra <saikat.mai...@gmail.com> wrote: > Hi, > > I have been working on implementing the Apache Ignite Runner to run Apache > Beam pipeline. I have created IgniteRunner and IgnitePipelineOptions. I > have implemented the normalize pipeline method and currently working on run > method implementation for Pipeline and IgnitePipelineTranslator. > > Jira : https://issues.apache.org/jira/browse/BEAM-9045 > > PR : https://github.com/apache/beam/pull/12593 > > Please review and feel free to share any feedback or questions. > > Regards, > Saikat >
