Hi Jiajun, The answers are yes & yes. Beam includes a Python-based runner that executes using the portable framework: https://github.com/apache/beam/tree/master/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py
We do currently run the full suite of Java-based compliance tests on this runner, using the portability protocols: https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_ULR/ It is intended to be the reference runner where new features receive a canonical implementation first. Hopefully it can also be a helpful reference for you. Kenn On Sun, Nov 14, 2021 at 8:38 AM Jiajun Yao <[email protected]> wrote: > Hi All, > > I'm a developer of the open source Ray project ( > https://github.com/ray-project/ray) and looking into writing a portable > python beam runner on top of Ray. I'm wondering if beam has equal support > for writing a portable python runner given that all real runners are in > Java (e.g. spark, flink). Also is there any reference implementation of > portable python runner or any materials about writing a portable runner > that I can take a look at? Thanks! > > -- > Best Wishes. > Jiajun Yao >
