Hi Kenneth,

Thanks, it’s great to hear that!

On Tue, Nov 16, 2021 at 9:35 AM Kenneth Knowles <[email protected]> wrote:

> Hi Jiajun,
>
> The answers are yes & yes. Beam includes a Python-based runner that
> executes using the portable framework:
> https://github.com/apache/beam/tree/master/sdks/python/apache_beam/runners/portability/fn_api_runner/fn_runner.py
>
> We do currently run the full suite of Java-based compliance tests on this
> runner, using the portability protocols:
> https://ci-beam.apache.org/job/beam_PostCommit_Java_ValidatesRunner_ULR/
>
> It is intended to be the reference runner where new features receive a
> canonical implementation first. Hopefully it can also be a helpful
> reference for you.
>
> Kenn
>
> On Sun, Nov 14, 2021 at 8:38 AM Jiajun Yao <[email protected]> wrote:
>
>> Hi All,
>>
>> I'm a developer of the open source Ray project (
>> https://github.com/ray-project/ray) and looking into writing a portable
>> python beam runner on top of Ray. I'm wondering if beam has equal support
>> for writing a portable python runner given that all real runners are in
>> Java (e.g. spark, flink). Also is there any reference implementation of
>> portable python runner or any materials about writing a portable runner
>> that I can take a look at? Thanks!
>>
>> --
>> Best Wishes.
>> Jiajun Yao
>>
> --
Best Wishes.

Jiajun Yao

Reply via email to