Hi, AFAIK, Portable Spark runner supports Streaming mode [1] (with some exceptions, like Side inputs and States/Timers) and Beam provides a portable Kafka connector for Python SDK. So, it should work.
— Alexey [1] https://issues.apache.org/jira/browse/BEAM-7587 > On 2 Jun 2021, at 17:21, Moshe Hoadley <[email protected]> wrote: > > Hi > I would like to run beam written in python SDK on spark. > I need to read from kafka, so, I need streaming functionality. > > Does the spark portable runner support streaming? If not, is there a roadmap > for it? > > Thanks > Moshe > This email and the information contained herein is proprietary and > confidential and subject to the Amdocs Email Terms of Service, which you may > review athttps://www.amdocs.com/about/email-terms-of-service > <https://www.amdocs.com/about/email-terms-of-service>
