Hello Etienne, Your slide mentioned that streaming mode development is blocked because Spark lacks supporting multiple-aggregations in its streaming mode but design is ongoing. Do you have a link or something else to their design discussion/doc?
-Rui On Wed, Sep 11, 2019 at 5:10 PM Etienne Chauchot <[email protected]> wrote: > Hi Rahul, > Sure, and great ! Thanks for proposing ! > If you want details, here is the presentation I did 30 mins ago at the > apachecon. You will find the video on youtube shortly but in the meantime, > here is my presentation slides. > > And here is the structured streaming branch. I'll be happy to review your > PRs, thanks ! > > <https://github.com/apache/beam/tree/spark-runner_structured-streaming> > https://github.com/apache/beam/tree/spark-runner_structured-streaming > > Best > Etienne > > Le mercredi 11 septembre 2019 à 16:37 +0530, rahul patwari a écrit : > > Hi Etienne, > > I came to know about the work going on in Structured Streaming Spark > Runner from Apache Beam Wiki - Works in Progress. > I have contributed to BeamSql earlier. And I am working on supporting > PCollectionView in BeamSql. > > I would love to understand the Runner's side of Apache Beam and > contribute to the Structured Streaming Spark Runner. > > Can you please point me in the right direction? > > Thanks, > Rahul > >
