This is pretty cool. Thanks for working on this and for sharing:) Best -P. On Thu, Mar 21, 2019, 8:18 AM Alexey Romanenko <aromanenko....@gmail.com> wrote:
> Good job! =) > Congrats to all who was involved to move this forward! > > Btw, for all who is interested in a progress of work on this runner, I > wanted to remind that we have #beam-spark channel on Slack where we discuss > all ongoing questions. Feel free to join! > > Alexey > > > On 21 Mar 2019, at 15:51, Jean-Baptiste Onofré <j...@nanthrax.net> wrote: > > > > Congrats and huge thanks ! > > > > (I'm glad to be one of the little "launcher" to this effort ;) ) > > > > Regards > > JB > > > > On 21/03/2019 15:47, Ismaël Mejía wrote: > >> This is excellent news. Congrats Etienne, Alexey and the others > >> involved for the great work! > >> On Thu, Mar 21, 2019 at 3:10 PM Etienne Chauchot <echauc...@apache.org> > wrote: > >>> > >>> Hi guys, > >>> > >>> We are glad to announce that the spark runner POC that was re-written > from scratch using the structured-streaming framework and the dataset API > can now run WordCount ! > >>> > >>> It is still embryonic. For now it only runs in batch mode and there is > no fancy stuff like state, timer, SDF, metrics, ... but it is still a major > step forward ! > >>> > >>> Streaming support work has just started. > >>> > >>> You can find the branch here: > https://github.com/apache/beam/tree/spark-runner_structured-streaming > >>> > >>> Enjoy, > >>> > >>> Etienne > >>> > >>> > >
