Congrats and huge thanks !
(I'm glad to be one of the little "launcher" to this effort ;) )
Regards
JB
On 21/03/2019 15:47, Ismaël Mejía wrote:
This is excellent news. Congrats Etienne, Alexey and the others
involved for the great work!
On Thu, Mar 21, 2019 at 3:10 PM Etienne Chauchot <echauc...@apache.org> wrote:
Hi guys,
We are glad to announce that the spark runner POC that was re-written from
scratch using the structured-streaming framework and the dataset API can now
run WordCount !
It is still embryonic. For now it only runs in batch mode and there is no fancy
stuff like state, timer, SDF, metrics, ... but it is still a major step forward
!
Streaming support work has just started.
You can find the branch here:
https://github.com/apache/beam/tree/spark-runner_structured-streaming
Enjoy,
Etienne
