Ismaël Mejía created BEAM-9531:
----------------------------------
Summary: Kickstart the C# .net SDK for Beam
Key: BEAM-9531
URL: https://issues.apache.org/jira/browse/BEAM-9531
Project: Beam
Issue Type: Sub-task
Components: sdk-ideas
Reporter: Ismaël Mejía
The idea of this GSoC project is to kickstart the creation of the Beam SDK for
C# (.net). The goal is to create the minimal set of pieces required to allow a
user to write and execute a WordCount type of pipeline in C# with Beam.
To do this we will need to implement the minimum set of abstractions of the
SDK: ParDo (Beam’s Map with super powers) + GroupByKey, as well as a Harness
capable of writing to the data channel, and some internal data representations
(WindowedValue and others) to be able to run the pipeline using portable
runners.
Don’t worry if the Beam specific details are not clear, just familiarity with
the Big Data WordCount concepts are a prerequisite, as well as probably reading
some of the Beam introductory material [1-3]. Good knowledge of C# and its
idioms, as well as familiarity with the recent .net ecosystem are required for
the student who wants to apply for this project.
[1] [https://beam.apache.org/]
[2] [https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-101]
[3] [https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-102]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
