Hi,
I will push my branch with the current state of the mapreduce runner.
Regards
JB
On 07/13/2017 04:47 AM, Pei HE wrote:
Thanks guys!
I replied Kenn's comments, and looking forward to more feedbacks and
suggestions.
Also, could we add a mapreduce-runner branch?
Thanks
--
Pei
On Sat, Jul 8, 2017 at 12:42 AM, Kenneth Knowles <[email protected]>
wrote:
Very cool to see this. Commenting a little on the doc.
On Fri, Jul 7, 2017 at 8:41 AM, Jean-Baptiste Onofré <[email protected]>
wrote:
Hi Pei,
I also pumped some ideas and part of code from Crunch for the MapReduce
runner.
I will push my changes on my github branch and share with you.
Let me take a look on your doc.
Regards
JB
On 07/07/2017 03:11 PM, Pei HE wrote:
Hi all,
While JB is working on MapReduce Runner BEAM-165
<https://issues.apache.org/jira/browse/BEAM-165>, I have spent time
reading
Apache Crunch code and drafted Beam MapReduce Runner One-Pager
<https://docs.google.com/document/d/10jJ8pBTZ10rNr_IO5YnggmZ
ZG1MU-F47sWg8N6xkBM0/edit#heading=h.bewnehqnt4zd>
(mostly
around ParDo/Flatten fusion support, and with many missing details).
I would like to start the discussion, and get people's attention of
supporting MapReduce in Beam.
Feel free to make comments and suggestions on that doc.
Thanks
--
Pei
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com
--
Jean-Baptiste Onofré
[email protected]
http://blog.nanthrax.net
Talend - http://www.talend.com