Hi Pei, I also pumped some ideas and part of code from Crunch for the MapReduce runner.
I will push my changes on my github branch and share with you. Let me take a look on your doc. Regards JB On 07/07/2017 03:11 PM, Pei HE wrote:
Hi all, While JB is working on MapReduce Runner BEAM-165 <https://issues.apache.org/jira/browse/BEAM-165>, I have spent time reading Apache Crunch code and drafted Beam MapReduce Runner One-Pager <https://docs.google.com/document/d/10jJ8pBTZ10rNr_IO5YnggmZZG1MU-F47sWg8N6xkBM0/edit#heading=h.bewnehqnt4zd> (mostly around ParDo/Flatten fusion support, and with many missing details). I would like to start the discussion, and get people's attention of supporting MapReduce in Beam. Feel free to make comments and suggestions on that doc. Thanks -- Pei
-- Jean-Baptiste Onofré [email protected] http://blog.nanthrax.net Talend - http://www.talend.com
