Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Jesse Anderson
Basing this on Crunch's approach is a good way to go. I'd really love to see this happen. On Fri, Jul 7, 2017 at 6:11 AM Pei HE wrote: > Hi all, > While JB is working on MapReduce Runner BEAM-165 > , I have spent time > reading >

Re: Failure in Apex runner

2017-07-07 Thread Pramod Immaneni
Hi Manu, Can you refresh your netlet dependency. There was a respin of a release that usually doesn't happen. You could do this by deleting contents of your ~/.m2/repository/com/datatorrent/netlet/ folder and rebuilding, which will fetch the netlet dependency again. Thanks On Fri, Jul 7, 2017

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Jean-Baptiste Onofré
Hi Pei, I also pumped some ideas and part of code from Crunch for the MapReduce runner. I will push my changes on my github branch and share with you. Let me take a look on your doc. Regards JB On 07/07/2017 03:11 PM, Pei HE wrote: Hi all, While JB is working on MapReduce Runner BEAM-165

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Kenneth Knowles
Very cool to see this. Commenting a little on the doc. On Fri, Jul 7, 2017 at 8:41 AM, Jean-Baptiste Onofré wrote: > Hi Pei, > > I also pumped some ideas and part of code from Crunch for the MapReduce > runner. > > I will push my changes on my github branch and share with

Re: MergeBot is here!

2017-07-07 Thread Davor Bonaci
This is fantastic! Thank you Jason, and special thanks to the Infrastructure team for supporting us every step of the way. On Fri, Jul 7, 2017 at 1:21 PM, Jason Kuster wrote: > Hi Beam Community, > > Early on in the project, we had a number of discussions about

Re: MergeBot is here!

2017-07-07 Thread Lukasz Cwik
for i in range(0, inf): +1 Note that the URL for gitbox linking is: https://gitbox.apache.org/setup/ (above URL was missing '/' and was giving 404) On Fri, Jul 7, 2017 at 1:21 PM, Jason Kuster wrote: > Hi Beam Community, > > Early on in the project, we had a

MergeBot is here!

2017-07-07 Thread Jason Kuster
Hi Beam Community, Early on in the project, we had a number of discussions about creating an automated tool for merging pull requests. I’m happy to announce that we’ve developed such a tool and it is ready for experimental usage in Beam! The tool, MergeBot, works in conjunction with ASF’s

Re: Failure in Apex runner

2017-07-07 Thread Manu Zhang
Okay, that fixes my errors. On Sat, Jul 8, 2017 at 1:41 AM Pramod Immaneni wrote: > Hi Manu, > > Can you refresh your netlet dependency. There was a respin of a release > that usually doesn't happen. You could do this by deleting contents of > your

Re: MergeBot is here!

2017-07-07 Thread Ted Yu
For https://gitbox.apache.org/setup/ , after completing the first two steps, is there any action needed for "MFA Status" box ? Cheers On Fri, Jul 7, 2017 at 1:37 PM, Lukasz Cwik wrote: > for i in range(0, inf): +1 > > Note that the URL for gitbox linking is: >

Re: Making it easier to run IO ITs

2017-07-07 Thread Jason Kuster
This looks great Stephen -- this will make the process of running IO ITs much easier. I'll take a look at the doc and leave comments if I have any. On Wed, Jul 5, 2017 at 5:02 PM, Kenneth Knowles wrote: > I have some extra nerdy maven-fu (pom-fu?) to suggest: use -D

Re: [Proposal] Submitting pipelines to Runners in another language

2017-07-07 Thread Thomas Groh
I left a couple of comments. I'm looking forwards to this - it's going to be a good step towards being able to execute any pipeline on any runner. On Thu, Jul 6, 2017 at 5:11 PM, Ahmet Altay wrote: > Thank you Sourabh. I added my comments as well and +1 to Kenn. > >

Re: MergeBot is here!

2017-07-07 Thread Kenneth Knowles
This is awesome!! On Fri, Jul 7, 2017 at 1:46 PM, Thomas Groh wrote: > Super duper cool. Very exciting. > > On Fri, Jul 7, 2017 at 1:40 PM, Ted Yu wrote: > > > For https://gitbox.apache.org/setup/ , after completing the first two > > steps, is

Re: MergeBot is here!

2017-07-07 Thread tarush grover
This is really good!! Regards, Tarush On Sat, 8 Jul 2017 at 10:20 AM, Jean-Baptiste Onofré wrote: > That's awesome ! > > Thanks Jason ! > > Regards > JB > > On 07/07/2017 10:21 PM, Jason Kuster wrote: > > Hi Beam Community, > > > > Early on in the project, we had a number of

Re: [jira] [Commented] (BEAM-2573) Better filesystem discovery mechanism in Python SDK

2017-07-07 Thread Robert Bradshaw
Wouldn't you want to import filesystems to do validation of paths, etc? (Also, registering an imported object is less error-prone than registering a string.) On Fri, Jul 7, 2017 at 9:29 PM, Chamikara Jayalath (JIRA) wrote: > > [ >

Re: MergeBot is here!

2017-07-07 Thread Thomas Groh
Super duper cool. Very exciting. On Fri, Jul 7, 2017 at 1:40 PM, Ted Yu wrote: > For https://gitbox.apache.org/setup/ , after completing the first two > steps, is there any action needed for "MFA Status" box ? > > Cheers > > On Fri, Jul 7, 2017 at 1:37 PM, Lukasz Cwik

[DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Pei HE
Hi all, While JB is working on MapReduce Runner BEAM-165 , I have spent time reading Apache Crunch code and drafted Beam MapReduce Runner One-Pager

Re: Failure in Apex runner

2017-07-07 Thread Manu Zhang
Hey guys, I'd like to offer some input. The test also fails locally on my Mac with the following error. (so WriteOperation#finalize is not called) java.lang.NullPointerException at com.datatorrent.netlet.util.Slice.(Slice.java:54) at