Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-26 Thread Josh Wills
Inlined. On Sat, May 26, 2012 at 3:20 PM, Jakob Homan wrote: > This isn't about whether or not they will respond appropriately to new > contributors once they are incubator project.  And it's absolutely not > whether or not I should be an initial committer (the vote's going on > already and I'm h

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-26 Thread Jakob Homan
This isn't about whether or not they will respond appropriately to new contributors once they are incubator project. And it's absolutely not whether or not I should be an initial committer (the vote's going on already and I'm happy it is). Since the team has already stumbled in its first steps, I

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-26 Thread Edward J. Yoon
+1 Sent from my iPad On May 27, 2012, at 6:51 AM, Jukka Zitting wrote: > Personally I've never fully understood the practice of allowing just > about anyone to sign up as an initial committer of a podling. Putting > your name on a list does not make you a part of a community, > participating an

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-26 Thread Benson Margulies
I'll see Jukka one and raise him one. I have advised potential podlings to be very conservative with their initial list, and keep some potential contributors in their collective back pocket. This gives them a ready-made source of community growth, which is typically the scarcest and most precious c

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-26 Thread Jukka Zitting
Hi, On Fri, May 25, 2012 at 11:39 AM, Steve Loughran wrote: > I'd go for pulling Jakob in for tactical and strategic reasons We grant committership based on merit, not tactics or strategy. Sounds to me like Josh and the rest of the team would be quite willing to add Jakob as soon as he shows up

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-26 Thread Steve Loughran
On 25 May 2012 20:00, Josh Wills wrote: > Hi Steve, > > Thank you for your thoughtful comments. Replies inlined below. > > > 1. He's using it at work, so represents the end users. > > A super-majority of the initial committers are also end users. I use > Crunch on my own projects (e.g., > http://

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-25 Thread Josh Wills
Hi Steve, Thank you for your thoughtful comments. Replies inlined below. On Fri, May 25, 2012 at 2:39 AM, Steve Loughran wrote: > On 23 May 2012 19:35, Josh Wills wrote: > >> Hey Jakob, >> >> This was a tough one-- you know that I've been talking about Crunch >> w/Joe Adler for a few weeks now,

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-25 Thread Jakob Homan
> Assuming the VOTE passes, I hope you'll still give the project a chance, > Jakob.  Given your rep around the ASF, if you contribute as you have to other > projects yet your merit goes unrecognized, I suspect that the Crunch's Mentors > are going to be asking questions. ;) I imagine we'll continu

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-25 Thread Josh Wills
Hi Jukka, Apologies for the delay, I had a vacation day. Replies inline. On Wed, May 23, 2012 at 2:33 PM, Jukka Zitting wrote: > Hi, > > On Wed, May 16, 2012 at 2:23 AM, Josh Wills wrote: >> http://wiki.apache.org/incubator/CrunchProposal > > Some comments from the related vote thread: > >> for

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-25 Thread Steve Loughran
On 23 May 2012 19:35, Josh Wills wrote: > Hey Jakob, > > This was a tough one-- you know that I've been talking about Crunch > w/Joe Adler for a few weeks now, and I personally am really looking > forward to working with you guys. That said, the team did feel > strongly about keeping the initial

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-23 Thread Marvin Humphrey
On Wed, May 23, 2012 at 12:40 PM, Jakob Homan wrote: > Totally understand, although basing your criteria on S4's approach, > which has a rocky time in the incubator and has yet to create a > release, is certainly an interesting approach.  Best of luck. Assuming the VOTE passes, I hope you'll stil

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-23 Thread Jukka Zitting
Hi, On Wed, May 16, 2012 at 2:23 AM, Josh Wills wrote: > http://wiki.apache.org/incubator/CrunchProposal Some comments from the related vote thread: > formally released twice, as versions 0.1.0 (October 2010) and 0.2.0 s/2010/2011/ I presume. > == Source and Intellectual Property Submission P

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-23 Thread Josh Wills
On Wed, May 23, 2012 at 1:15 PM, Marvin Humphrey wrote: > On Wed, May 23, 2012 at 11:35 AM, Josh Wills wrote: >> That said, the team did feel strongly about keeping the initial committers >> to people who had already added major pieces of functionality to Crunch > > Speaking as a former benevolen

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-23 Thread Marvin Humphrey
On Wed, May 23, 2012 at 11:35 AM, Josh Wills wrote: > That said, the team did feel strongly about keeping the initial committers > to people who had already added major pieces of functionality to Crunch Speaking as a former benevolent dictator... When you bring a project to Apache, you have to a

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-23 Thread Jakob Homan
Totally understand, although basing your criteria on S4's approach, which has a rocky time in the incubator and has yet to create a release, is certainly an interesting approach. Best of luck. -jg On Wed, May 23, 2012 at 11:35 AM, Josh Wills wrote: > Hey Jakob, > > This was a tough one-- you kno

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-23 Thread Josh Wills
Hey Jakob, This was a tough one-- you know that I've been talking about Crunch w/Joe Adler for a few weeks now, and I personally am really looking forward to working with you guys. That said, the team did feel strongly about keeping the initial committers to people who had already added major piec

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-22 Thread Jakob Homan
Here at LinkedIn we're also experimenting with Crunch and are interested in seeing it succeed in the Incubator. Barring objections, I'd like to add myself as well. Hadoo, Giraph and Kafka committer, details here: http://www.linkedin.com/in/jghoman -Jakob On Mon, May 21, 2012 at 10:22 AM, Josh

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-21 Thread Josh Wills
Thank you Vinod. I wasn't sure of the right protocol for this sort of thing, as my expectation was that the initial committers would be drawn from the people who had contributed to Crunch already. This thread from when S4 entered the incubator was particularly illuminating: http://markmail.org/mes

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-19 Thread Vinod Kumar Vavilapalli
+1, great addition. Looking forward to see this at Apache! I'd like to add myself to the list of initial committers if that is fine with you. (Didn't find any section for interested developers in the proposal, so asking here) My Background: Long time Hadoop MapReduce committer. Lead dev on Had

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Josh Wills
Arun, That would be great-- thank you. I went ahead and added your name to the mentors list. Look forward to seeing you at Hadoop Summit. Best, Josh On Fri, May 18, 2012 at 3:46 PM, Arun C Murthy wrote: > Josh, > >  Sounds interesting, I've followed Crunch given my leanings towards Apache > Ha

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Arun C Murthy
Josh, Sounds interesting, I've followed Crunch given my leanings towards Apache Hadoop MapReduce. Good to see it in the ASF. If you don't mind I'll sign up as a volunteer mentor. thanks, Arun On May 15, 2012, at 5:23 PM, Josh Wills wrote: > Hi all, > > I would like to propose Crunch, a lib

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Josh Wills
Nah, that was the automatic wiki linking on CapitalizedWords being a little bit too clever. Fixed. On Fri, May 18, 2012 at 10:03 AM, Donald Whytock wrote: > The MapReduce link in the proposal doesn't resolve.  You perhaps want > to use "http://hadoop.apache.org/mapreduce/"; instead. > > Don > > -

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Donald Whytock
The MapReduce link in the proposal doesn't resolve. You perhaps want to use "http://hadoop.apache.org/mapreduce/"; instead. Don - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail:

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Josh Wills
Hey JB, I think that the underlying data model is the main difference. Pig, like Hive and Cascading, has a relational data model-- the fundamental data type is a Tuple of values. Crunch is closer to bare-metal MapReduce; it doesn't impose a data model on the developer, and I think that it ends up

Re: [DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Jean-Baptiste Onofré
Hi Josh, Could you compare with Pig ? Is Scala support the main difference ? Thanks, Regards JB On 05/16/2012 02:23 AM, Josh Wills wrote: Hi all, I would like to propose Crunch, a library for writing MapReduce pipelines in Java and Scala, as an Apache Incubator project. The proposal is here:

[DISCUSS] Crunch to join the Apache Incubator

2012-05-18 Thread Josh Wills
Hi all, I would like to propose Crunch, a library for writing MapReduce pipelines in Java and Scala, as an Apache Incubator project. The proposal is here: http://wiki.apache.org/incubator/CrunchProposal We would gladly welcome additional volunteers to act as mentors on the project, so if this so