Hey Adam, That would be awesome. +1
We've discussed moving the various contrib projects out of Hadoop in the past, and think it make sense for all the reasons you mention. A good example of how we've done this was done previously is MRUnit, now hosted at http://mrunit.apache.org. Next steps, if others agree then you can draft a proposal to vote on. See this thread and jira for an example: http://mail-archives.apache.org/mod_mbox/hadoop-general/201102.mbox/%3c77405974-6771-4604-926b-976240743...@mac.com%3E https://issues.apache.org/jira/browse/MAPREDUCE-2430 Thanks, Eli On Mon, Sep 17, 2012 at 12:34 PM, Adam Berry <ambe...@yahoo-inc.com> wrote: > Hello all, > > I'm proposing spinning out the eclipse plugin from the main hadoop source > into a separate incubating project. I'm willing to commit to this effort. > > With a separate project, that isn't tied (source wise) to the Hadoop source > we could make dev tools that could support multiple versions of Hadoop from > within a single IDE, which would be very helpful when migrating jobs or > dealing with clusters running different versions. > > The current tools seem to support the 0.20 line, and help with developing MR > jobs, and also have some HDFS tools included. So the early work would be to > ensure that these features were supported across the version space of Hadoop. > > Down the line we could also add support for additional tools such as MRUnit > and other products in the Hadoop ecosystem, to eventually yield a one stop > project for all dev tools around this space. > > If there is agreement on this, how do we go about getting it done? > > Thanks, > > Adam Berry
