Re: development environment for hadoop core

2013-01-21 Thread Erik Paulson
On Wed, Jan 16, 2013 at 7:31 AM, Glen Mazza gma...@talend.com wrote: On 01/15/2013 06:50 PM, Erik Paulson wrote: Hello - I'm curious what Hadoop developers use for their day-to-day hacking on Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not developing Map-Reduce

Re: development environment for hadoop core

2013-01-21 Thread Colin McCabe
Hi Erik, Eclipse can run junit tests very rapidly. If you want a shorter test cycle, that's one way to get it. There is also Maven-shell, which reduces some of the overhead of starting Maven. But I haven't used it so I can't really comment. cheers, Colin On Mon, Jan 21, 2013 at 8:36 AM,

Re: development environment for hadoop core

2013-01-16 Thread Steve Loughran
My setup ( I work from home) # OS/X laptop w/ 30 monitor # FTTC broadband, 55Mbit/s down, 15+ up -it's the upload bandwidth that really helps development: http://www.flickr.com/photos/steve_l/8050751551/ # IntelliJ IDEA IDE, settings edited for a 2GB Heap # Maven on the command line for builds #

Re: development environment for hadoop core

2013-01-16 Thread Glen Mazza
On 01/15/2013 06:50 PM, Erik Paulson wrote: Hello - I'm curious what Hadoop developers use for their day-to-day hacking on Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not developing Map-Reduce jobs or using using the HDFS Client libraries to talk to a filesystem from an

Re: development environment for hadoop core

2013-01-16 Thread Gopal Vijayaraghavan
Not quite an advance developer, but I learnt some shortcuts for my dev cycle along the way. I've checked out Hadoop, made minor changes and built it with Maven, and tracked down the resulting artifacts in a target/ directory that I could deploy. Is this typically how a

Re: development environment for hadoop core

2013-01-16 Thread Hitesh Shah
On Jan 16, 2013, at 6:17 AM, Gopal Vijayaraghavan wrote: So, this is a question I have for everyone else. How do I change the hadoop version of an entire build, so that I can name it something unique use it in other builds in maven (-SNAPSHOT doesn't cut it, since occasionally mvn will

Re: development environment for hadoop core

2013-01-15 Thread Todd Lipcon
Hi Erik, When I started out on Hadoop development, I used to use emacs for most of my development. I eventually saw the light and switched to eclipse with a bunch of emacs keybindings - using an IDE is really handy in Java for functions like find callers of, quick navigation to types, etc. etags

Re: development environment for hadoop core

2013-01-15 Thread Andy Isaacson
On Tue, Jan 15, 2013 at 3:50 PM, Erik Paulson epaul...@unit1127.com wrote: I'm curious what Hadoop developers use for their day-to-day hacking on Hadoop. I'm talking changes to the Hadoop libraries and daemons, and not developing Map-Reduce jobs or using using the HDFS Client libraries to talk