Re: difference between hadoop code and the amazon elastic Mapreduce

2012-09-09 Thread Momina Khan
thank u that was very helpful! On Mon, Sep 10, 2012 at 1:04 AM, Eli Collins wrote: > Peter, > > Thanks for the info. Do you guys plan to contribute the rewritten s3 > code (assume you're referring to org.apache.hadoop.fs.s3) back to > Apache? > > Thanks, > Eli > > On Sun, Sep 9, 2012 at 12:38 P

Re: Help with dev environment setup for Hadoop MR

2012-09-09 Thread Karthik Kambatla
Hi Sudhir http://wiki.apache.org/hadoop/EclipseEnvironment is a good place to start for your eclipse setup. For deploying a cluster off of your local changes, you can either package it (mvn package) or just build the jars and replace the jars in an existing setup. Hope that helps. Karthik On Sun

Re: difference between hadoop code and the amazon elastic Mapreduce

2012-09-09 Thread Eli Collins
Peter, Thanks for the info. Do you guys plan to contribute the rewritten s3 code (assume you're referring to org.apache.hadoop.fs.s3) back to Apache? Thanks, Eli On Sun, Sep 9, 2012 at 12:38 PM, Sirota, Peter wrote: > Hi, > > The major differences are in s3 file system that has been rewritten

Help with dev environment setup for Hadoop MR

2012-09-09 Thread Sudhir Kylasa
Hi, I am Sudhir Kylasa, a PhD student @ Purdue University. I just started with Hadoop MR and other related open projects with Apache. Can someone please point me to a place where I can find instructions on how to setup Eclipse with HadoopMR development environment. I want to download a sta

Re: difference between hadoop code and the amazon elastic Mapreduce

2012-09-09 Thread Sirota, Peter
Hi, The major differences are in s3 file system that has been rewritten in EMR and in Hadoop interactions with S3. Other differences are in detecting various failure conditions. Outside these it's Apache Hadoop. Here is a list of patches EMR applied on top of 1.0.3 Hadoop http://docs.amazon

Build failed in Jenkins: Hadoop-Common-trunk #528

2012-09-09 Thread Apache Jenkins Server
See Changes: [eli] HDFS-2757. Cannot read a local block that's being written to when using the local read short circuit. Contributed by Jean-Daniel Cryans -- [...truncated 26859 lines...] [DE