The Activities of Apache Hadoop Community

2014-02-13 Thread Akira AJISAKA
Hi all, We collected and analyzed JIRA tickets to investigate the activities of Apache Hadoop Community in 2013. http://ajisakaa.blogspot.com/2014/02/the-activities-of-apache-hadoop.html We counted the number of the organizations, the lines of code, and the number of the issues. As a result, we

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-13 Thread Sandy Ryza
+1 (non-binding) Built from source and ran jobs on a pseudo-distributed cluster with the Fair Scheduler On Wed, Feb 12, 2014 at 7:56 PM, Xuan Gong xg...@hortonworks.com wrote: +1 (non-binding) downloaded the source tar ball, built, ran a number of MR jobs on a single-node cluster and

[jira] [Created] (MAPREDUCE-5758) Reducer local data is not deleted until job completes

2014-02-13 Thread Jason Lowe (JIRA)
Jason Lowe created MAPREDUCE-5758: - Summary: Reducer local data is not deleted until job completes Key: MAPREDUCE-5758 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5758 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-13 Thread Alejandro Abdelnur
Trying to run the PI MapReduce example using RC0 the job is failing, looking at the NM logs I'm getting the following. I believe it may be something in my setup as many already test MR jobs with this RC successfully, but couldn't figure out yet. Running on OSX 10.9.1 using JDK7. Thanks. --

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-13 Thread Travis Thompson
I suspect it's your setup because I'm able to run the PI example without errors. Running on RHEL 6.3 w/ JDK7. On Feb 13, 2014, at 3:05 PM, Alejandro Abdelnur t...@cloudera.com wrote: Trying to run the PI MapReduce example using RC0 the job is failing, looking at the NM logs I'm getting the

Re: [VOTE] Release Apache Hadoop 2.3.0

2014-02-13 Thread Tsuyoshi OZAWA
+1 (non-binding) * Built from source. * Ran a pseudo-cluster with manual RM HA. * Ran a few MR examples as tests. Thanks, Tsuyoshi On Tue, Feb 11, 2014 at 6:49 AM, Arun C Murthy a...@hortonworks.com wrote: Folks, I've created a release candidate (rc0) for hadoop-2.3.0 that I would like to

Re: The code for the Shuffle phase of MapReduce

2014-02-13 Thread Tsuyoshi OZAWA
Hi Pramod, In addition to shuffle plugin related parts, please check out how spill works in MapTask.java and how reducer fetches MapOutputs from mappers. Thanks, Tsuyoshi On Mon, Feb 10, 2014 at 2:54 AM, Pramod Biligiri pramodbilig...@gmail.com wrote: Hi, I'm beginning to look at the code for

Re: Looking for a resource about measuring MapReduce performance

2014-02-13 Thread Tsuyoshi OZAWA
Hi Pramod, Now PUMA benchmarks are available at the following site: https://sites.google.com/site/farazahmad/pumabenchmarks Thanks, Tsuyoshi On Mon, Feb 10, 2014 at 2:46 AM, Pramod Biligiri pramodbilig...@gmail.com wrote: Hi Tian, Thanks for that link to PUMA. It's proving useful for us in