I want to run some test with MapReduce but not in YARN in the latest Hadoop
version 2.3.
Is it possible?
Thanks a lot!
Yes.You can still run MR without enabling YARN
On Tue, Mar 4, 2014 at 9:13 PM, hwpstorage hwpstor...@gmail.com wrote:
I want to run some test with MapReduce but not in YARN in the latest Hadoop
version 2.3.
Is it possible?
Thanks a lot!
--
Thanks
Deepak
www.bigdatabig.com
Thanks for the reply.
I got this error message when I tried to start the jobtracker node.
the jobtracker command is no longer supported.
Here are the details.
# /hadoop/hadoop-2.3.0/sbin/hadoop-daemon.sh --config
/hadoop/hadoop-2.3.0/etc/hadoop start jobtracker
starting jobtracker, logging to
It seems your HADOOP_MAPRED_HOME is pointing to the MRV2 configurations.
Make sure that in hadoop-env.sh, you change export
HADOOP_MAPRED_HOME=/usr/lib/hadoop-mapreduce to export
HADOOP_MAPRED_HOME=/usr/lib/hadoop-0.20-mapreduce.
Thanks
Deepak
On Tue, Mar 4, 2014 at 9:23 PM, hwpstorage
Deepak,
Thanks for the help!
I downloaded the hadoop2.3 binary from
http://www.apache.org/dyn/closer.cgi/hadoop/common/
There is no such directory /usr/lib/hadoop-0.20-mapreduce.
I guess you are referring to a CDH or HDP installation.
The error message is from /hadoop/hadoop-2.3.0/bin/mapred
Yes.so in order to run classic mode , you need to have classic hadoop
binaries.
Download hadoop 0.20 and point your HADOOP_MAPRED_HOME to this new download
in hadoop-env.sh
Hope this helps.
Thanks
Deepak
www.bigdatabig.com
On Tue, Mar 4, 2014 at 10:40 PM, hwpstorage hwpstor...@gmail.com wrote:
If you mean on top of JobTracker/TaskTracker, no you cannot do that in any of
the 2.x releases.
+Vinod
On Mar 4, 2014, at 7:43 AM, hwpstorage hwpstor...@gmail.com wrote:
I want to run some test with MapReduce but not in YARN in the latest Hadoop
version 2.3.
Is it possible?
Thanks a lot!
Ming Ma created MAPREDUCE-5776:
--
Summary: TaskAttempt should honor TA_KILL event when TA is in
SUCCESS_CONTAINER_CLEANUP state
Key: MAPREDUCE-5776
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5776
Jason Lowe created MAPREDUCE-5778:
-
Summary: JobSummary does not escape newlines in the job name
Key: MAPREDUCE-5778
URL: https://issues.apache.org/jira/browse/MAPREDUCE-5778
Project: Hadoop