I am following the install steps on
https://github.com/mesos/hadoop
Question one:
--------------------
Where should be
conf/mapred-site.xml
I can only see etc/hadoop/mapred-site.xml , there is no conf/ directory
Question two:
-------------------
How can i start the hadoop mesos framework?
Steps:
- mvn package and put target/mesos-hadoop-mr1-0.1.1-SNAPSHOT.jar into
hadoop-2.5.0-cdh5.2.0/share/hadoop/common/lib/
- done the link changes described
- packaged tar, uploaded to hdfs (hdfs://hdfs/hadoop-2.5.0-cdh5.2.0.tar.gz)
- patched the config file (etc/hadoop/mapred-site.xml)
- uploaded again (with the changed config file)
invoking the hadoop binary from downloaded/unpacked tar:
root@mesos-master3 ~/hadoop-2.5.0-cdh5.2.0 #
MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos.so ./bin/hadoop jobtracker
Error: Could not find or load main class org.apache.hadoop.mapred.JobTracker
my classpath echo:
root@mesos-master3 ~/hadoop-2.5.0-cdh5.2.0 #
MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos.so ./bin/hadoop jobtracker
/root/hadoop-2.5.0-cdh5.2.0/bin-mapreduce1/../etc/hadoop:/usr/lib/tools.jar:/root/hadoop-2.5.0-cdh5.2.0/bin-mapreduce1/../share/hadoop/mapreduce1/hadoop-core-2.5.0-mr1-cdh5.2.0.jar:/root/hadoop-2.5.0-cdh5.2.0/bin-mapreduce1/../lib/*.jar:/root/hadoop-2.5.0-cdh5.2.0/bin-mapreduce1/../lib/jsp-2.1/*.jar:/root/hadoop-2.5.0-cdh5.2.0/bin-mapreduce1/../etc/hadoop:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/common/lib/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/common/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/hdfs:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/hdfs/lib/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/hdfs/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/yarn/lib/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/yarn/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/mapreduce:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/mapreduce/lib/*:/root/hadoop-2.5.0-cdh5.2.0/share/hadoop/mapreduce/*
Error: Could not find or load main class org.apache.hadoop.mapred.JobTracker
invoking "hadoop" gives me an error about jobtracker command no longer
supported.
MESOS_NATIVE_JAVA_LIBRARY=/path/to/libmesos.so hadoop jobtracker
root@mesos-master3 ~/hadoop-2.5.0-cdh5.2.0 #
MESOS_NATIVE_JAVA_LIBRARY=/usr/lib/libmesos.so hadoop jobtracker
DEPRECATED: Use of this script to execute mapred command is deprecated.
Instead use the mapred command for it.
Sorry, the jobtracker command is no longer supported.
You may find similar functionality with the "yarn" shell command.
Usage: mapred [--config confdir] COMMAND
where COMMAND is one of:
pipes run a Pipes job
job manipulate MapReduce jobs
queue get information regarding JobQueues
classpath prints the class path needed for running
mapreduce subcommands
historyserver run job history servers as a standalone daemon
distcp <srcurl> <desturl> copy file or directories recursively
archive -archiveName NAME -p <parent path> <src>* <dest> create a hadoop
archive
hsadmin job history server admin interface
Most commands print help when invoked w/o parameters.
