Okay - in order to get the jobtracker to come up I had to copy conf/core-site.xml and conf/hdfs-site.xml to the location where I unpacked hadoop.tar.gz. The jobtracker now starts up and accepts jobs.
So I then tried to run the "PI" benchmark to test the installation. The output from PI looks like this: [craigv@m5 benchmarks]$ pi.sh Number of Maps = 10 Samples per Map = 1000000000 Wrote input for Map #0 Wrote input for Map #1 Wrote input for Map #2 Wrote input for Map #3 Wrote input for Map #4 Wrote input for Map #5 Wrote input for Map #6 Wrote input for Map #7 Wrote input for Map #8 Wrote input for Map #9 Starting Job 13/03/07 09:43:57 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same. 13/03/07 09:43:57 INFO mapred.FileInputFormat: Total input paths to process : 10 13/03/07 09:43:57 INFO mapred.JobClient: Running job: job_201303070943_0001 13/03/07 09:43:59 INFO mapred.JobClient: map 0% reduce 0% while the Mesosized jobtracker prints out the following endlessly: 13/03/07 09:49:34 INFO mapred.MesosScheduler: Launching task Task_Tracker_328 on http://m5:31000 13/03/07 09:49:34 INFO mapred.MesosScheduler: Unable to fully satisfy needed map/reduce slots: 8 map slots remaining 13/03/07 09:49:35 INFO mapred.MesosScheduler: Status update of Task_Tracker_328 to TASK_LOST with message Executor exited 13/03/07 09:49:35 INFO mapred.MesosScheduler: JobTracker Status Pending Map Tasks: 10 Pending Reduce Tasks: 1 Idle Map Slots: 0 Idle Reduce Slots: 0 Inactive Map Slots: 2 (launched but no hearbeat yet) Inactive Reduce Slots: 2 (launched but no hearbeat yet) Needed Map Slots: 10 Needed Reduce Slots: 1 So it looks like the tasktracker tries to start the tasks and then fails. What should I try now? Craig On Wed, Mar 6, 2013 at 5:58 PM, Craig Vanderborgh < [email protected]> wrote: > Hi Vinod - > > You mentioned configuration changes for mapred-site.xml. Do I also have > to modify hadoop-env.sh, to specify JAVA_HOME, PROTOBUF_JAR, MESOS_JAR, > MESOS_NATIVE_LIBRARY, and HADOOP_CLASSPATH as shown here: > > http://files.meetup.com/3138542/*mesos*-spark-meetup-04-05-12.pptx > > Please advise.. > > Thanks, > Craig Vanderborgh >
