Hi,
I am trying to setup a test system to host a distributed hbase installation.
No matter what I do, I get the below errors.

2011-09-28 22:17:26,288 WARN org.apache.hadoop.hdfs.DFSClient: Error
Recovery fo
r block null bad datanode[0] nodes == null
2011-09-28 22:17:26,288 WARN org.apache.hadoop.hdfs.DFSClient: Could not get
blo
ck locations. Source file "/tmp/mapred/system/jobtracker.info" - Aborting...
2011-09-28 22:17:26,288 WARN org.apache.hadoop.mapred.JobTracker: Writing to
fil
e hdfs://
ec2-184-73-22-146.compute-1.amazonaws.com/tmp/mapred/system/jobtracker.
info failed!
2011-09-28 22:17:26,288 WARN org.apache.hadoop.mapred.JobTracker: FileSystem
is
not ready yet!
2011-09-28 22:17:26,292 WARN org.apache.hadoop.mapred.JobTracker: Failed to
init
ialize recovery manager.
org.apache.hadoop.ipc.RemoteException: java.io.IOException: File
/tmp/mapred/sys
tem/jobtracker.info could only be replicated to 0 nodes, instead of 1
        at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBloc
k(FSNamesystem.java:1417)
....

this is how i setup my config -
core-site.xml -
<configuration>

  <property>
    <name>fs.default.name</name>
    <value>hdfs://ec2-184-73-22-146.compute-1.amazonaws.com/</value>
  </property>

</configuration>

hdfs-site.xml -
<configuration>

  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>

  <property>
    <name>dfs.name.dir</name>
    <value>/tmp/hbase</value>
  </property>

  <property>
    <name>dfs.data.dir</name>
    <value>/tmp/hbase</value>
  </property>

</configuration>


mapred-site.xml -
<configuration>

  <property>
    <name>mapred.job.tracker</name>
    <value>ec2-184-73-22-146.compute-1.amazonaws.com:9001</value>
  </property>

  <property>
    <name>mapred.local.dir</name>
    <value>/tmp/mapred_tmp</value>
  </property>

  <property>
    <name>mapred.map.tasks</name>
    <value>10</value>
  </property>

  <property>
    <name>mapred.reduce.tasks</name>
    <value>2</value>
  </property>

  <property>
    <name>mapred.system.dir</name>
    <value>/tmp/mapred/system/</value>
  </property>


</configuration>

i know that i am missing something really basic but not sure what it is. the
documentation says mapred.system.dir should be globally accessible. how do i
achieve that?

thanks
vinod

Reply via email to