Re: A basic question on HBase

Thu, 18 Oct 2007 09:49:40 -0700 

(Ignore my last message.  I had missed your back and forth with Edward).
Regards step 3. below, you are starting both mapreduce and dfs daemons. You only need dfs daemons running hbase so you could do ./bin/start-dfs.sh instead.
Are you using hadoop 0.14.x? (It looks like it going by the commands and log excerpt below). If so, please use TRUNK or the 0.15.0 candidate (Branch is here http://svn.apache.org/viewvc/lucene/hadoop/branches/branch-0.15/). There is a big difference between hbase 0.14.0 and 0.15.0 (The 0.15.0 candidate contains the first hbase release). For example vestige log files are properly split and distributed in later hbases where before they threw the "Can not start region server because..." exception.
As Edward points out, the master does not seem to be getting the region server 'report-for-duty' message (which doesn't jibe with the region server log that says -ROOT- has been deployed because master assigns regions).
Regards your not being able to reformat -- presuming no valuable data in your hdfs, that all is running on localhost, and that you are moving from hadoop 0.14.0 to 0.15.0 -- just remove /tmp/hadoop-hadoop dir. 

St.Ack




Bin YANG wrote:

Dear edward,

I will show you the steps what I have done:

1. hadoop-site.xml

<property>
    <name>fs.default.name</name>
    <value>localhost:9000</value>
     <description>Namenode </description>
  </property>

  <property>
    <name>mapred.job.tracker</name>
    <value>localhost:9001</value>
    <description>JobTracker </description>
  </property>

  <property>
    <name>dfs.replication</name>
    <value>1</value>
  </property>

2. /hadoop-0.14.2$ bin/hadoop namenode -format
3. bin/start-all.sh
4. hbase.site.xml

<configuration>
<property>
  <name>hbase.master</name>
  <value>localhost:60000</value>
  <description>The host and port that the HBase master runs at.
      TODO: Support 'local' (All running in single context).
  </description>
 </property>
 <property>
  <name>hbase.regionserver</name>
  <value>localhost:60010</value>
  <description>The host and port a HBase region server runs at.
  </description>
 </property>

</configuration>

5.  bin/hbase-start.sh

The log:
1. hbase-hadoop-regionserver-yangbin.log

2007-10-18 15:40:58,588 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library
2007-10-18 15:40:58,592 INFO
org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded &
initialized native-zlib library
2007-10-18 15:40:58,690 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 60010: starting
2007-10-18 15:40:58,692 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 60010: starting
2007-10-18 15:40:58,694 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 60010: starting
2007-10-18 15:40:58,692 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 60010: starting
2007-10-18 15:40:58,691 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 60010: starting
2007-10-18 15:40:58,696 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 60010: starting
2007-10-18 15:40:58,691 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 60010: starting
2007-10-18 15:40:58,696 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 60010: starting
2007-10-18 15:40:58,697 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 60010: starting
2007-10-18 15:40:58,698 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 60010: starting
2007-10-18 15:40:58,699 INFO org.apache.hadoop.hbase.HRegionServer:
HRegionServer started at: 127.0.1.1:60010
2007-10-18 15:40:58,709 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 60010: starting
2007-10-18 15:40:58,867 INFO org.apache.hadoop.hbase.HStore: HStore
online for --ROOT--,,0/info
2007-10-18 15:40:58,872 INFO org.apache.hadoop.hbase.HRegion: region
--ROOT--,,0 available
2007-10-18 18:21:55,558 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: localhost/127.0.0.1:60000. Already tried 1 time(s).
2007-10-18 18:21:56,577 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: localhost/127.0.0.1:60000. Already tried 2 time(s).
2007-10-18 18:21:57,585 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: localhost/127.0.0.1:60000. Already tried 3 time(s).
2007-10-18 18:21:58,593 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: localhost/127.0.0.1:60000. Already tried 4 time(s).
2007-10-18 18:22:05,874 ERROR org.apache.hadoop.hbase.HRegionServer:
Can not start region server because
org.apache.hadoop.hbase.RegionServerRunningException: region server
already running at 127.0.1.1:60010 because logdir
/tmp/hadoop-hadoop/hbase/log_yangbin_60010 exists
        at org.apache.hadoop.hbase.HRegionServer.<init>(HRegionServer.java:482)
        at org.apache.hadoop.hbase.HRegionServer.<init>(HRegionServer.java:407)
        at org.apache.hadoop.hbase.HRegionServer.main(HRegionServer.java:1357)

2007-10-18 19:57:40,243 INFO org.apache.hadoop.util.NativeCodeLoader:
Loaded the native-hadoop library
2007-10-18 19:57:40,274 INFO
org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded &
initialized native-zlib library
2007-10-18 19:57:40,364 INFO org.apache.hadoop.ipc.Server: IPC Server
listener on 60010: starting
2007-10-18 19:57:40,366 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 0 on 60010: starting
2007-10-18 19:57:40,367 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 1 on 60010: starting
2007-10-18 19:57:40,368 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 2 on 60010: starting
2007-10-18 19:57:40,368 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 3 on 60010: starting
2007-10-18 19:57:40,369 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 4 on 60010: starting
2007-10-18 19:57:40,370 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 5 on 60010: starting
2007-10-18 19:57:40,371 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 6 on 60010: starting
2007-10-18 19:57:40,371 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 7 on 60010: starting
2007-10-18 19:57:40,372 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 8 on 60010: starting
2007-10-18 19:57:40,373 INFO org.apache.hadoop.hbase.HRegionServer:
HRegionServer started at: 127.0.1.1:60010
2007-10-18 19:57:40,384 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 9 on 60010: starting
2007-10-18 19:57:41,118 INFO org.apache.hadoop.hbase.HStore: HStore
online for --ROOT--,,0/info
2007-10-18 19:57:41,125 INFO org.apache.hadoop.hbase.HRegion: region
--ROOT--,,0 available

2. hbase-hadoop-master-yangbin.log

There is a lot of the below statement

2007-10-18 15:52:52,885 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 1 time(s).
2007-10-18 15:52:53,892 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 2 time(s).
2007-10-18 15:52:54,900 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 3 time(s).
2007-10-18 15:52:55,904 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 4 time(s).
2007-10-18 15:52:56,912 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 5 time(s).
2007-10-18 15:52:57,924 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 6 time(s).
2007-10-18 15:52:58,928 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 7 time(s).
2007-10-18 15:52:59,932 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 8 time(s).
2007-10-18 15:53:00,936 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 9 time(s).
2007-10-18 15:53:01,939 INFO org.apache.hadoop.ipc.Client: Retrying
connect to server: /127.0.1.1:60010. Already tried 10 time(s).
2007-10-18 15:53:02,943 INFO org.apache.hadoop.ipc.RPC: Server at
/127.0.1.1:60010 not available yet, Zzzzz...

Reply via email to