I took the old hbase 0.2.0 EC2 scripts and modified them to work with
Hadoop 0.18.2 / hbase 0.18.1. Things seemed to be working and I can see
the cluster with the different regions etc. of both the hadoop port
50030 and hbase 60010.
I will release these scripts once they are working properly.
My problem is that whenever I execute code on the master node it is
running as local.
"09/01/13 09:22:40 INFO mapred.JobClient: Running job: job_local_0001"
That is, the table is generated , the data gets in the table but I get a
"local" indication in the job name and I see no reflection of the actual
Map reduce via the web interface at port 50030.
I attach the hadoop-site and hbase site file here:
HADOOP
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hadoop.tmp.dir</name>
<value>/mnt/hadoop</value>
</property>
<property>
<name>fs.default.name</name>
<value>hdfs://domU-12-31-39-00-13-A1.compute-1.internal:50001</value>
</property>
<property>
<name>mapred.job.tracker</name>
<value>domU-12-31-39-00-13-A1.compute-1.internal:50002</value>
</property>
<property>
<name>tasktracker.http.threads</name>
<value>80</value>
</property>
<property>
<name>mapred.tasktracker.map.tasks.maximum</name>
<value>4</value>
</property>
<property>
<name>mapred.tasktracker.reduce.tasks.maximum</name>
<value>4</value>
</property>
<property>
<name>mapred.output.compress</name>
<value>true</value>
</property>
<property>
<name>mapred.output.compression.type</name>
<value>BLOCK</value>
</property>
<property>
<name>dfs.client.block.write.retries</name>
<value>3</value>
</property>
HBASE
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<configuration>
<property>
<name>hbase.master</name>
<value>domU-12-31-39-00-13-A1.compute-1.internal:60000</value>
</property>
<property>
<name>hbase.rootdir</name>
<value>hdfs://domU-12-31-39-00-13-A1.compute-1.internal:50001/hbase</val
ue>
</property>
</configuration>
Here is the Captured printscreen using Elasticfox
Master Attributes
Attribute Name
Value
Description
HBase Version
0.18.1, r707159
HBase version and svn revision
HBase Compiled
Wed Oct 22 12:43:06 PDT 2008, stack
When HBase version was compiled and by whom
Hadoop Version
0.18.1, r694836
Hadoop version and svn revision
Hadoop Compiled
Fri Sep 12 23:29:35 UTC 2008, hadoopqa
When Hadoop version was compiled and by whom
Filesystem
hdfs://domU-12-31-39-00-13-A1.compute-1.internal:50001/hbase
Filesystem HBase is running on
HBase Root Directory
hdfs://domU-12-31-39-00-13-A1.compute-1.internal:50001/hbase
Location of HBase home directory
Load average
1.0
Average load across all region servers. Naive computation.
Catalog Tables
Table
Description
-ROOT-
<http://ec2-174-129-169-159.compute-1.amazonaws.com:60010/table.jsp?name
=-ROOT->
The -ROOT- table holds references to all .META. regions.
.META.
<http://ec2-174-129-169-159.compute-1.amazonaws.com:60010/table.jsp?name
=.META.>
The .META. table holds references to all User Table regions
User Tables
1 table(s) in set.
Table
Description
ase
<http://ec2-174-129-169-159.compute-1.amazonaws.com:60010/table.jsp?name
=ase>
{NAME => 'ase', IS_ROOT => 'false', IS_META => 'false', FAMILIES =>
[{NAME => 'URL', BLOOMFILTER => 'false', COMPRESSION => 'NONE', VERSIONS
=> '2147483647', LENGTH => '2147483647', TTL => '7257600', IN_MEMORY =>
'false', BLOCKCACHE => 'false'}, {NAME => 'CATEGORY', BLOOMFILTER =>
'false', COMPRESSION => 'NONE', VERSIONS => '2147483647', LENGTH =>
'2147483647', TTL => '7257600', IN_MEMORY => 'false', BLOCKCACHE =>
'false'}, {NAME => 'SEARCHTERM', BLOOMFILTER => 'false', COMPRESSION =>
'NONE', VERSIONS => '2147483647', LENGTH => '2147483647', TTL =>
'7257600', IN_MEMORY => 'false', BLOCKCACHE => 'false'}]}
Region Servers
Address
Start Code
Load
domU-12-31-39-02-CD-82.compute-1.internal:60020
<http://domU-12-31-39-02-CD-82.compute-1.internal:60030/>
1231836487534
requests: 0 regions: 2
domU-12-31-39-02-10-91.compute-1.internal:60020
<http://domU-12-31-39-02-10-91.compute-1.internal:60030/>
1231836848289
requests: 0 regions: 1
domU-12-31-39-00-13-A1.compute-1.internal:60020
<http://domU-12-31-39-00-13-A1.compute-1.internal:60030/>
1231853256586
requests: 0 regions: 0
Total:
servers: 3
requests: 0 regions: 3
Load is requests per second and count of regions loaded
