Hi All:
I am a newbie for testing the hadoop suite. When I am test the hbase
importtsv command,
hadoop jar $HBASE_HOME/hbase-0.90.4-cdh3u2.jar importtsv
-Dimporttsv.separator=, -Dimporttsv.bulk.output=/tmp/output
-Dimporttsv.columns=HBASE_ROW_KEY,e:a,e:b,e:c t1 /tmp/1
I got below error even though I assign the -Dimporttsv.bulk.output:
11/12/09 09:24:58 WARN
client.HConnectionManager$HConnectionImplementation: Encountered problems when
prefetch META table:
org.apache.hadoop.hbase.TableNotFoundException: Cannot find row in .META. for
table: t1, row=t1,,99999999999999
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:136)
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:95)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.prefetchRegionCache(HConnectionManager.java:649)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:703)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:594)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:559)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:173)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
at
org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:305)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:393)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:49)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:186)
My env:
SuseLinux 11 SP1+SDK
JDK 1.6.0_27-b07
Hadoop version: hadoop cdh3u2 suite, gz package
There are three machine, one for master and other two are datanodes.
Linux user is : hadoop,
Hadoop user bash env:
export HADOOP_HOME=/usr/local/hadoop/hadoop-0.20.2-cdh3u2
export PATH=$HADOOP_HOME/bin:$PATH
export HADOOP_CONF_DIR=/usr/local/hadoop/hadoop-0.20.2-cdh3u2/conf
export HADOOP_LIB=$HADOOP_HOME/lib
export HBASE_HOME=/usr/local/hadoop/hbase-0.90.4-cdh3u2
export HBASE_LIB=/usr/local/hadoop/hbase-0.90.4-cdh3u2/lib
export PATH=$PATH:$HBASE_HOME/bin
export HIVE_HOME=/usr/local/hadoop/hive-0.7.1-cdh3u2
export HIVE_CONF_DIR=$HIVE_HOME/conf
export HIVE_LIB=$HIVE_HOME/lib
export
HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$HBASE_HOME/conf/hbase-site.xml:$HBASE_HOME/hbase-0.90.4-cdh3u2.jar
export ZOOKEEPER_HOME=/usr/local/hadoop/zookeeper-3.3.3-cdh3u2
export
HADOOP_CLASSPATH=$HADOOP_CLASSPATH:$ZOOKEEPER_HOME/zookeeper-3.3.3-cdh3u2.jar:$HBASE_HOME/lib/guava-r06.jar
export PATH=$ZOOKEEPER/bin/:$PATH
export PIG_HOME=/usr/local/hadoop/pig-0.8.1-cdh3u2
export PATH=$PIG_HOME/bin/:$PATH
export PIG_HADOOP_VERSION=20
export PIG_CLASSPATH=$HADOOP_HOME/conf/
export CLASSPATH=`${HBASE_HOME}/bin/hbase classpath`
hadoop master core-site.xml:
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://bjhl-hadoopmaster:54310/</value>
</property>
<property>
<name>hadoop.tmp.dir</name>
<value>/usr/local/hadoop/tmp/</value>
</property>
<property>
<name>heartbeat.recheck.interval</name>
<value>5000</value>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
<description>Property from ZooKeeper config zoo.cfg.</description>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>bjhl-hadoopmaster,bjhl-hadoopslave1,bjhl-hadoopslave2</value>
<description>Comma separated list of servers in the ZooKeeper
Quorum.</description>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/usr/local/hadoop/zookeeper-data</value>
</property>
</configuration>
Hadoop hdfs-site.xml:
<configuration>
<property>
<name>dfs.name.dir</name>
<value>/usr/local/hadoop/name/</value>
</property>
<property>
<name>dfs.replication</name>
<value>1</value>
</property>
<property>
<name>dfs.permissions</name>
<value>false</value>
</property>
<property>
<name>dfs.web.ugi</name>
<value>hadoop,supergroup</value>
</property>
</configuration>
Hbase hbase-site.xml:
<configuration>
<property>
<name>hbase.rootdir</name>
<value>hdfs://bjhl-hadoopmaster:54310/hbase</value>
<description>The directory shared by region
servers.</description>
</property>
<property>
<name>hbase.tmp.dir</name>
<value>/usr/local/hadoop/tmp</value>
<description>Temporary directory on the local
filesystem.</description>
</property>
<property>
<name>hbase.master</name>
<value>bjhl-hadoopmaster:60000</value>
<description>The port master should bind to.</description>
</property>
<property>
<name>hbase.cluster.distributed</name>
<value>true</value>
<description></description>
</property>
<property>
<name>hbase.zookeeper.property.clientPort</name>
<value>2181</value>
<description>Property from ZooKeeper config
zoo.cfg.</description>
</property>
<property>
<name>hbase.zookeeper.quorum</name>
<value>bjhl-hadoopmaster,bjhl-hadoopslave1,bjhl-hadoopslave2</value>
<description>Comma separated list of servers in the ZooKeeper
Quorum.</description>
</property>
<property>
<name>hbase.zookeeper.property.dataDir</name>
<value>/usr/local/hadoop/hbase-data</value>
</property>
</configuration>
Start order: hadoop zookeeper hbase
When I start hbase, there is a warn in one datanode:
11/12/08 19:08:54 WARN wal.HLog: HDFS pipeline error detected. Found 2
replicas but expecting 3 replicas. Requesting close of hlog.
I googled the internet, and there is no answer. And I serach the mail list, the
answer are the hbase 0.90 version.
I also run check_meta.rb, its result say the meta is ok.
From hbase cli, I scan the .META. there is no table t1.
Can somebody help me? Thx. Thousand.
________________________________
窦晓峰
华为朗新
Mobile: 18600127780 13501399226
Email: [email protected]
http://www.huawei.com
________________________________
本邮件及其附件含有华为公司的保密信息，仅限于发送给上面地址中列出的个人或群组。禁
止任何其他人以任何形式使用（包括但不限于全部或部分地泄露、复制、或散发）本邮件中
的信息。如果您错收了本邮件，请您立即电话或邮件通知发件人并删除本邮件！
This e-mail and its attachments contain confidential information from HUAWEI,
which
is intended only for the person or entity whose address is listed above. Any
use of the
information contained herein in any way (including, but not limited to, total
or partial
disclosure, reproduction, or dissemination) by
