[
https://issues.apache.org/jira/browse/HBASE-12782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14269730#comment-14269730
]
stack commented on HBASE-12782:
-------------------------------
Script running MR job. 25M per slot. 5 servers/slots. 125M per map task seems
to bring on the failure pretty reliably.
[stack@c2020 ~]$ more bin/generator.sh
export HOME=/home/stack
export JAVA_HOME=${HOME}/bin/jdk1.7.0_67/
export HBASE_HOME=${HOME}/hbase
echo 'disable "IntegrationTestBigLinkedList"; drop
"IntegrationTestBigLinkedList"'| ${HOME}/hbase/bin/hbase --config
${HOME}/conf_hbase shell
date=`date -u +"%Y%m%dT%H%M%SZ"`
export HADOOP_CLASSPATH="${HOME}/conf_hbase:`${HOME}/hbase/bin/hbase classpath`"
${HOME}/hadoop/bin/hadoop --config ${HOME}/conf_hadoop
org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
serverKilling Generator 5 25000000 g.$date
Here is how I run verify:
[stack@c2020 ~]$ more bin/verify.sh
export HOME=/home/stack
export JAVA_HOME=${HOME}/bin/jdk1.7.0_67/
export HBASE_HOME=${HOME}/hbase
date=`date -u +"%Y%m%dT%H%M%SZ"`
export HADOOP_CLASSPATH="${HOME}/conf_hbase:`${HOME}/hbase/bin/hbase classpath`"
${HOME}/hadoop/bin/hadoop --config ${HOME}/conf_hadoop
org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList Verify v.$date 5
Bits of shell I've been using debugging:
hbase(main):021:0> java.util.Date.new(1420593779581).toString()
hbase(main):051:0> c = org.apache.hadoop.hbase.HBaseConfiguration.create
=> #<Java::OrgApacheHadoopConf::Configuration:0x3905ee13>
hbase(main):054:0> t = org.apache.hadoop.hbase.client.HTable.new(c,
"IntegrationTestBigLinkedList")
=> #<Java::OrgApacheHadoopHbaseClient::HTable:0x787ce7d9>
hbase(main):056:0>
t.getRegionLocation("\xC0AqA\xEC\xF6\xFEd\xE6\xB3\xD6\xABs\xD9!w")
=> #<Java::OrgApacheHadoopHbase::HRegionLocation:0x5b12e5ff>
hbase(main):057:0> rl =
t.getRegionLocation("\xC0AqA\xEC\xF6\xFEd\xE6\xB3\xD6\xABs\xD9!w")
=> #<Java::OrgApacheHadoopHbase::HRegionLocation:0x5b12e5ff>
hbase(main):058:0> print rl
region=IntegrationTestBigLinkedList,\xE6ffffffX,1420593356701.20d5b9a6b5c4855ce61cb6db4f766767.,
hostname=c2025.halxg.cloudera.com,16020,1420590827340,
seqNum=9928hbase(main):059:0>
hbase(main):002:0*
org.apache.hadoop.hbase.util.Bytes.toLong("\x00\x00\x00\x00\x00\xED\xAB\xE6".to_java_bytes)
=> 15576038
> ITBLL fails for me if generator does anything but 5M per maptask
> ----------------------------------------------------------------
>
> Key: HBASE-12782
> URL: https://issues.apache.org/jira/browse/HBASE-12782
> Project: HBase
> Issue Type: Bug
> Components: integration tests
> Affects Versions: 1.0.0
> Reporter: stack
> Priority: Critical
> Fix For: 1.0.0
>
>
> Anyone else seeing this? If I do an ITBLL with generator doing 5M rows per
> maptask, all is good -- verify passes. I've been running 5 servers and had
> one splot per server. So below works:
> HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase
> classpath`" ./hadoop/bin/hadoop --config ~/conf_hadoop
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
> serverKilling Generator 5 5000000 g1.tmp
> or if I double the map tasks, it works:
> HADOOP_CLASSPATH="/home/stack/conf_hbase:`/home/stack/hbase/bin/hbase
> classpath`" ./hadoop/bin/hadoop --config ~/conf_hadoop
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList --monkey
> serverKilling Generator 10 5000000 g2.tmp
> ...but if I change the 5M to 50M or 25M, Verify fails.
> Looking into it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
