On taking it for a spin I'm having issues when I kill the RS and DN that's
holding root.
Spun up a new dfs on hadoop-0.20.2-cdh3u3
Started hbase
started running loadtest tool.
killed rs and dn holding root with killall -9 java on server sv4r27s44 at
about 2012-07-25 22:40:00
After things stabilize Root is in a bad state. Ran hbck and got:
Exception in thread "main"
org.apache.hadoop.hbase.client.NoServerForRegionException: No server
address listed in -ROOT- for region .META.,,1.1028785192 containing row
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegionInMeta(HConnectionManager.java:1016)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:841)
at
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.locateRegion(HConnectionManager.java:810)
at org.apache.hadoop.hbase.client.HTable.finishSetup(HTable.java:232)
at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:172)
at org.apache.hadoop.hbase.util.HBaseFsck.connect(HBaseFsck.java:241)
at org.apache.hadoop.hbase.util.HBaseFsck.main(HBaseFsck.java:3236)
hbase(main):001:0> scan '-ROOT-'
ROW COLUMN+CELL
12/07/25 22:43:18 INFO security.UserGroupInformation: JAAS Configuration
already set up for Hadoop, not re-installing.
.META.,,1 column=info:regioninfo,
timestamp=1343255838525, value={NAME => '.META.,,1', STARTKEY => '', ENDKEY
=> '', ENCODED => 1028785192,}
.META.,,1 column=info:v,
timestamp=1343255838525, value=\x00\x00
1 row(s) in 0.5930 seconds
Here's the master log: https://gist.github.com/3179194
I tried the same thing with 0.92.1 and I was able to get into a similar
situation, so I don't think this is anything new. I'm going to file an
issue with what I've seen, since all that was required to fix it was a move
of meta.
On Tue, Jul 24, 2012 at 9:09 PM, lars hofhansl <[email protected]> wrote:
>
> The 2nd 0.94.1 RC is available for download here:
http://people.apache.org/~larsh/hbase-0.94.1-rc1/
>
> Signed with my code signing key: A1AC25A9
>
> 0.94.1 is a bug fix release and has 156 issues resolved against it.
>
> The full list of changes is available here:
>
https://issues.apache.org/jira/secure/IssueNavigator.jspa?reset=true&jqlQuery=project+%3D+HBASE+AND+fixVersion+%3D+%220.94.1%22+AND+status+%3D+Resolved+ORDER+BY+priority+DESC&mode=hide
>
> The tests on the Jenkins machines are stable again and the artifact were
built there.
>
> Please take the RC for a spin, check out the doc, etc, and vote +1/-1 by
August 7th on whether we should release this as 0.94.1.
>
> The testing spreadsheet is here:
>
https://docs.google.com/spreadsheet/ccc?key=0AvLqcVIqNtlTdDAxUmwzVkpXSl9DN0tGUmYxUFhub0E#gid=0
>
> Thanks.
>
> -- Lars
