[
https://issues.apache.org/jira/browse/HBASE-7594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13559957#comment-13559957
]
Andrew Purtell commented on HBASE-7594:
---------------------------------------
Thanks. Now we can see what's actually going on after treating the symptom in
FixedFileTrailer:
I'm guessing a < v2 HFile is being opened as a v2? Hence the trouble with the
comparator.
{noformat}
2013-01-22 19:42:47,914 ERROR
[RS_OPEN_ROOT-asf000.sp2.ygridcore.net,40563,1358883761837-0]
handler.OpenRegionHandler(443): Failed open of region=-ROOT-,,0.70236052,
starting to roll back the global memstore size.
java.io.IOException: java.io.IOException: java.io.IOException: Expected block
of type ROOT_INDEX but found DATA
at
org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:616)
at
org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:537)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4033)
at
org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3983)
at
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
at
org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
at
org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.IOException: java.io.IOException: Expected block of type
ROOT_INDEX but found DATA
at
org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:466)
at org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:220)
at
org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3016)
at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:589)
at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:587)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
... 3 more
Caused by: java.io.IOException: Expected block of type ROOT_INDEX but found DATA
at
org.apache.hadoop.hbase.io.hfile.HFileBlock$AbstractFSReader$1.nextBlockWithBlockType(HFileBlock.java:1215)
at
org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:129)
at
org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
at
org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
at
org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1294)
at
org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
at
org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:442)
at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:438)
... 8 more
{noformat}
So this is crapping out trying to open some store file previously flushed for
-ROOT-. Detritus from an earlier test?
Right above we can see it's using /tmp/hbase-jenkins:
{noformat}
2013-01-22 19:42:47,811 DEBUG
[RS_OPEN_ROOT-asf000.sp2.ygridcore.net,40563,1358883761837-0]
wal.SequenceFileLogWriter(193):
Path=file:/tmp/hbase-jenkins/hbase/.logs/asf000.sp2.ygridcore.net,40563,1358883761837/asf000.sp2.ygridcore.net%2C40563%2C1358883761837.1358883767809.meta,
compression=false
{noformat}
Maybe picking up some junk.
> TestLocalHBaseCluster failing on ubuntu2
> ----------------------------------------
>
> Key: HBASE-7594
> URL: https://issues.apache.org/jira/browse/HBASE-7594
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 0.96.0
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Attachments: 7594-1.patch, 7594-2.patch, 7594-3.patch, 7594-4.patch
>
>
> {noformat}
> java.io.IOException: java.io.IOException: java.io.IOException:
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> at
> org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:612)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:533)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4092)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:4042)
> at
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:427)
> at
> org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:130)
> at
> org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:202)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: java.io.IOException:
> java.lang.InstantiationException: org.apache.hadoop.io.RawComparator
> at
> org.apache.hadoop.hbase.regionserver.HStore.loadStoreFiles(HStore.java:450)
> at org.apache.hadoop.hbase.regionserver.HStore.<init>(HStore.java:215)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:3060)
> at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:585)
> at org.apache.hadoop.hbase.regionserver.HRegion$1.call(HRegion.java:583)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> ... 3 more
> Caused by: java.io.IOException: java.lang.InstantiationException:
> org.apache.hadoop.io.RawComparator
> at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:607)
> at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:615)
> at
> org.apache.hadoop.hbase.io.hfile.HFileReaderV2.<init>(HFileReaderV2.java:115)
> at
> org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:564)
> at
> org.apache.hadoop.hbase.io.hfile.HFile.createReaderWithEncoding(HFile.java:599)
> at
> org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1294)
> at
> org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:525)
> at
> org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:628)
> at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:426)
> at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:422)
> ... 8 more
> Caused by: java.lang.InstantiationException:
> org.apache.hadoop.io.RawComparator
> at java.lang.Class.newInstance0(Class.java:340)
> at java.lang.Class.newInstance(Class.java:308)
> at
> org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.createComparator(FixedFileTrailer.java:605)
> ... 17 more
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
