[
https://issues.apache.org/jira/browse/HADOOP-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
stack resolved HADOOP-1753.
---------------------------
Resolution: Duplicate
Fix Version/s: 0.15.0
Fixed in HADOOP-1776
> [hbase] Move at end of compaction sometimes fails
> -------------------------------------------------
>
> Key: HADOOP-1753
> URL: https://issues.apache.org/jira/browse/HADOOP-1753
> Project: Hadoop
> Issue Type: Bug
> Components: contrib/hbase
> Reporter: stack
> Assignee: stack
> Fix For: 0.15.0
>
>
> I've seen the following exception a couple of times loading a cluster with
> data
> {code}
> 2007-08-21 23:52:08,079 INFO org.apache.hadoop.hbase.HRegion: starting
> compaction on region
> hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359
> 2007-08-21 23:52:08,079 DEBUG org.apache.hadoop.hbase.HStore: started
> compaction of 3 files in
> /bfd/hadoop-stack-data/tmp/hbase/compaction.tmp/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo
> 2007-08-21 23:52:13,129 DEBUG org.apache.hadoop.hbase.HStore: moving
> hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/-1 in
> /bfd/hadoop-stack-data/tmp/hbase/compaction.tmp to
> hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/4863512705511503252
> in /bfd/hadoop-stack-data/tmp/hbase
> 2007-08-21 23:52:13,214 ERROR org.apache.hadoop.hbase.HRegionServer: What
> happens if this fails? Are we toast?
> org.apache.hadoop.ipc.RemoteException: java.io.IOException: File does not
> exist
> at org.apache.hadoop.dfs.FSDirectory.getFileInfo(FSDirectory.java:747)
> at
> org.apache.hadoop.dfs.FSNamesystem.getFileInfo(FSNamesystem.java:1253)
> at org.apache.hadoop.dfs.NameNode.getFileInfo(NameNode.java:459)
> at sun.reflect.GeneratedMethodAccessor19.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:340)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:566)
> at org.apache.hadoop.ipc.Client.call(Client.java:470)
> at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:165)
> at org.apache.hadoop.dfs.$Proxy0.getFileInfo(Unknown Source)
> at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:82)
> at
> org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:59)
> at org.apache.hadoop.dfs.$Proxy0.getFileInfo(Unknown Source)
> at org.apache.hadoop.dfs.DFSClient.getFileInfo(DFSClient.java:431)
> at
> org.apache.hadoop.dfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:342)
> at org.apache.hadoop.fs.FileSystem.getLength(FileSystem.java:449)
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1220)
> at
> org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1215)
> at org.apache.hadoop.io.MapFile$Reader.<init>(MapFile.java:228)
> at org.apache.hadoop.io.MapFile$Reader.<init>(MapFile.java:216)
> at
> org.apache.hadoop.hbase.HStoreFile$BloomFilterMapFile$Reader.<init>(HStoreFile.java:813)
> at org.apache.hadoop.hbase.HStoreFile.getReader(HStoreFile.java:925)
> at
> org.apache.hadoop.hbase.HStore.processReadyCompaction(HStore.java:996)
> at org.apache.hadoop.hbase.HStore.compactHelper(HStore.java:658)
> at org.apache.hadoop.hbase.HStore.compactHelper(HStore.java:564)
> at org.apache.hadoop.hbase.HStore.compact(HStore.java:559)
> at org.apache.hadoop.hbase.HRegion.compactStores(HRegion.java:700)
> at
> org.apache.hadoop.hbase.HRegionServer$SplitOrCompactChecker.run(HRegionServer.java:169)
> at java.lang.Thread.run(Thread.java:619)
> {code}
> Looking on the filesystem, I see the following for the problematic store:
> {code}
> /bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/info
> <dir> 2007-08-21 23:52
> /bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/info/4863512705511503252
> <r 3> 9 2007-08-21 23:52
> /bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/mapfiles
> <dir> 2007-08-21 23:52
> /bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/mapfiles/4863512705511503252
> <dir> 2007-08-21 23:52
> /bfd/hadoop-stack-data/tmp/hbase/hregion_hbaserepository,Rc0CnuSEIxXeO1CAcLTV2V==,221090350699527359/repo/mapfiles/4863512705511503252/index
> <r 3> 8340 2007-08-21 23:52
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
