Here goes the exception details.. I again encountered...
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$mutateRowsTs_result$1.class
11/01/16 20:22:59 INFO wal.HLogSplitter: Split writers finished
11/01/16 20:22:59 ERROR master.MasterFileSystem: Failed splitting
file:/tmp/hbase-karan/hbase/.logs/abinash,3620,1295188307109
java.io.IOException: Unable to delete src dir:
file:/tmp/hbase-karan/hbase/.logs/abinash,3620,1295188307109
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.archiveLogs(HLogSplitt
er.java:341)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:290)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:187)
at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja
va:196)
at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF
ileSystem.java:180)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378
)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo
mmandLine.java:193)
at java.lang.Thread.run(Unknown Source)
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$Iface.class
11/01/16 20:22:59 INFO master.MasterFileSystem: Log folder
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984 doesn't belong
to a known regi
on server, splitting
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$deleteAllTs_args.class
11/01/16 20:22:59 INFO wal.HLogSplitter: Splitting 1 hlog(s) in
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$Processor$atomicIncrement.cla
ss
11/01/16 20:22:59 DEBUG wal.HLogSplitter: Splitting hlog 1 of 1:
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
129518950
2031, length=8192
11/01/16 20:22:59 WARN util.FSUtils: Running on HDFS without append enabled
may result in data loss
11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread
Thread[WriterThread-0,6,main]: starting
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$mutateRow_args$_Fields.class
11/01/16 20:22:59 WARN fs.FSInputChecker: Problem opening checksum file:
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
1
295189502031. Ignoring exception: java.io.EOFException
at java.io.DataInputStream.readFully(Unknown Source)
at java.io.DataInputStream.readFully(Unknown Source)
at
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(Checks
umFileSystem.java:134)
at
org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283)
at
org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1444)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.ope
nFile(SequenceFileLogReader.java:65)
at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1431)
at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424)
at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1419)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<in
it>(SequenceFileLogReader.java:57)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(Sequence
FileLogReader.java:158)
at
org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:576)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter
.java:469)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.parseHLog(HLogSplitter
.java:406)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:261)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:187)
at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja
va:196)
at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF
ileSystem.java:180)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378
)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo
mmandLine.java:193)
at java.lang.Thread.run(Unknown Source)
11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread
Thread[WriterThread-2,6,main]: starting
11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread
Thread[WriterThread-1,6,main]: starting
11/01/16 20:22:59 WARN wal.SequenceFileLogReader: Error while trying to get
accurate file length. Truncation / data loss may occur if RegionServers d
ie.
java.lang.NoSuchMethodException:
org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.getFileLength
()
at java.lang.Class.getMethod(Unknown Source)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader$WAL
ReaderFSDataInputStream.getPos(SequenceFileLogReader.java:107)
at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1434)
at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424)
at
org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1419)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<in
it>(SequenceFileLogReader.java:57)
at
org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(Sequence
FileLogReader.java:158)
at
org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:576)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter
.java:469)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.parseHLog(HLogSplitter
.java:406)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:261)
at
org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter.
java:187)
at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja
va:196)
at
org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF
ileSystem.java:180)
at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378
)
at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo
mmandLine.java:193)
at java.lang.Thread.run(Unknown Source)
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$getColumnDescriptors_result$1
.class
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/generated/Hbase$scannerOpenWithPrefix_result$
_Fields.class
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftServer$HBaseHandler$1.class
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftServer$HBaseHandler.class
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftUtilities.class
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/thrift/ThriftServer.class
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
org/apache/hadoop/hbase/HColumnDescriptor$CompressionType.class
11/01/16 20:22:59 DEBUG wal.HLogSplitter: Pushed=31 entries from
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
129518950
2031
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/LICENSE
11/01/16 20:22:59 INFO wal.HLogSplitter: EOF from hlog
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
1295189502031. con
tinuing
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/NOTICE
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/DEPENDENCIES
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
hbase-webapps/master/index.html
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
hbase-webapps/master/WEB-INF/web.xml
11/01/16 20:22:59 INFO wal.SequenceFileLogWriter: syncFs -- HDFS-200 -- not
available, dfs.support.append=false
11/01/16 20:22:59 DEBUG wal.HLogSplitter: Creating writer
path=file:/tmp/hbase-karan/hbase/-ROOT-/70236052/recovered.edits/00000000000
00002697 region=
70236052
11/01/16 20:22:59 INFO wal.HLogSplitter: Archived processed log
file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030.
1295189502
031 to file:/tmp/hbase-karan/hbase/.oldlogs/abinash%3A4030.1295189502031
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry:
hbase-webapps/static/hbase_logo_med.gif
-----Original Message-----
From: Ted Dunning [mailto:[email protected]]
Sent: Saturday, January 08, 2011 2:28 AM
To: [email protected]
Subject: Re: java.lang.NoSuchMethodException: hbase-0.90
Great. I will file a patch to move the check to the constructor and fail
back to
old process if the method is missing.
For our case, I just implemented getFileLength and all is happy (on that
front)
On Fri, Jan 7, 2011 at 12:38 PM, Stack <[email protected]> wrote:
> Let me open an issue to add more checks around the reflection; e.g.
> check type as you fellas suggest. If anything is not as expected,
> then we'd fallback on old getPos behavior. It should not fail for
> 'pure' HDFS. 'Alternative' HDFS's probably don't have this 2G
> problem.
>
