Will file in 0.20.1 once I finish debugging the problem looks like its the
column not the key causing the problem
Billy
----- Original Message -----
From: "stack" <[email protected]>
Newsgroups:
gmane.comp.java.hadoop.hbase.devel,gmane.comp.java.hadoop.hbase.user
To: <hbase-dev-7ArZoLwFLBtd/SJB6HiN2Ni2O/[email protected]>
Cc: <hbase-user-7ArZoLwFLBtd/SJB6HiN2Ni2O/[email protected]>
Sent: Tuesday, August 18, 2009 1:46 PM
Subject: Re: hbase 0.20.0 Release Candidate 2 available for download
Please file a bug Billy.
IMO this is not a critical issue since its easy enough making a
workaround.
Thanks,
St.Ack
On Tue, Aug 18, 2009 at 10:58 AM, Billy Pearson
<sales-bilS+b3c8gufP+p43NWRKVaTQe2KTcn/@public.gmane.org>wrote:
testing RC2
found
2009-08-18 12:54:16,572 FATAL
org.apache.hadoop.hbase.regionserver.MemStoreFlusher: Replay of hlog
required. Forcing server shutdown
org.apache.hadoop.hbase.DroppedSnapshotException: region:
webdata,http:\x2F\x2Fanaal-genomen.isporno.nl\x2F,1250569930062
at
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:950)
at
org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:843)
at
org.apache.hadoop.hbase.regionserver.MemStoreFlusher.flushRegion(MemStoreFlusher.java:241)
at
org.apache.hadoop.hbase.regionserver.MemStoreFlusher.run(MemStoreFlusher.java:149)
Caused by: java.io.IOException: Key length 183108 > 65536
at
org.apache.hadoop.hbase.io.hfile.HFile$Writer.checkKey(HFile.java:511)
at
org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:479)
at
org.apache.hadoop.hbase.io.hfile.HFile$Writer.append(HFile.java:447)
at
org.apache.hadoop.hbase.regionserver.Store.internalFlushCache(Store.java:525)
at
org.apache.hadoop.hbase.regionserver.Store.flushCache(Store.java:489)
at
org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:935)
... 3 more
looks like from a mr job we allow keys larger then 65536 to be processed
but when the memcache flush happends we kill the server should the client
not fail before the long key gets in to memory?
Billy
"stack" <[email protected]> wrote in message
news:7c962aed0908172252q5eab02fax7dfada4ee99dcb32-JsoAwUIsXouq+1Nelnf3ueG/[email protected]
The second hbase 0.20.0 release candidate is available for download:
http://people.apache.org/~stack/hbase-0.20.0-candidate-2/<http://people.apache.org/%7Estack/hbase-0.20.0-candidate-2/>
Near to 450 issues have been addressed since the 0.19 branch. Release
notes
are available here: http://su.pr/18zcEO <http://tinyurl.com/8xmyx9>.
HBase 0.20.0 runs on Hadoop 0.20.0. Alot has changed since 0.19.x
including
configuration fundamentals. Be sure to read the 'Getting Started'
documentation in 0.20.0 available here: http://su.pr/8YQjHO
If you wish to bring your 0.19.x hbase data forward to 0.20.0, you will
need
to run a migration. See
http://wiki.apache.org/hadoop/Hbase/HowToMigrate
.
First read the overview and then go to the section, 'From 0.19.x to
0.20.x'.
Should we release this candidate as hbase 0.20.0? Please vote +1/-1 by
Wednesday, August 25th.
Yours,
The HBasistas
