could it be from the global memcache limit
I set my hbase.hregion.memcache.flush.size =
hbase.regionserver.globalMemcacheLimit
So that memcache flushes are only as needed.
But now with the client cache it could it be exceeding that limit to fast
and causing this error?
My version is current trunk and I am writing 8 threads to one region server
with 8 regions.
Billy
----- Original Message -----
From: "Michael Stack" <[EMAIL PROTECTED]>
Newsgroups: gmane.comp.java.hadoop.hbase.user
To: <hbase-user-7ArZoLwFLBtd/SJB6HiN2Ni2O/[EMAIL PROTECTED]>
Sent: Monday, November 10, 2008 11:33 PM
Subject: Re: java.io.IOException: java.util.NoSuchElementException
Thats an odd one Billy. We're in that bit of code because we need to
flush some regions fast because we're up at memory thresholds -- but we're
getting java.util.NoSuchElementException because there are no regions to
flush. HBASE-990 in trunk addresses the immediate silly error of trying
to get a first element from a Set that has none, but do you have an idea
why there'd be memory pressure in the hbase heap though no seemingly no
regions online?
Thanks,
St.Ack
Billy Pearson wrote:
The first post was from the reducer
This is from the region server
2008-11-10 18:14:53,157 INFO org.apache.hadoop.ipc.Server: IPC Server
handler 69 on 60020, call batchUpdates([EMAIL PROTECTED],
[Lorg.apache.hadoop.hbase.io.BatchUpdate;@1b8e8d2) from
192.168.1.201:37077: error: java.io.IOException:
java.util.NoSuchElementException
java.io.IOException: java.util.NoSuchElementException
at java.util.TreeMap.key(TreeMap.java:1206)
at java.util.TreeMap.firstKey(TreeMap.java:267)
at
org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushSomeRegions(MemcacheFlusher.java:227)
at
org.apache.hadoop.hbase.regionserver.MemcacheFlusher.reclaimMemcacheMemory(MemcacheFlusher.java:213)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdates(HRegionServer.java:1227)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:634)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
"Billy Pearson" <sales-bilS+b3c8gufP+p43NWRKVaTQe2KTcn/@public.gmane.org>
wrote in message news:[EMAIL PROTECTED]
I started getting these when the server are under heavy load
java.io.IOException: java.io.IOException:
java.util.NoSuchElementException
at java.util.TreeMap.key(TreeMap.java:1206)
at java.util.TreeMap.firstKey(TreeMap.java:267)
at
org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushSomeRegions(MemcacheFlusher.java:227)
at
org.apache.hadoop.hbase.regionserver.MemcacheFlusher.reclaimMemcacheMemory(MemcacheFlusher.java:213)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.batchUpdates(HRegionServer.java:1227)
at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HbaseRPC$Server.call(HbaseRPC.java:634)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:888)
