[
https://issues.apache.org/jira/browse/HBASE-1459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12715285#action_12715285
]
stack commented on HBASE-1459:
------------------------------
Rong-en: Looking at this one, its an odd one. Its saying that the snapshot is
being modified while we're flushing. The memcache makes a snapshot when it
moves current memcache aside replacing it with a new one. Until the snapshot
is successfully flushed, its read-only. Somehow a write is going into the
snapshot. Should never happen. Can I have logs from around the above
exception if you still have them.
Mind if I move this out of 0.19.4? It looks rare and its not going to happen
in 0.20.0 because the memcache datastructure now can be iterated without
throwing CME. Thanks Rong-en.
> CME during memcache flush forces HRS shutdown
> ---------------------------------------------
>
> Key: HBASE-1459
> URL: https://issues.apache.org/jira/browse/HBASE-1459
> Project: Hadoop HBase
> Issue Type: Bug
> Components: regionserver
> Affects Versions: 0.19.1
> Reporter: Rong-En Fan
> Fix For: 0.20.0, 0.19.4
>
>
> I just saw this on my 0.19.1 cluster:
> 2009-05-30 03:57:19,559 FATAL
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher: Replay of hlog
> required. Forcing server shutdown
> org.apache.hadoop.hbase.DroppedSnapshotException: region:
> table,rowkey,1243547152622
> at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:897)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.flushcache(HRegion.java:790)
> at
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.flushRegion(MemcacheFlusher.java:228)
> at
> org.apache.hadoop.hbase.regionserver.MemcacheFlusher.run(MemcacheFlusher.java:138)
> Caused by: java.util.ConcurrentModificationException
> at java.util.TreeMap$PrivateEntryIterator.nextEntry(TreeMap.java:1100)
> at java.util.TreeMap$EntryIterator.next(TreeMap.java:1136)
> at java.util.TreeMap$EntryIterator.next(TreeMap.java:1131)
> at
> org.apache.hadoop.hbase.regionserver.HStore.internalFlushCache(HStore.java:678)
> at org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:636)
> at
> org.apache.hadoop.hbase.regionserver.HRegion.internalFlushcache(HRegion.java:882)
> ... 3 more
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
