http://www.riptano.com/docs/0.6/troubleshooting/index#nodes-are-dying-with-oom-errors
On Wed, Nov 24, 2010 at 4:38 PM, zangds <zan...@ihep.ac.cn> wrote: > Hi, > I'm using apache-cassandra-0.7.0-beta3 , when I did some insertions into > cassandra,I got errors that stop cassandra from working, anyone have a look > on this? > > WARN [ScheduledTasks:1] 2010-11-24 22:38:33,067 MessagingService.java (line 515) Dropped 39 messages in the > last 1000ms > ERROR [ReadStage:3] 2010-11-24 22:38:33,075 AbstractCassandraDaemon.java (line 89) Fatal exception in thread > Thread[ReadStage:3,5,main] > java.lang.OutOfMemoryError: Java heap space > ERROR [ReadStage:7] 2010-11-24 22:38:49,581 AbstractCassandraDaemon.java (line 89) Fatal exception in thread > Thread[ReadStage:7,5,main] > java.lang.OutOfMemoryError: Java heap space > ERROR [ReadStage:4] 2010-11-24 22:38:49,581 AbstractCassandraDaemon.java (line 89) Fatal exception in thread > Thread[ReadStage:4,5,main] > java.lang.OutOfMemoryError: Java heap space > ERROR [ReadStage:6] 2010-11-24 22:38:49,580 AbstractCassandraDaemon.java (line 89) Fatal exception in thread > Thread[ReadStage:6,5,main] > java.lang.OutOfMemoryError: Java heap space > at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:89) > at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:342) > at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:291) > at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:79) > at org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:40) > at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136) > at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131) > at org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:108 > ) > at org.apache.commons.collections.iterators.CollatingIterator.anyHasNext(CollatingIterator.java:364) > at org.apache.commons.collections.iterators.CollatingIterator.hasNext(CollatingIterator.java:217) > at org.apache.cassandra.utils.ReducingIterator.computeNext(ReducingIterator.java:63) > at com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:136) > at com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:131) > at org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilter.java:122) > at org.apache.cassandra.db.filter.QueryFilter.collectCollatedColumns(QueryFilter.java:146) > at org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1208) > at org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1068) > at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1092) > at org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1055) > at org.apache.cassandra.db.Table.getRow(Table.java:359) > at org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:63) > at org.apache.cassandra.service.StorageProxy$weakReadLocalCallable.call(StorageProxy.java:722) > at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) > at java.util.concurrent.FutureTask.run(FutureTask.java:166) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > ...... > ERROR [ReadStage:2] 2010-11-24 22:38:49,580 AbstractCassandraDaemon.java (line 89) Fatal exception in thread > Thread[ReadStage:2,5,main] > java.lang.OutOfMemoryError: Java heap space > ERROR [pool-1-thread-2427] 2010-11-24 22:38:49,580 Cassandra.java (line 2792) Internal error processing mult > iget_slice > java.lang.RuntimeException: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap s > pace > at org.apache.cassandra.service.StorageProxy.weakRead(StorageProxy.java:280) > at org.apache.cassandra.service.StorageProxy.readProtocol(StorageProxy.java:223) > at org.apache.cassandra.thrift.CassandraServer.readColumnFamily(CassandraServer.java:131) > at org.apache.cassandra.thrift.CassandraServer.getSlice(CassandraServer.java:227) > at org.apache.cassandra.thrift.CassandraServer.multigetSliceInternal(CassandraServer.java:305) > at org.apache.cassandra.thrift.CassandraServer.multiget_slice(CassandraServer.java:277) > at org.apache.cassandra.thrift.Cassandra$Processor$multiget_slice.process(Cassandra.java:2784) > at org.apache.cassandra.thrift.Cassandra$Processor.process(Cassandra.java:2555) > at org.apache.cassandra.thrift.CustomTThreadPoolServer$WorkerProcess.run(CustomTThreadPoolServer.jav > a:167) > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) > at java.lang.Thread.run(Thread.java:636) > Caused by: java.util.concurrent.ExecutionException: java.lang.OutOfMemoryError: Java heap space > at java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:252) > at java.util.concurrent.FutureTask.get(FutureTask.java:111) > at org.apache.cassandra.service.StorageProxy.weakRead(StorageProxy.java:276) > ... 11 more > Caused by: java.lang.OutOfMemoryError: Java heap space > > > 2010-11-24 > ________________________________ > zangds -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com