I have 12-nodes cassandra's cluster, after restart (really, upgrade from 0.4.0
to 0.4.1) of one node it writes in log a lot of messages like:
ERROR [pool-1-thread-46] 2009-10-14 17:06:40,804 Cassandra.java (line 679)
Internal error processing get_slice
java.lang.RuntimeException: error reading key 00000000000028344851
at
org.apache.cassandra.service.StorageProxy.weakReadRemote(StorageProxy.java:265)
at
org.apache.cassandra.service.StorageProxy.readProtocol(StorageProxy.java:312)
at
org.apache.cassandra.service.CassandraServer.readColumnFamily(CassandraServer.java:100)
at
org.apache.cassandra.service.CassandraServer.getSlice(CassandraServer.java:182)
at
org.apache.cassandra.service.CassandraServer.multigetSliceInternal(CassandraServer.java:251)
at
org.apache.cassandra.service.CassandraServer.get_slice(CassandraServer.java:220)
at
org.apache.cassandra.service.Cassandra$Processor$get_slice.process(Cassandra.java:671)
at
org.apache.cassandra.service.Cassandra$Processor.process(Cassandra.java:627)
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:253)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
at java.lang.Thread.run(Thread.java:636)
Caused by: java.util.concurrent.TimeoutException: Operation timed out.
at org.apache.cassandra.net.AsyncResult.get(AsyncResult.java:97)
at
org.apache.cassandra.service.StorageProxy.weakReadRemote(StorageProxy.java:261)
... 11 more
Read from that key from another nodes is ok, but reading from restarted
timeouted with that message.
Is some rules/recommendation to restart node?
--
Teodor Sigaev E-mail: [email protected]
WWW: http://www.sigaev.ru/
