For one project I will need to run cassandra on following dedicated servers:
Single CPU XEON 4 cores no hyper-threading, 8 GB RAM, 12 TB locally attached HDD's in some kind of RAID, visible as single HDD. I can do cluster of 20-30 such servers, may be even more. The data will be huge, I am estimating 4-6 TB per server. I know this is best, but those are my resources. Currently I am testing with one of such servers, except HDD is 300 GB. Every 15-20 hours, I get out of heap memory, e.g. something like: ERROR [Thrift:641] 2013-04-11 11:25:19,563 CassandraDaemon.java (line 164) Exception in thread Thread[Thrift:641,5,main] ... INFO [StorageServiceShutdownHook] 2013-04-11 11:25:39,915 ThriftServer.java (line 116) Stop listening to thrift clients INFO [StorageServiceShutdownHook] 2013-04-11 11:25:39,943 Gossiper.java (line 1077) Announcing shutdown INFO [StorageServiceShutdownHook] 2013-04-11 11:26:08,613 MessagingService.java (line 682) Waiting for messaging service to quiesce INFO [ACCEPT-/208.94.232.37] 2013-04-11 11:26:08,655 MessagingService.java (line 888) MessagingService shutting down server thread. ERROR [Thrift:721] 2013-04-11 11:26:37,709 CustomTThreadPoolServer.java (line 217) Error occurred during processing of message. java.util.concurrent.RejectedExecutionException: ThreadPoolExecutor has shut down Anyone have some advices about better utilization of such servers? Nick.
