Re: rebuild constantly fails, 3.11

2017-08-11 Thread Micha
the nodes have 32G ram, there are no other processes running. Thanks for the info about the g1gc. I used bootstrap resume to finish the bootstrap, then added another two nodes. This worked, but I saw in munin a constantly rising memory consumption during streaming, while on the other nodes there

Re: rebuild constantly fails, 3.11

2017-08-11 Thread Micha
It's an oom issue, the kernel kills the cassandra job. The config was to use offheap buffers and 20G java heap, I changed this to use heap buffers and 16G java heap. I added a new node yesterday which got streams from 4 other nodes. They all succeeded except on the one node which failed before.

Re: rebuild constantly fails, 3.11

2017-08-11 Thread kurt greaves
How much memory do these machines have? Typically we've found that G1 isn't worth it until you get to around 24G heaps, and even at that it's not really better than CMS. You could try CMS with an 8G heap and 2G new size. However as the oom is only happening on one node have you ensured there are

Re: rebuild constantly fails, 3.11

2017-08-11 Thread kurt greaves
cc'ing user back in... On 12 Aug. 2017 01:55, "kurt greaves" wrote: > How much memory do these machines have? Typically we've found that G1 > isn't worth it until you get to around 24G heaps, and even at that it's not > really better than CMS. You could try CMS with an 8G