hi,

we have 6 servers and 14 shards in cluster, the index size 26GB, we have 1 
replica so total size is 52GB, and ES v1.4.0, java version "1.7.0_65"

we use servers with RAM of 14GB (m3.xlarge), and heap is set to 7GB

around week ago we started facing next issue:

random cluster servers around once per day/two are hitting the heap size 
limit (java.lang.OutOfMemoryError: Java heap space) in log, and cluster is 
failing - becomes red or yellow

we tried adding more servers to cluster - even 8, but than it's a matter of 
time when we'll hit the problem, so looks no matter how many servers are in 
cluster - it will still hit the limit after some time

before we started facing the problem we were running smoothly with 3 servers
also we set indices.fielddata.cache.size:  40% but it didnt helped

also, there are possible workarounds to decrease heap usage:

1) reboot some server - than heap becomes under 70% and for some time 
cluster is ok

or

2) decrease number of replicas to 0, and than back to 1

but I dont like to use those workarounds

how it can happen while all index can fit into RAM it can run out of it?

thanks much for possible help

-- 
You received this message because you are subscribed to the Google Groups 
"elasticsearch" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to [email protected].
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/2ae23017-fde7-4b10-b31b-39076b079f10%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

Reply via email to