Hey all! I'm having some a serious problem with my ES cluster. Every now and then, when writing to the cluster, a machine (or two) will suddenly spike up on OS Load, writing will come to a screeching halt (>5s for 1k docs, as opposed to ~100ms normally), and then shortly after, the VM that was spiking will simply disappear from the cluster.
<https://lh3.googleusercontent.com/-tof8Eiwa1hw/U8-44SG-VGI/AAAAAAAAAAM/cQHRGV43r3s/s1600/Screenshot+2014-07-23+09.28.30.png> Another thing I've noticed, is that the "Document Count" dips to 0 when this happens. FWIW - the VMs are 15gb mem / 4 cores, each, running docker. <https://lh5.googleusercontent.com/-Clp-mK2fddQ/U8-5EhQrlZI/AAAAAAAAAAU/TtgFCAne6aE/s1600/Screenshot+2014-07-23+09.28.10.png> *Here are some logs from around the time this happened:* *Hot threads*: https://gist.github.com/schonfeld/370f9c32dbefce59e628 *Nodes stats*: https://gist.github.com/schonfeld/5f528949d3a6341417dc Screenshots: https://www.dropbox.com/s/gthreucugoz0opm/Screenshot%202014-07-23%2009.28.30.png && https://www.dropbox.com/s/ae1vijcdgv5sv7u/Screenshot%202014-07-23%2009.28.10.png Any clues, insights, and thoughts will be greatly appreciated! Thanks, - Michael -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/e8bb2fa4-42da-4177-9b75-d9d4843fcc93%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
