Hello Mark, Thanks for your answer! We are using the default values, so no doc_values. I did some research about it and it sounds very interesting and helpful to keep the heap usage lower. How can I add doc_values: true to the index template so that the new daily based generated indexes using this feature.
Cheers Chris On Monday, March 16, 2015 at 11:36:13 AM UTC+7, Mark Walkom wrote: > > Those are reasonably large documents. You also seem to have a lot of > shards for the data. > > What sort of data is it, are you using doc values, how are you bucketing > data (ie time series indices)? > > On 15 March 2015 at 20:39, <[email protected] <javascript:>> wrote: > >> Hello, >> >> We have a 2 node elasticsearch cluster which is used by logstash to store >> log files. The current input is around 100 documents (logs) per second wit >> a size of around 50kb - 150kb. >> Compared to what i have read so far this is not a high amount but we >> experience already a high heap usage 70% form the total of 11GB heap size, >> the system has in total 32GB RAM. CPU and IO are totally fine. >> >> Any suggestion highly appreciated! >> >> Cheers >> Chris >> >> <http://i.imgur.com/muodrOO.png> >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to [email protected] <javascript:>. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/c2679cad-72ec-472f-a009-a6c9e2abbb9d%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/c2679cad-72ec-472f-a009-a6c9e2abbb9d%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/bdd6d405-61b4-449d-b1ce-3f95bdf8b0c2%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
