Take a look at http://www.elastic.co/guide/en/elasticsearch/guide/current/doc-values.html
On 16 March 2015 at 20:29, <[email protected]> wrote: > Hello Mark, > > Thanks for your answer! We are using the default values, so no doc_values. > I did some research about it and it sounds very interesting and helpful to > keep the heap usage lower. > How can I add doc_values: true to the index template so that the new daily > based generated indexes using this feature. > > Cheers > Chris > > On Monday, March 16, 2015 at 11:36:13 AM UTC+7, Mark Walkom wrote: >> >> Those are reasonably large documents. You also seem to have a lot of >> shards for the data. >> >> What sort of data is it, are you using doc values, how are you bucketing >> data (ie time series indices)? >> >> On 15 March 2015 at 20:39, <[email protected]> wrote: >> >>> Hello, >>> >>> We have a 2 node elasticsearch cluster which is used by logstash to >>> store log files. The current input is around 100 documents (logs) per >>> second wit a size of around 50kb - 150kb. >>> Compared to what i have read so far this is not a high amount but we >>> experience already a high heap usage 70% form the total of 11GB heap size, >>> the system has in total 32GB RAM. CPU and IO are totally fine. >>> >>> Any suggestion highly appreciated! >>> >>> Cheers >>> Chris >>> >>> <http://i.imgur.com/muodrOO.png> >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to [email protected]. >>> To view this discussion on the web visit https://groups.google.com/d/ >>> msgid/elasticsearch/c2679cad-72ec-472f-a009-a6c9e2abbb9d% >>> 40googlegroups.com >>> <https://groups.google.com/d/msgid/elasticsearch/c2679cad-72ec-472f-a009-a6c9e2abbb9d%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/bdd6d405-61b4-449d-b1ce-3f95bdf8b0c2%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/bdd6d405-61b4-449d-b1ce-3f95bdf8b0c2%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X89%3D9nd1AVZGvu7TWSM7%2BA_dNsVo%3D9Z0YcxNT%3DsNc6msQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
