What version of ES do you use? Jörg
On Mon, Aug 18, 2014 at 9:42 PM, rookie7799 <[email protected]> wrote: > Hello there, > > We are having the same exact problem with a really resource hungry query: > 5 nodes with 16GB ES_HEAP_SIZE > 1.2 Billion records inside 1 index with 5 shards > > Whenever we start running an aggregate query the whole cluster breaks and > disconnects. Why can't it just not return results and simple give and error > without actually killing the entire cluster? > > Cheers! > > > On Saturday, February 9, 2013 1:05:54 PM UTC-5, Igor Motov wrote: >> >> ES_HEAP_SIZE ES_MAX_MEM ES_MIN_MEM are environment variables. They need >> to be specified on the command line. For example: >> >> ES_HEAP_SIZE=4g bin/elasticsearch -f >> >> To get JVM stats, you need to set jvm=true on stats request: >> >> curl -XGET 'http://localhost:9200/_cluster/nodes/stats?jvm=true&; >> pretty=true' >> >> To understand how much memory you need, give it as much as you can, put >> some load and monitor "jvm.mem.heap_used" in the output of the stats >> command above. If this number ever goes and stays above 90% >> of available heap it's typically a good indicator that you need more. >> >> There is a small Russian elasticsearch forum - https://groups.google.com/ >> forum/?fromgroups=#!forum/elasticsearch-ru >> >> On Saturday, February 9, 2013 12:57:04 PM UTC-5, Николай Измайлов wrote: >>> >>> In continuation of the topic https://github.com/ >>> elasticsearch/elasticsearch/issues/2636#issuecomment-13332877 >>> >>> in continuation of the topic https://github.com/ >>> elasticsearch/elasticsearch/issues/2636#issuecomment-13332877 >>> On the page http://www.elasticsearch.org/guide/reference/setup/ >>> installation.html it is said that it is necessary to increase >>> ES_HEAP_SIZE ES_MAX_MEM ES_MIN_MEM, but I have not found this configuration >>> then /etc/elasticsearch/elasticsearch.yml. Here's my cluster >>> >>> { >>> "cluster_name" : "elasticsearch", >>> "nodes" : { >>> "VPjABUm-REmy24NQ_AkXDQ" : { >>> "timestamp" : 1360432148849, >>> "name" : "Sin", >>> "transport_address" : "inet[/ip:9300]", >>> "hostname" : "Ubuntu-1204-precise-64-minimal", >>> "indices" : { >>> "store" : { >>> "size" : "34.6gb", >>> "size_in_bytes" : 37221752556, >>> "throttle_time" : "0s", >>> "throttle_time_in_millis" : 0 >>> }, >>> "docs" : { >>> "count" : 58480, >>> "deleted" : 4759 >>> }, >>> "indexing" : { >>> "index_total" : 20, >>> "index_time" : "1.7s", >>> "index_time_in_millis" : 1748, >>> "index_current" : 0, >>> "delete_total" : 0, >>> "delete_time" : "0s", >>> "delete_time_in_millis" : 0, >>> "delete_current" : 0 >>> }, >>> "get" : { >>> "total" : 2, >>> "time" : "5ms", >>> "time_in_millis" : 5, >>> "exists_total" : 0, >>> "exists_time" : "0s", >>> "exists_time_in_millis" : 0, >>> "missing_total" : 2, >>> "missing_time" : "5ms", >>> "missing_time_in_millis" : 5, >>> "current" : 0 >>> }, >>> "search" : { >>> "query_total" : 1726375, >>> "query_time" : "7.7m", >>> "query_time_in_millis" : 462631, >>> "query_current" : 0, >>> "fetch_total" : 61663, >>> "fetch_time" : "20.9s", >>> "fetch_time_in_millis" : 20955, >>> "fetch_current" : 0 >>> }, >>> "cache" : { >>> "field_evictions" : 0, >>> "field_size" : "0b", >>> "field_size_in_bytes" : 0, >>> "filter_count" : 5896, >>> "filter_evictions" : 0, >>> "filter_size" : "511.6kb", >>> "filter_size_in_bytes" : 523944, >>> "bloom_size" : "22.1kb", >>> "bloom_size_in_bytes" : 22640, >>> "id_cache_size" : "0b", >>> "id_cache_size_in_bytes" : 0 >>> }, >>> "merges" : { >>> "current" : 0, >>> "current_docs" : 0, >>> "current_size" : "0b", >>> "current_size_in_bytes" : 0, >>> "total" : 0, >>> "total_time" : "0s", >>> "total_time_in_millis" : 0, >>> "total_docs" : 0, >>> "total_size" : "0b", >>> "total_size_in_bytes" : 0 >>> }, >>> "refresh" : { >>> "total" : 15, >>> "total_time" : "143ms", >>> "total_time_in_millis" : 143 >>> }, >>> "flush" : { >>> "total" : 25, >>> "total_time" : "3.2s", >>> "total_time_in_millis" : 3205 >>> } >>> } >>> } >>> } >>> } >>> >>> >>> As understand how much I need to allocate memory for elasticsearch and >>> in General the description for each of the parameters. >>> >>> there is a Russian community ? >>> >>> -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/12846c2e-e777-4812-bce2-d6c97a30c352%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/12846c2e-e777-4812-bce2-d6c97a30c352%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAKdsXoEiFy9HUU4%2BCD3BGh9EjmShi2hNiWHZ0n_N9daVkr_WTw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
