Currently you have shards upwards of over 100GB, which is massive and probably causing you some issues. Ideally you should be aiming for a max shard size of 40-50GB, so increasing your shard count to 24 brings you under this level and also gives you room for growth on an index level.
Having a higher shard count also spreads the query load, and reduces the amount of thrashing (ie data transfer) if/when a node goes down. On 9 December 2014 at 15:50, Ron Sher <ron.s...@gmail.com> wrote: > we have 24 data nodes, 3 master nodes and 3 client nodes. > We use m3.4xlarge for the data nodes > > On Tue, Dec 9, 2014 at 4:37 PM, Mark Walkom <markwal...@gmail.com> wrote: > >> How many servers are in this cluster? >> >> On 9 December 2014 at 14:36, Ron Sher <ron.s...@gmail.com> wrote: >> >>> Hi, >>> >>> We have a multi tenant SAAS application in which we keep data for all >>> accounts of our clients (300 of them which we call services). >>> We keep data in monthly indices that grew to be about 700GB with 4.6 >>> billion documents each month. >>> Each day we index a new account per day for each service. >>> >>> Each index is built from 6 shards and we use 1 replica. >>> >>> We're starting to have second thoughts of the structure of our indices >>> and about proper use of routing. >>> Few things we contemplate: >>> >>> - Use routing according to service so that we will probably benefit >>> from caching better. >>> - Change the indices according to service + month so that we will >>> query much less data, but will add many indices (now instead of 12 >>> indices >>> a year we will have 300x12 and growing when the number of clients grow). >>> >>> Any thoughts/suggestions? >>> >>> Thanks, >>> Ron >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearch+unsubscr...@googlegroups.com. >>> To view this discussion on the web visit >>> https://groups.google.com/d/msgid/elasticsearch/096f4d7b-2702-46d7-96d6-f746f2389623%40googlegroups.com >>> <https://groups.google.com/d/msgid/elasticsearch/096f4d7b-2702-46d7-96d6-f746f2389623%40googlegroups.com?utm_medium=email&utm_source=footer> >>> . >>> For more options, visit https://groups.google.com/d/optout. >>> >> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "elasticsearch" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/elasticsearch/32uvCMR1kl4/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> elasticsearch+unsubscr...@googlegroups.com. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_TaWiZvpEpZ10_bMHhuOwSxpmBv%2BBhTNjPUHnKTA-Bgg%40mail.gmail.com >> <https://groups.google.com/d/msgid/elasticsearch/CAEYi1X_TaWiZvpEpZ10_bMHhuOwSxpmBv%2BBhTNjPUHnKTA-Bgg%40mail.gmail.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/CAKHuyJo5nyDgUfur-%3DNw6O4Jg98duO1GQVr5zRf_tcqqg-kJ-w%40mail.gmail.com > <https://groups.google.com/d/msgid/elasticsearch/CAKHuyJo5nyDgUfur-%3DNw6O4Jg98duO1GQVr5zRf_tcqqg-kJ-w%40mail.gmail.com?utm_medium=email&utm_source=footer> > . > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEYi1X9K%2B6_MpOQN4nAg22pmgRHccdNzb2_RHZjYSWprF8Q7EA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
