Your logic around having so many shards may make sense, but you still end up having to move the same amount of data and it's more over head. You should have N number of shards, where N is the number of nodes.
Check your logs, there may be something in there. Otherwise can you provide more details on your node size; RAM, disk, CPU, ES and java version, that sort of thing, On 18 November 2014 19:59, Pavel P <[email protected]> wrote: > Hi again, > > The question is still actual. > > Yesterday I've updated the ES version to 1.4.0, in the night new index was > created, currently it is not able to assign 2 nodes: > > > <https://lh5.googleusercontent.com/-e5DZN7BvA3w/VGsKW-0Su2I/AAAAAAAAAKo/lrst5q10vWI/s1600/Screen%2BShot%2B2014-11-18%2Bat%2B10.58.37%2BAM.png> > > > Please, advice me something :) > > > On Monday, November 17, 2014 11:02:43 AM UTC+2, Pavel P wrote: >> >> Hi, >> >> I have a cluster from 5 nodes, where I store the information from the >> logstash. >> Recently I've tried to increase the number of shards in the logstash >> index to 20 (from 5). >> >> From the beginning everything went well, all the shards were allocated >> and the cluster state was green. >> >> But, currently, when the new index is started (at the beginning of the >> day), I met the situation when some shards are not allocated: >> >> >> <https://lh3.googleusercontent.com/-R3bWkXbXCbU/VGmwngnPOzI/AAAAAAAAAKY/9n8XlVCGPyc/s1600/Screen%2BShot%2B2014-11-17%2Bat%2B10.23.04%2BAM.png> >> >> Nothing happens during the day, while I thing the cluster has resources. >> >> If I would restart some nodes from the cluster, it could turn out that >> all the shards would be allocated. >> >> The idea which I'm trying to reach - more shards => each shard is smaller >> => it would allocate them faster, it would index faster, because of the >> indexing on each shard. >> >> Questions: >> >> 1. Why it is not able to allocate those shards during the index creation? >> 2. Why it does not allocate those shards during the day? >> 3. What is the recommended shards number for N nodes? >> >> Any thoughts are welcome. >> >> Regards, >> > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/6b9b0a09-c6b3-428d-ae26-148e94480a16%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/6b9b0a09-c6b3-428d-ae26-148e94480a16%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAF3ZnZkmUcML7MGPvf_93xVhVsQR4X5iETUpquDbmkFpo3nMXw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
