It seems that this particular node is complaining about too many open files. This usually happens if you have very low limits on your operating system and/or if you have many shards on a single node. When this happens, things degrade pretty badly as there is no way to open new files anymore.
Please see http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/setup-configuration.html#file-descriptors for more information. On Wed, Aug 13, 2014 at 9:23 PM, José Andrés <[email protected]> wrote: > Can someone elaborate as to why the exception below is thrown? > > [2014-08-11 11:27:41,189][WARN ][cluster.action.shard ] [mycluster] > [all][4] received shard failed for [all][4], node[MLNWasasasWi2V58hRA93mg], > [P], s[INITIALIZING], indexUUID [KSScFASsasas6yTEcK7HqlmA], reason [Failed > to start shard, message [IndexShardGatewayRecoveryException[[all][4] failed > recovery]; nested: EngineCreationFailureException[[all][4] failed to open > reader on writer]; nested: > FileSystemException[/var/lib/elasticsearch/mycluster/nodes/0/indices/all/4/index/_ > m4bz_es090_0.tim: Too many open files]; ]] 2:11 /var/lib/elasticsearch > doesn't exist on the nodes > > Thank you very much for your feedback. > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/16968aac-dbfe-44c4-b3fe-d25af0dfbe37%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/16968aac-dbfe-44c4-b3fe-d25af0dfbe37%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- Adrien Grand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j5n0x_zBEYEP1B3a1uf0vCFGoCphZw%3DCZwJF7nuF24ERQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
