> I am wondering when Elasticsearch will have issues with the number of > indexes. For example is 10 a good number? 100? 1000? 10000? etc. > > I would like to break up the indexes as much as possible and make use of > aliases for searching the data of interest, but I don't want to create so > many indexes that it will have an adverse affect on performance.
FYR, one issue that I ran into with daily indices is the limit of file descriptiors per node. I wanted to maximize write performance so the number of shards was set to be 24, matching the number of CPU cores. It does not seem to be that much, but after a few weeks the number of FD reach 65k limit before the disk space ran out, and this setting need to be changed. At this point the cluster have 6 nodes, 4 new indices per day, the total days kept is about 80. But we do not do cross-day query. -- Cheers, Kang-min Liu -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/m2fvex68vh.fsf%40gugod.org. For more options, visit https://groups.google.com/d/optout.
