Did you get better writes? What sort of storage are you on, did you measure before and after, are you reaching I/O limits?
Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: [email protected] web: www.campaignmonitor.com On 9 October 2014 17:33, Kang-min Liu <[email protected]> wrote: > > > I am wondering when Elasticsearch will have issues with the number of > > indexes. For example is 10 a good number? 100? 1000? 10000? etc. > > > > I would like to break up the indexes as much as possible and make use of > > aliases for searching the data of interest, but I don't want to create so > > many indexes that it will have an adverse affect on performance. > > FYR, one issue that I ran into with daily indices is the limit of file > descriptiors per node. > > I wanted to maximize write performance so the number of shards was set > to be 24, matching the number of CPU cores. It does not seem to be that > much, but after a few weeks the number of FD reach 65k limit before the > disk space ran out, and this setting need to be changed. > > At this point the cluster have 6 nodes, 4 new indices per day, the total > days kept is about 80. But we do not do cross-day query. > > -- > Cheers, > Kang-min Liu > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/m2fvex68vh.fsf%40gugod.org > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAEM624b7dPM-vgf0B%2B0%3D28oLZaGc5keFi%2BRseMmZGqyhf91DyA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
