It's perfectly normal/healthy for many small merges below the floor size to happen.
I think you should first figure out why this node is different from the others? Are you sure it's merging CPU cost that's different? Mike McCandless http://blog.mikemccandless.com On Sat, Jul 5, 2014 at 9:51 PM, Kireet Reddy <[email protected]> wrote: > We have a situation where one of the four nodes in our cluster seems to > get caught up endlessly merging. However it seems to be high CPU > activity and not I/O constrainted. I have enabled the IndexWriter info > stream logs, and often times it seems to do merges of quite small segments > (100KB) that are much below the floor size (2MB). I suspect this is due to > frequent refreshes and/or using lots of threads concurrently to do > indexing. Is this true? > > My supposition is that this is leading to the merge policy doing lots of > merges of very small segments into another small segment which will again > require a merge to even reach the floor size. My index has 64 segments and > 25 are below the floor size. I am wondering if there should be an exception > for the maxMergesAtOnce parameter for the first level so that many small > segments could be merged at once in this case. > > I am considering changing the other parameters (wider tiers, lower floor > size, more concurrent merges allowed) but these all seem to have side > effects I may not necessarily want. Is there a good solution here? > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to [email protected]. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/0a8db0dc-ae0b-49cb-b29d-e396510bf755%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/0a8db0dc-ae0b-49cb-b29d-e396510bf755%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAD7smRcuyvH6oE_dEZUD06%2B7bxy_guh__Q3O1LbjxdDWpmA9zw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
