Hello, I have a very large Index in ES (millions of entries over 100s of GB) with too few Shards. And I want only to create the same Index but with more, smaller, efficient Shards. And I would love it if this could happen quickly (minutes?)
My googling indicates that the elasticsearch-reindex Plugin (https://github.com/karussell/elasticsearch-reindex) is the best approach. Is that still the case?? Under the covers elasticsearch-reindex uses the recommended scan-and-scroll technique. But reading the doc/code in the elasticsearch-reindex Plugin, they indicate that perhaps they should have implemented it as a River. And I’ve not been able to find a River that accomplished this same task. It seems that this might be a pretty common thing to need to do, and that there may be a very efficient way to accomplish it that I am missing. And it seems that it might be fastest to have some sort of very fast streaming process that could essentially stream the entries of indexOld to indexNew with a new number of Shards. Is elasticsearch-reindex still the best tool for this job?? (I am on ES 1.0.2) Thanks much, — Chris -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/14711f9d-0848-4923-b00a-62cd85d8a337%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
