That’s what we are planning on doing. Block writes(making index read-only), write into a parallel directory using 8.x lucene codec and then switch over if/when completely written. Downside is (temporarily) requiring double the index size in total disk space while writing the index given that we regularly run into multi-terabyte indexes.
Easier said than done, given the unknown challenges in doing so, so the feasibility remains to be seen. I really wish there was a supported way to do this out of the box. On Thu, Oct 7, 2021 at 9:36 AM Michael Conrad <mich...@newsrx.com> wrote: > > > On 10/7/21 8:46 AM, Rahul Goswami wrote: > > Won’t work. I have tried optimize on 7.7.2 to 8.x where several segments > > were originally written in 5.x and 6.x. > > We are scratching our heads to achieve this seamlessly since reindexing > > will take several weeks given the size of indexes for many of our > customers. > > > > -Rahul > > > > > > There really needs to be a way to simply rewrite existing segments into > the new lucene format. with appropriate errors in case of unsupported > field types, etc. >
