Index size variation

2017-03-03 Thread Chris Bamford
Hello I have observed that sometimes my index size temporarily increases by a large amount, presumably while it it merges segments. Is there some documentation on this subject? I am trying to estimate total disk space I'll need for a project. Thanks Chris -

RE: Index size variation

2017-03-03 Thread Uwe Schindler
Hi Chris, as always: "it depends". Generally I would reserve space of approximately the "original" index size. Most indexes that are continuously updated have an overhead by 40% for deleted documents. The remaining 60% are indeed used for merging. Please also keep in mind that if IndexReaders a

Re: Building an automaton efficiently (CompiledAutomaton vs RunAutomaton vs Automaton)

2017-03-03 Thread Oliver Mannion
Hi Dawid, Yes, the performance differences between Lucene's FST, morfologik's fsa and the PatriciaTrie are rather small. I've managed to get something working well for my use-case. Thanks Dawid and Michael for all your insight! On 20 February 2017 at 19:21, Dawid Weiss wrote: > > PatriciaTrie