Just to add one thing, in case it makes a difference. Max document size on which highlighting needs to be done is few hundred kb's (in file system). In index its compressed so should be much smaller. Total documents are more than 100 million.
On Tue, Jan 25, 2011 at 12:42 AM, Salman Akram < salman.ak...@northbaysolutions.net> wrote: > Hi, > > Does anyone have any benchmarks how much highlighting speeds up with Term > Vectors (compared to without it)? e.g. if highlighting on 20 documents take > 1 sec with Term Vectors any idea how long it will take without them? > > I need to know since the index used for highlighting has a TVF file of > around 450GB (approx 65% of total index size) so I am trying to see whether > the decreasing the index size by dropping TVF would be more helpful for > performance (less RAM, should be good for I/O too I guess) or keeping it is > still better? > > I know the best way is try it out but indexing takes a very long time so > trying to see whether its even worthy or not. > > -- > Regards, > > Salman Akram > > -- Regards, Salman Akram
