Is storing 20 fields in a lucene document desirable?

2007-11-20 Thread kumarlimbu
. Will this frequent read and write have impact on performance? Our current index size is around 8G and contains around 3M documents. If there are any suggestions or questions, please reply. Thanks you all! Regards, Kumar -- View this message in context: http://www.nabble.com/Is-storing-20-fields-in-a-lucene

Re: Is storing 20 fields in a lucene document desirable?

2007-11-20 Thread Grant Ingersoll
On Nov 20, 2007, at 6:29 AM, kumarlimbu wrote: Our document contains a total of 23 fields in one document and we STORE all of them in lucene index. We have recently had some performance issues and our analysis has shown the bottleneck to be lucene search and retrieval. Perhaps you

Re: Is storing 20 fields in a lucene document desirable?

2007-11-20 Thread Erick Erickson
How are you doing your search? When you say lucene is the bottleneck, that encompasses a lot. You really need to pinpoint things a bit more 1 are you iterating over the hits object for many docs? This is bad. 2 are you using a HitCollector and reading the doc each time you get to the collect