Thanks Otis for your questions. Here are the answers... Please let me know your thoughts....
We do optimize() after indexWrite. The maximum open file allowed is 2,000. Is this normal, too small? What is your recommended number ? We have 57 index files, how many files that Lucene index will actually opens per session? We use default mergeFactor 10, default merge Docs 1000. We have about 18,000 documents, 23 indexed fields. We are not using compound index because, but we are considering it. Following is a snapshot of our typical index files: -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f1 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f10 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f11 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f12 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f13 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f14 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f15 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f16 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f17 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f18 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f19 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f2 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f20 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f21 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f22 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f23 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f24 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f25 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f26 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f27 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f28 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f29 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f3 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f30 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f31 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f32 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f33 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f34 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f35 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f36 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f37 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f38 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f39 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f4 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f40 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f41 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f42 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f43 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f44 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f45 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f46 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f47 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f48 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f49 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f5 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f50 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f51 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f6 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f7 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f8 -rw-rw---- 1 skpmq p/gsa_cd 18719 Sep 01 09:18 _bgw.f9 -rw-rw---- 1 skpmq p/gsa_cd 18624312 Sep 01 09:18 _bgw.fdt -rw-rw---- 1 skpmq p/gsa_cd 149752 Sep 01 09:18 _bgw.fdx -rw-rw---- 1 skpmq p/gsa_cd 579 Sep 01 09:18 _bgw.fnm -rw-rw---- 1 skpmq p/gsa_cd 23085952 Sep 01 09:18 _bgw.frq -rw-rw---- 1 skpmq p/gsa_cd 42672641 Sep 01 09:18 _bgw.prx -rw-rw---- 1 skpmq p/gsa_cd 145555 Sep 01 09:18 _bgw.tii -rw-rw---- 1 skpmq p/gsa_cd 11866281 Sep 01 09:18 _bgw.tis -rw-rw---- 1 skpmq p/gsa_cd 4 Sep 01 09:18 deletable -rw-rw---- 1 skpmq p/gsa_cd 29 Sep 01 09:18 segments -- Sent from the Lucene - Java Users forum at Nabble.com: http://www.nabble.com/Too-many-open-files-when-doing-performance-testing-t272369.html#a766958
