thanks for this hint, Andrew! It is the merge-factor. A comprehensive description can be found at http://www.mail-archive.com/lucene-user@jakarta.apache.org/msg00373.html.
The quick hack: Look in SimpleLuceneCocoonIndexerImpl.java for the constant MERGE_FACTOR_DEFAULT = 20. Lower the value. I set it to 10. Indexing about 2000 files now works fine. /Leo On Monday, April 8, 2002, at 02:01 Uhr, Andrew C. Oliver wrote: > This sounds like your index merge factor. > > On Mon, 2002-04-08 at 03:26, Nader S. Henein wrote: >> Cocoon Lucene Indesing: "Too Many files open Error" >> >> I can't opt for that solution, what I'm trying to do >> is get out of Oracle Internmedia and ultimately out of oracle >> and if you've ever had oracle bill you for licensing fees >> you'll know why ... but as far as the indexing is concerned >> I'm going to need to index about 200 000 XML files did you try >> discussing the problem on the lucene dev forums ? I mean it is >> open source we should be able to fix it. >> The "Too Many files open Error" sounds like there is a file handle >> close() method missing somewhere I'm going to start going through the >> code today, and I'll post the problem on the Lucene Dev board .. it >> would be >> nice to know who wrote the damn thing .. they could probably fix this >> one >> in no time. >> >> cheers >> >> OPEN SOURCE ROCKS >> >> >> -----Original Message----- >> From: leo leonid [mailto:[EMAIL PROTECTED]] >> Sent: Saturday, April 06, 2002 7:44 PM >> To: [EMAIL PROTECTED] >> Subject: Re: Sorry to be a nag >> >> >> uups. wrong URL. forget the old .com, the lucene try is on >> http://www.helnwein.de >> sorry >> /Leo >> >> >> On Saturday, April 6, 2002, at 05:39 Uhr, leo leonid wrote: >> >>> yes! I tried it. And the result was the same error as you got. >>> I started a thread "Problem with SimpleLuceneCocoonIndexerImpl (Too >>> many open files)" on Fri Mar 15, but it faded out quickly. >>> Indexing works now, but I had to limit indexing to a small part of my >>> site :-( >>> Another problem I have: non-ascii characters in query strings (e.g. >>> german Umlauts) you can test my try at http://www.helnwein.com ) >>> /Leo >>> >>> >>> On Thursday, April 4, 2002, at 09:41 Uhr, Nader S. Henein wrote: >>> >>>> People sorry to be a nag and I have asked this one before and >>>> got nothing, but just to make sure .. has anyone out there developed >>>> an App as opposed to a webapp to create a search index using the >>>> lucene >>>> library on Cocoon 2.0.2 ? I tried and it's just giving me an ulcer. >>>> >>>> OS : Solaris 8 >>>> Webserver : Orion 1.4.5 >>>> Cocoon : 2.0.2 >>>> >>>> >>>> Nader S. Henein >>>> Bayt.com , Dubai Internet City >>>> Tel. +9714 3911900 >>>> Fax. +9714 3911915 >>>> GSM. +9715 05659557 >>>> www.bayt.com >>>> >>>> --------------------------------------------------------------------- >>>> Please check that your question has not already been answered in the >>>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html> >>>> >>>> To unsubscribe, e-mail: <[EMAIL PROTECTED]> >>>> For additional commands, e-mail: <[EMAIL PROTECTED]> >>>> >>>> >>> >>> >>> --------------------------------------------------------------------- >>> Please check that your question has not already been answered in the >>> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html> >>> >>> To unsubscribe, e-mail: <[EMAIL PROTECTED]> >>> For additional commands, e-mail: <[EMAIL PROTECTED]> >>> >>> >> >> >> --------------------------------------------------------------------- >> Please check that your question has not already been answered in the >> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html> >> >> To unsubscribe, e-mail: <[EMAIL PROTECTED]> >> For additional commands, e-mail: <[EMAIL PROTECTED]> >> >> >> >> --------------------------------------------------------------------- >> Please check that your question has not already been answered in the >> FAQ before posting. <http://xml.apache.org/cocoon/faqs.html> >> >> To unsubscribe, e-mail: <[EMAIL PROTECTED]> >> For additional commands, e-mail: <[EMAIL PROTECTED]> >> > -- > http://www.superlinksoftware.com > http://jakarta.apache.org/poi - port of Excel/Word/OLE 2 Compound > Document > format to java > http://developer.java.sun.com/developer/bugParade/bugs/4487555.html > - fix java generics! > The avalanche has already started. It is too late for the pebbles to > vote. > -Ambassador Kosh > > > --------------------------------------------------------------------- > Please check that your question has not already been answered in the > FAQ before posting. <http://xml.apache.org/cocoon/faqs.html> > > To unsubscribe, e-mail: <[EMAIL PROTECTED]> > For additional commands, e-mail: <[EMAIL PROTECTED]> > > --------------------------------------------------------------------- Please check that your question has not already been answered in the FAQ before posting. <http://xml.apache.org/cocoon/faqs.html> To unsubscribe, e-mail: <[EMAIL PROTECTED]> For additional commands, e-mail: <[EMAIL PROTECTED]>
