by optimizing the created in index(es) u can reduce multiple files into a smaller set of files
and on some file systems might be a good idea to optimize once in while >-----Original Message----- >From: Joel Shellman [mailto:[EMAIL PROTECTED] >Sent: 23 July 2004 14:38 >To: Lucene Users List >Subject: Re: Large index files > > >I'm a little confused by this. I thought Lucene keeps creating new files >as the index gets bigger and any single file doesn't ever get all that >big. Is that not the case? > >Thanks, > >Joel Shellman > > >John Moylan wrote: >> As long as your kernel has "Large File Support", then you should be >> fine. Most modern distro's support >2GB files now out of the box. >> >> John >> >> On Fri, 2004-07-23 at 13:44, Karthik N S wrote: >> >>>Hi >>> >>> I think (a) would be a better choice [I have done it on >Linux upt to >>>7GB , it's pretty faster then doing the same on win2000 PF] >>> >>> >>>with regards >>>Karthik >>> >>>-----Original Message----- >>>From: Rupinder Singh Mazara [mailto:[EMAIL PROTECTED] >>>Sent: Friday, July 23, 2004 5:55 PM >>>To: Lucene Users List >>>Subject: Large index files >>> >>> >>>Hi all >>> >>> I am using lucene to index a large dataset, it so happens 10% >of this data >>>yields indexes of >>> 400MB, in all likelihood it is possible the index may go upto 7GB. >>> >>> My deployment will be on a linux/tomcat system, what will be a better >>>solution >>> a) create one large index and hope linux does not mind >>> b) generate 7-10 indexes based on some criteria and glue them together >>>using MultiReader, in this case I may cross the MAX file handles limit of >>>Tomcat ? >>> >>> regards >>> >>> >>> >>> >>> >>> >>> >>>--------------------------------------------------------------------- >>>To unsubscribe, e-mail: [EMAIL PROTECTED] >>>For additional commands, e-mail: [EMAIL PROTECTED] >>> >>> >>>--------------------------------------------------------------------- >>>To unsubscribe, e-mail: [EMAIL PROTECTED] >>>For additional commands, e-mail: [EMAIL PROTECTED] > >--------------------------------------------------------------------- >To unsubscribe, e-mail: [EMAIL PROTECTED] >For additional commands, e-mail: [EMAIL PROTECTED] > > --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
