Re: Lucene on Windows

2003-10-21 Thread Eric Jain
 The CVS version of Lucene has a patch that allows one to use a
 'Compound Index' instead of the traditional one.  This reduces the
 number of open files.  For more info, see/make the Javadocs for
 IndexWriter.

Interesting option. Do you have a rough idea of what the performance
impact of using this setting is?

--
Eric Jain


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: Lucene on Windows

2003-10-21 Thread Otis Gospodnetic
A very rough and simple 'add a single document to the index' test shows
that the Compound Index is marginally slower than the traditional one.
I did not test searching.

Otis

--- Eric Jain [EMAIL PROTECTED] wrote:
  The CVS version of Lucene has a patch that allows one to use a
  'Compound Index' instead of the traditional one.  This reduces the
  number of open files.  For more info, see/make the Javadocs for
  IndexWriter.
 
 Interesting option. Do you have a rough idea of what the performance
 impact of using this setting is?
 
 --
 Eric Jain
 
 
 -
 To unsubscribe, e-mail: [EMAIL PROTECTED]
 For additional commands, e-mail: [EMAIL PROTECTED]
 


__
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: Lucene on Windows

2003-10-21 Thread Doug Cutting
Tate Avery wrote:
You might have trouble with too many open files if you set your mergeFactor too high.  For example, on my Win2k, I can go up to mergeFactor=300 (or so).  At 400 I get a too many open files error.  Note: the default mergeFactor of 10 should give no trouble.
Please note that it is never recommended that you set mergeFactor 
anywhere near this high.  I don't know why folks do this.  It really 
doesn't make indexing much faster, and it makes searching slower if you 
don't optimize.  It's a bad idea.  The default setting of 10 works 
pretty well.  I've also had good experience setting it as high as 50 on 
big batch indexing runs, but do not recommend setting it much higher 
than that.  Even then, this can cause problems if you need to use 
several indexes at once, or you have lots of fields.

Doug

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]


Lucene on Windows

2003-10-20 Thread Steve Jenkins
Hi,

Wonder if anyone can help. Has anyone used Lucene on a Windows environment?
Anyone know of any documentation specifically focused on doing that? 
Or anyone know of any gotchas to avoid?

Thanks for any help,
Cheers Steve.



Re: Lucene on Windows

2003-10-20 Thread Erik Hatcher
On Monday, October 20, 2003, at 12:00  PM, Steve Jenkins wrote:
Hi,

Wonder if anyone can help. Has anyone used Lucene on a Windows 
environment?
Anyone know of any documentation specifically focused on doing that?
Or anyone know of any gotchas to avoid?
Yup, used Lucene on Windows lots.  Is there a specific issue you feel 
is Windows related?  Its pure Java and works the same on all supported 
platforms.  So no real gotchas with respect to Windows.

	Erik

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]


RE: Lucene on Windows

2003-10-20 Thread Otis Gospodnetic
The CVS version of Lucene has a patch that allows one to use a
'Compound Index' instead of the traditional one.  This reduces the
number of open files.  For more info, see/make the Javadocs for
IndexWriter.

Otis

--- Tate Avery [EMAIL PROTECTED] wrote:
 
 You might have trouble with too many open files if you set your
 mergeFactor too high.  For example, on my Win2k, I can go up to
 mergeFactor=300 (or so).  At 400 I get a too many open files error. 
 Note: the default mergeFactor of 10 should give no trouble.
 
 FYI - On my linux box, I got the 'too many open' error on
 mergeFactor=300 (and 200).  So, I am using 100.
 
 
 Tate
 
 
 -Original Message-
 From: Erik Hatcher [mailto:[EMAIL PROTECTED]
 Sent: October 20, 2003 12:11 PM
 To: Lucene Users List
 Subject: Re: Lucene on Windows
 
 
 
 On Monday, October 20, 2003, at 12:00  PM, Steve Jenkins wrote:
  Hi,
 
  Wonder if anyone can help. Has anyone used Lucene on a Windows 
  environment?
  Anyone know of any documentation specifically focused on doing
 that?
  Or anyone know of any gotchas to avoid?
 
 Yup, used Lucene on Windows lots.  Is there a specific issue you feel
 
 is Windows related?  Its pure Java and works the same on all
 supported 
 platforms.  So no real gotchas with respect to Windows.
 
   Erik
 
 
 -
 To unsubscribe, e-mail: [EMAIL PROTECTED]
 For additional commands, e-mail: [EMAIL PROTECTED]
 
 
 -
 To unsubscribe, e-mail: [EMAIL PROTECTED]
 For additional commands, e-mail: [EMAIL PROTECTED]
 


__
Do you Yahoo!?
The New Yahoo! Shopping - with improved product search
http://shopping.yahoo.com

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



LARM running with Lucene on Windows 2000?

2002-12-23 Thread TJ Tee
Have anyone successfully make LARM crawler integrate with Lucene on Windows
2000 platform? Thank you.