Lucene removing some words while searching

2005-12-27 Thread M å n i s h
Hi erik and other gurus, I have some doubts over double quote queries (as it is) Suppose I search “lucene user forum” it should give correct continuous occurrence of full text , But if I search for “when they occur” lucene is searching for “when occur” also. I think lucene is

Indexing and deleting simultaneously..

2005-12-27 Thread K.A.Hussain Ali
HI all. I am a newbie to Lucene.. Could we do indexing and deleting a document on the same file simultaneously ? Do lucene provide such options to carry out the tasks? Any Help is greatly appreciated Thanks in advacne regards -Hussain.

RE: Indexing and deleting simultaneously..

2005-12-27 Thread Steven Pannell
Hi, Basically you can update/delete and read an index simultaneously. When you start to read the index and then update/delete the index, the current read process will continue reading with the old data before the delete took place. A little bit like a transaction on the database. You don't

Re: Indexing and deleting simultaneously..

2005-12-27 Thread Chris Lu
This is generally true, most of the time. But my experience is, there can be some FileNotFoundException, if your searcher is opened for a while, and indexing is doing some file deleting/renaming when merging. Of course, if your data volumn is not that large and updating is not often, maybe you

Re: Indexing and deleting simultaneously..

2005-12-27 Thread Yonik Seeley
That shouldn't happen. What platform(s) have you seen this on, and with what Lucene versions? -Yonik On 12/27/05, Chris Lu [EMAIL PROTECTED] wrote: This is generally true, most of the time. But my experience is, there can be some FileNotFoundException, if your searcher is opened for a while,

Re: More than 32 required/prohibited clauses in query

2005-12-27 Thread Yonik Seeley
That's a Lucene 1.4 limitation, gone in the latest 1.9 development version. If you want to stick with 1.4, try restructuring your query to avoid this restriction. -Yonik On 12/27/05, Alex Kiselevski [EMAIL PROTECTED] wrote: I got a strange exception More than 32 required/prohibited clauses in

RE: More than 32 required/prohibited clauses in query

2005-12-27 Thread Alex Kiselevski
How can I get latest 1.9 development version ? -Original Message- From: Yonik Seeley [mailto:[EMAIL PROTECTED] Sent: Tuesday, December 27, 2005 4:52 PM To: java-user@lucene.apache.org Subject: Re: More than 32 required/prohibited clauses in query That's a Lucene 1.4 limitation, gone in

Re: More than 32 required/prohibited clauses in query

2005-12-27 Thread Yonik Seeley
There is no officially released 1.9 version yet. Many people are using the current 1.9 branch for production, however, and it is stable (moreso than 1.4.3 IMO). You have to check the latest source out from subversion and build it. mkdir lucene svn checkout

Re: Problem Getting Started...

2005-12-27 Thread Gaston
Hi, I had the same problem at the beginning. Try java -classpath lucene-1.4-final.jar; lucene-demos-1.4-final.jar; org.apache.lucene.demo.IndexHTML -create -index webindex docs If this fails go in the org/apache/lucene/demo directory and compile IndexHTML.java with the command javac

Field searches and special characters - ??

2005-12-27 Thread Dmitry Goldenberg
Hello, Trying to get my field searches to work with special characters. It appears that Lucene is not able to interpret these searches correctly (but works as expected with generic content searches). For instance, I created a document named item+with+pluses (plus being the special

Proximity searches and Porter stemming - ??

2005-12-27 Thread Dmitry Goldenberg
Hello, I tried using Porter stemming in our application and it worked great except it broke the proximity searches. Is there any way at all that these two pieces of functionality could coexist peacefully? I do not see any reason why they should not. It seems to me that proximity query

Wildcard and Fuzzy queries - no best fragments generated - ??

2005-12-27 Thread Dmitry Goldenberg
Hello, While testing my code that integrates the Highlighter class from org.apache.lucene.search.highlight, I found out that for wildcard and fuzzy queries, it generates no best fragments. Any particular reason why that is the case? Shouldn't the highlighter be able to work just like with

Re: Wildcard and Fuzzy queries - no best fragments generated - ??

2005-12-27 Thread Erik Hatcher
You have to _rewrite_ the Query for this to work. This, I believe, is mentioned in the javadocs. I think you are hijacking a thread with your recent postings. Please create a new message rather than reply to one and change the subject. Thanks. Erik On Dec 27, 2005, at 1:55

RE: Proximity searches and Porter stemming - ??

2005-12-27 Thread Dmitry Goldenberg
Erik, thanks for the quick response. I believe we had an analyzer discrepancy. I just retested and the queries work. I see character encode eliminate~3 and character encoding eliminates~3 returning the same results. Thanks! From: Erik Hatcher [mailto:[EMAIL

RE: Wildcard and Fuzzy queries - no best fragments generated - ??

2005-12-27 Thread Dmitry Goldenberg
Erik, What do you mean by _rewriting_ the query? I checked all the classes in the highlighter package and did not see any mention of having to rewrite. Sorry for the highjacking, didn't mean to be a terrorist :) - Dmitry From: Erik Hatcher [mailto:[EMAIL

Re: Wildcard and Fuzzy queries - no best fragments generated - ??

2005-12-27 Thread Erik Hatcher
On Dec 27, 2005, at 2:34 PM, Dmitry Goldenberg wrote: What do you mean by _rewriting_ the query? I checked all the classes in the highlighter package and did not see any mention of having to rewrite. From Highlighter's package.html in it's javadocs: pre IndexSearcher searcher =

Re: Indexing and deleting simultaneously..

2005-12-27 Thread Yonik Seeley
If anyone could provide a testcase that can reproduce this, it would be a huge step toward fixing it! -Yonik On 12/27/05, Chris Lu [EMAIL PROTECTED] wrote: I have got around it by using two indexes, one for searching, one for updating. But searching FileNotFoundException lucene returns some

Re: Wildcard and Fuzzy queries - no best fragments generated - ??

2005-12-27 Thread Erik Hatcher
On Dec 27, 2005, at 5:51 PM, Dmitry Goldenberg wrote: This is great. Now, just so I understand how rewrite applies. Are there specific cases when the rewrite method should or should not be invoked on the query before it is passed on to the search method? Where I'm going with this is, if

filtering an IndexReader

2005-12-27 Thread Eric Schulte
Good evening everyone, So, I apologize if this question has a simple answer (although I hope it does). I am trying to apply a filter to an IndexReader, so that the reader can only see documents that match the filter. The goal here is to be able to implement the 'terms' and 'termDocs' methods,

RE: More than 32 required/prohibited clauses in query

2005-12-27 Thread Alex Kiselevski
Thanks, It works, I took binary jar from Luke site -Original Message- From: Erik Hatcher [mailto:[EMAIL PROTECTED] Sent: Tuesday, December 27, 2005 8:25 PM To: java-user@lucene.apache.org Subject: Re: More than 32 required/prohibited clauses in query On Dec 27, 2005, at 12:38 PM,