Problem with close IndexWriter pausing due to locked files

2009-12-03 Thread Paul Williams 

Hi,


I have found an issue with a Lucene index locking files from a Searcher
instance. So that when a mergeSegments happens on a indexwriter close it
actually hangs until the search instance is closed

This seems to happen only when the index is stored on a network SAN device.
When stored elsewhere it acts normally.

Lucene version:2.1 and 2.3. going to test later versions.

The merge segments hangs here:-

DEBUG 12:59:09,993 debug.ThreadDump  -   at
java.io.WinNTFileSystem.delete0(Native Method)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
java.io.Win32FileSystem.delete(Win32FileSystem.java:504)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
java.io.File.delete(File.java:871)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.store.FSDirectory.deleteFile(FSDirectory.java:350)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.index.IndexFileDeleter.deleteFile(IndexFileDeleter.java:224)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:217)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:298)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.index.IndexFileDeleter.deleteFiles(IndexFileDeleter.java:215)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.index.IndexFileDeleter.deleteSegments(IndexFileDeleter.java:177)
DEBUG 12:59:09,993 debug.ThreadDump  -   at
org.apache.lucene.index.IndexWriter.mergeSegments(IndexWriter.java:1582)
DEBUG 12:59:10,008 debug.ThreadDump  -   at
org.apache.lucene.index.IndexWriter.maybeMergeSegments(IndexWriter.java:1415)
DEBUG 12:59:10,008 debug.ThreadDump  -   at
org.apache.lucene.index.IndexWriter.flushRamSegments(IndexWriter.java:1352)
DEBUG 12:59:10,008 debug.ThreadDump  -   at
org.apache.lucene.index.IndexWriter.close(IndexWriter.java:588)

Once the searcher is closed from a seperate JVM/Server it frees the files
and the writer close can finish.

Has anyone else seen this behaviour?

I see it catches the IO exception on deletefiles in the indexwriter and puts
it in delete list for later. But this does not seem to happen on this
occasion. it just seems to hang

Any ideas on a way round this?

Regards,

Paul


-- 
View this message in context: 
http://old.nabble.com/Problem-with-close-IndexWriter-pausing-due-to-locked-files-tp26626826p26626826.html
Sent from the Lucene - Java Users mailing list archive at Nabble.com.


-
To unsubscribe, e-mail: java-user-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-user-h...@lucene.apache.org

RE: Most Frequent Terms

2007-01-19 Thread Paul Williams 
To answer my own question; I've just found the HighFreqTerms class in
luke which point me in the right direction!

Regards,
Paul.
 

-Original Message-
From: Paul Williams [mailto:[EMAIL PROTECTED] 
Sent: 19 January 2007 08:36 am
To: java-user@lucene.apache.org
Subject: Most Frequent Terms

Hopefully this a straight forward question, but what's the recommended
approach for finding the most frequent terms in an index?  Should this
sort of thing be done overnight?

 

Regards,

Paul.

 

 



-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Top n Searches

2005-12-08 Thread Paul Williams 
Hi, 

 

I've been asked whether we can do a Top n Searches functionality where
we record the most common searched for phrases on a daily basis.  I'm
not sure where to start with this or even if this is feasible with
Lucene.

 

Anyone done anything similar?

 

Cheers.

Paul Williams.

RE: Top n Searches

2005-12-13 Thread Paul Williams 
That was the approach I was planning to take but I've been asked to
provide a more intelligent implementation.  Basically I need to count
search phrases like 'x y z' and 'y z x' as being the same.


-Original Message-
From: Cheolgoo Kang [mailto:[EMAIL PROTECTED] 
Sent: 08 December 2005 08:51 am
To: java-user@lucene.apache.org
Subject: Re: Top n Searches

Hi,

You first save those search keywords entered by users into some kind
of storage like a database system or even into a dedicated Lucene
index. So it's a database and web issue, not a Lucene one.

And, as you know, Lucene does not provide this functionality out of the
box.

Good luck!

On 12/8/05, Paul Williams <[EMAIL PROTECTED]> wrote:
> Hi,
>
>
>
> I've been asked whether we can do a Top n Searches functionality where
> we record the most common searched for phrases on a daily basis.  I'm
> not sure where to start with this or even if this is feasible with
> Lucene.
>
>
>
> Anyone done anything similar?
>
>
>
> Cheers.
>
> Paul Williams.
>
>
>


--
Cheolgoo

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]






-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]