Re: Class in Lucene that Perform Search

2008-07-03 Thread blazingwolf7
Ah, thanks! I am clear now. Have to change tactics to achieve what I need. Which class during indexing time will create the .frq file? If possible, I want to add an extra value into it so that I can retrieve the information during the searching process. Thank Yonik Seeley wrote: > > On Wed, Ju

RE: readVInt, what is it for?

2008-07-03 Thread blazingwolf7
Thanks for all the help. I understand how it works already. Now I will have to know how to modify the .frq file. Can anyone help me with this? Mukherjee, Prasenjit wrote: > > The slide16 in the following ppt might be of some help. Let me know if > it helps. > > http://docs.google.com/Presen

[jira] Updated: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael McCandless updated LUCENE-1314: --- Attachment: lucene-1314.patch I don't think we need to check isCurrent() in doCommit

Re: IndexReader.isDeleted synchronization

2008-07-03 Thread Michael McCandless
But I think you still need to synchronize, because the first thread that does a deletion needs to create the deletedDocs BitVector and others need to wait while that's happening? I think [eventually] getting to a read-only reader is the best approach (https://issues.apache.org/jira/browse

Re: IndexReader.isDeleted synchronization

2008-07-03 Thread Jason Rutherglen
Should we do a read-only reader as part of the clone patch? Sounds very similar. Also sounds like the delegate model will work best instead of creating a SegmentReader subclass. On Thu, Jul 3, 2008 at 7:55 AM, Michael McCandless < [EMAIL PROTECTED]> wrote: > > But I think you still need to sync

Deleting first IndexCommit

2008-07-03 Thread Jason Rutherglen
For Ocean I need to be able to delete the latest commit, however currently using IndexReader.open(final IndexCommit commit, IndexDeletionPolicy deletionPolicy) I need to open the IndexReader that represents the latest commit, presumably in IndexDeletionPolicy.onInit delete the IndexCommit, then clo

Re: IndexReader.isDeleted synchronization

2008-07-03 Thread Michael McCandless
Let's do it as a separate patch? The clone patch is already scaring me enough ;) Maybe we can allow creation of a read-only IndexReader during open? Ie, a new open method that takes a "boolean readOnly". I had been previously thinking that we'd get to a read-only IndexReader by slurpi

[jira] Commented: (LUCENE-1316) Avoidable synchronization bottleneck in MatchAlldocsQuery$MatchAllScorer

2008-07-03 Thread Yonik Seeley (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610228#action_12610228 ] Yonik Seeley commented on LUCENE-1316: -- {quote}but ... thinking about how SegmentTerm

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610244#action_12610244 ] Jason Rutherglen commented on LUCENE-1314: -- > check isCurrent() I thought we wan

Re: Deleting first IndexCommit

2008-07-03 Thread Michael McCandless
Actually you'd need to open an IndexWriter to do the delete, unless you open a reader, make a change, then close the reader (on closing the reader, which makes a new commit, your deletion policy gets a chance to delete commits). One question: why are you needing to delete the most recent co

Re: Deleting first IndexCommit

2008-07-03 Thread Jason Rutherglen
It's for recovery, a commit to an index may have occurred but other commits as part of a global commit failed, so it's for rollback in the event of failure. Are you saying the delete does not immediately happen when IndexCommit.delete is called using IndexDeletionPolicy? I don't mind using IndexW

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-03 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610260#action_12610260 ] Michael McCandless commented on LUCENE-1314: bq. I thought we wanted to check

Re: Deleting first IndexCommit

2008-07-03 Thread Michael McCandless
Jason Rutherglen wrote: It's for recovery, a commit to an index may have occurred but other commits as part of a global commit failed, so it's for rollback in the event of failure. Ahh got it. Are you saying the delete does not immediately happen when IndexCommit.delete is called using

Re: Class in Lucene that Perform Search

2008-07-03 Thread Yonik Seeley
On Thu, Jul 3, 2008 at 4:03 AM, blazingwolf7 <[EMAIL PROTECTED]> wrote: > Ah, thanks! I am clear now. Have to change tactics to achieve what I need. > Which class during indexing time will create the .frq file? DocumentsWriter (called from IndexWriter). > If possible, I want to add an extra value

Store/Index Email Address in Lucene

2008-07-03 Thread miztaken
Hi there, I want to index email address in such a way that i can do WildCard, Phrase and Simple search on those items. for each document i will have email addresses string just like in the case of CC and TO in mails. for eg "[EMAIL PROTECTED]; [EMAIL PROTECTED]; john hopkings; [EMAIL PROTECTED]"

[jira] Created: (LUCENE-1326) Inflater.end() method not always called in FieldsReader

2008-07-03 Thread Robert Newson (JIRA)
Inflater.end() method not always called in FieldsReader --- Key: LUCENE-1326 URL: https://issues.apache.org/jira/browse/LUCENE-1326 Project: Lucene - Java Issue Type: Bug Affects Versio

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610303#action_12610303 ] Jason Rutherglen commented on LUCENE-1314: -- There are really only two options her

[jira] Commented: (LUCENE-1326) Inflater.end() method not always called in FieldsReader

2008-07-03 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610312#action_12610312 ] Uwe Schindler commented on LUCENE-1326: --- I think a try {} finally {} around both pla

[jira] Commented: (LUCENE-1326) Inflater.end() method not always called in FieldsReader

2008-07-03 Thread Robert Newson (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610315#action_12610315 ] Robert Newson commented on LUCENE-1326: --- You're welcome and thanks for the quick re

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-03 Thread robert engels (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610318#action_12610318 ] robert engels commented on LUCENE-1314: --- volatile should work on just about all 1.4.

[jira] Commented: (LUCENE-1314) IndexReader.reopen(boolean force)

2008-07-03 Thread Jason Rutherglen (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12610330#action_12610330 ] Jason Rutherglen commented on LUCENE-1314: -- Following up on the API comment, ther

Re: changing index format

2008-07-03 Thread John Wang
Hi Michael: What is the plan/timeline for supporting flexible indexing? Thanks -John On Wed, Jun 25, 2008 at 3:40 AM, Michael McCandless < [EMAIL PROTECTED]> wrote: > > John Wang wrote: > > The problem I am having is stated below, I don't know how to add the >> minDoc and maxDoc value

Re: Class in Lucene that Perform Search

2008-07-03 Thread blazingwolf7
I am trying to retrieve the contentLength and the URL of each document from the index without continuously using IndexReader, eg: reader.document.get("ur"); I am trying to find a way to retrieve all this value and stored it into an array by using the IndexReader only once or twice. I thought may

Multifield Search with OR and AND on different doc Fields

2008-07-03 Thread RanjithStar
My requirement is to search on SEVEN Fields say F1,F2,F3,F4,F5,F6,F7 having F1,F2,F3,F4 on one doc index and F5,F6,F7 on a different doc index I need to perform a search with ((F1=9 AND F2=4) AND (F3=keyword OR F4=keyword)) OR (F5=9 AND F6=4 AND F7=keyword) For normal search I was doing like th