Re: Lucene indexes getting deleted after application restart

2016-07-06 Thread Michael McCandless
Call IW.commit on a periodic basis, e.g. every N (!= 1) docs, or every M bytes or something? Mike McCandless http://blog.mikemccandless.com On Wed, Jul 6, 2016 at 1:57 PM, Desteny Child wrote: > Hi! > > In my Spring/Lucene application I'm using Lucene IndexWriter, > TrackingIndexWriter, Search

Re: Lucene indexes reverting to past state

2015-08-26 Thread Michael McCandless
Are you calling IndexWriter.commit when you shut down the app? Mike McCandless http://blog.mikemccandless.com On Tue, Aug 25, 2015 at 11:49 PM, Loamy Hound wrote: > *Summary:* > > Lucene indexes appear to revert to some past state after an application > restart. > > *Background:* > > We're run

Re: Lucene Indexes explanantion

2013-06-10 Thread Jack Krupansky
ious terms: - Indexed terms - Stored values - Payloads - DocValues -- Jack Krupansky -Original Message- From: nikhil desai Sent: Monday, June 10, 2013 8:36 PM To: java-user@lucene.apache.org Subject: Re: Lucene Indexes explanantion I don't think I could get much from what you said, c

Re: Lucene Indexes explanantion

2013-06-10 Thread nikhil desai
. And there are > DocValues as well. > > > -- Jack Krupansky > > -Original Message- From: nikhil desai > Sent: Monday, June 10, 2013 8:06 PM > To: java-user@lucene.apache.org > Subject: Re: Lucene Indexes explanantion > > > Sure. Thanks Jack. > I don&#

Re: Lucene Indexes explanantion

2013-06-10 Thread Jack Krupansky
@lucene.apache.org Subject: Re: Lucene Indexes explanantion Sure. Thanks Jack. I don't have much experience working with Lucene, however, here is what I am trying to resolve. I learned that the Custom attributes cannot be used for indexing or searching purposes. However I wanted the attributes to be use

Re: Lucene Indexes explanantion

2013-06-10 Thread nikhil desai
Sure. Thanks Jack. I don't have much experience working with Lucene, however, here is what I am trying to resolve. I learned that the Custom attributes cannot be used for indexing or searching purposes. However I wanted the attributes to be used for indexing and searching. So I created custom attr

Re: Lucene Indexes explanantion

2013-06-10 Thread Jack Krupansky
Even though you've posted for Lucene, you might want to consider taking a look at Solr because Solr has an Admin UI with an Analysis page which gives you a nice display of how index and query text is analyzed into tokens, terms, and attributes - all of which Solr inherits from Lucene. And chec

RE: Lucene indexes

2009-02-24 Thread Steven A Rowe
On 2/24/2009 at 5:36 PM, Chris Hostetter wrote: > Shingling is (lucene specific?) vernacular for word based ngrams "Shingle" is not a Lucene-specific term - here's an entry, e.g., from an IBM "Glossary of terms for enterprise search" at

RE: Lucene indexes

2009-02-24 Thread Chris Hostetter
: The problem that I am trying to solve is : How to index phrases (rather : than phrase querying)? I have a Questions/Answers corpus, the : architecture I am using for IR creates one index for questions and : another one for answers (based on single terms) and then matches between : them. I wa

Re: Lucene indexes

2009-02-24 Thread Shashi Kant
you correctly). HTH, Shashi - Original Message From: Nada Mimouni To: java-user@lucene.apache.org Sent: Tuesday, February 24, 2009 9:22:19 AM Subject: RE: Lucene indexes Thank you Erick. I am totally aware that Lucene uses inverted index (class: IndexWriter). I have read in the

RE: Lucene indexes

2009-02-24 Thread Nada Mimouni
[mailto:erickerick...@gmail.com] Sent: Tue 2/24/2009 2:13 PM To: java-user@lucene.apache.org Subject: Re: Lucene indexes I have to ask why do you care? Which is another way of asking what problem you're trying to solve that you think this information would help with. As far as I know Lucene

Re: Lucene indexes

2009-02-24 Thread Erick Erickson
I have to ask why do you care? Which is another way of asking what problem you're trying to solve that you think this information would help with. As far as I know Lucene is an inverted index, period. You use IndexWriter to create it. Really the best way to get a sense for which classes to use is

Re: Lucene indexes and relationship

2007-09-15 Thread Grant Ingersoll
Sounds like faceting, I think. Have you looked at Solr? -Grant On Sep 15, 2007, at 1:15 AM, Mohammad Norouzi wrote: Hello, In our application, we have many categories (indexes) in which different kind of information have been indexed. we provided a facility for our users to opt their cate

Re: lucene indexes back up strategies

2007-05-01 Thread larry hughes
Hi Mike, I decided to go ahead and upgrade to Lucene 2.1. My regression tests seem fine. However, I still don't understand the files of the index you've described. >>You can also remove all now-deleted filenames if you are only interested in the most recent snapshot. I'm not sure what these

Re: lucene indexes back up strategies

2007-04-27 Thread Chris Hostetter
: > Wow, I did not know Lucene 2.1 can do all of this. The problem is that I'm : > currently using 2.0. Is there something similar to what you just mentioned : > in dealing with 2.0 indexes--backing up piecewise? Thanks again. : : Hmm, OK. Pre-2.1 Lucene will overwrite at least the file "segmen

Re: lucene indexes back up strategies

2007-04-27 Thread Michael McCandless
"larry hughes" <[EMAIL PROTECTED]> wrote: > Wow, I did not know Lucene 2.1 can do all of this. The problem is that I'm > currently using 2.0. Is there something similar to what you just mentioned > in dealing with 2.0 indexes--backing up piecewise? Thanks again. Hmm, OK. Pre-2.1 Lucene will

Re: lucene indexes back up strategies

2007-04-27 Thread larry hughes
Thanks Mike, Wow, I did not know Lucene 2.1 can do all of this. The problem is that I'm currently using 2.0. Is there something similar to what you just mentioned in dealing with 2.0 indexes--backing up piecewise? Thanks again. LH Michael McCandless-3 wrote: > > > > "larry hughes" <[EMAI

Re: lucene indexes back up strategies

2007-04-27 Thread Michael McCandless
"larry hughes" <[EMAIL PROTECTED]> wrote: > I'm pondering on long term maintenance issues with Lucene indexes > and would like to know of anyone's suggestions or recommendations to > backing up these indexes. My goal is to have a weekly, or even > daily, snapshot of the current index to make su