RE: updating index without refitting

2006-11-28 Thread Gal Nitzan
Hi,

You do not mention if the new field's data is stored as a metadata? Does the
value data being created during parse or is it added only during the index
phase?

If your new field is created during the parse process than you could delete
only the parse folders and run the parse process i.e. (delete segment/crawl
parse , segment/parse data , segment/parse text) and run bin/nutch parse
segment

Or if your field data is added during the index process than re-create your
index.

In any case it doesn't seem to me you would need to re-fetch.

HTH

Gal

-Original Message-
From: DS jha [mailto:[EMAIL PROTECTED] 
Sent: Tuesday, November 28, 2006 4:11 PM
To: nutch-dev@lucene.apache.org
Subject: updating index without refetching

Hi All,

Is it possible to update the index without refetching everything?  I have
changed logic of one of my plugins (which also sets a custom field in the
index) - and I would like this field to get updated without refetching
everything - is it doable?


Thanks,




Re: updating index without refitting

2006-11-28 Thread DS jha

new field's data is also stored as a meta data - value is assigned during
parse process and then during index, it reads meta-data field value and adds
it to an index. Looks like, I will have to run parse and index again.

Thanks much.


On 11/28/06, Gal Nitzan [EMAIL PROTECTED] wrote:


Hi,

You do not mention if the new field's data is stored as a metadata? Does
the
value data being created during parse or is it added only during the index
phase?

If your new field is created during the parse process than you could
delete
only the parse folders and run the parse process i.e. (delete
segment/crawl
parse , segment/parse data , segment/parse text) and run bin/nutch parse
segment

Or if your field data is added during the index process than re-create
your
index.

In any case it doesn't seem to me you would need to re-fetch.

HTH

Gal

-Original Message-
From: DS jha [mailto:[EMAIL PROTECTED]
Sent: Tuesday, November 28, 2006 4:11 PM
To: nutch-dev@lucene.apache.org
Subject: updating index without refetching

Hi All,

Is it possible to update the index without refetching everything?  I have
changed logic of one of my plugins (which also sets a custom field in the
index) - and I would like this field to get updated without refetching
everything - is it doable?


Thanks,