here is a pretty good and efficient way to do it, from the author of lucene
himself
http://www.mail-archive.com/[email protected]/msg12709.html
> Date: Wed, 17 Nov 2010 15:58:53 +0800
> Subject: How to Transmit and Append Indexes
>
in general). I don't think this will be a
lucene-specific issue.
Thanks,
-Ben
--- On Wed, 11/17/10, Bing Li wrote:
> From: Bing Li
> Subject: How to Transmit and Append Indexes
> To: [email protected]
> Date: Wednesday, November 17, 2010, 1:58 A
t; -Ben
>
>
> --- On Wed, 11/17/10, Bing Li wrote:
>
> > From: Bing Li
> > Subject: How to Transmit and Append Indexes
> > To: [email protected]
> > Date: Wednesday, November 17, 2010, 1:58 AM
> > Hi, all,
> >
> > I am working o
17/10, Bing Li wrote:
> From: Bing Li
> Subject: How to Transmit and Append Indexes
> To: [email protected]
> Date: Wednesday, November 17, 2010, 1:58 AM
> Hi, all,
>
> I am working on a distributed searching system. Now I have
> one server only.
> It
e-
> From: Derek Finlen [mailto:[email protected]]
> Sent: Wednesday, November 17, 2010 9:58 AM
> To: [email protected]; [email protected]
> Subject: RE: How to Transmit and Append Indexes
>
> I hope, this isn't for the search engine Bing? :P
>
> -
That's in horribly bad taste.
-Original Message-
From: Derek Finlen [mailto:[email protected]]
Sent: Wednesday, November 17, 2010 9:58 AM
To: [email protected]; [email protected]
Subject: RE: How to Transmit and Append Indexes
I hope, this isn't for the sea
Dear Shashi,
I hope only one machine to generate new indexes based new crawled pages.
After that, the indexes can be transmitted to another or others machines
that respond users' queries.
However, when using Lucene.NET, I cannot control the indexing process. What
I can see is just the index files
IndexWriter has a Merge() method to combine indexes. Not sure what you mean
by " transmitted to anther one" , if you mean making the index available you
can copy it across the network.
BTW suggest you should look into Solr, since it does most of the work for
you using sharding etc.
On Wed, Nov 17
I hope, this isn't for the search engine Bing? :P
-Original Message-
From: Bing Li [mailto:[email protected]]
Sent: Wednesday, November 17, 2010 2:59 AM
To: [email protected]
Subject: How to Transmit and Append Indexes
Hi, all,
I am working on a distri
Hi, all,
I am working on a distributed searching system. Now I have one server only.
It has to crawl pages from the Web, generate indexes locally and respond
users' queries. I think this is too busy for it to work smoothly.
I plan to use two servers at at least. The jobs to crawl pages and genera
10 matches
Mail list logo
