Yes, I am aware of the RemoteSearchable and ParallelSearcher. And I am doing something similiar now. i.e. split the index on multiple machines.
But managing such a set of indexes is not trivial. Especially when need to add redundancies for reliability and update frequently. I bumped into this a while ago: http://www.kimchy.org/compasslucene-and-datagrids/ also I've heard there is a Directory implemented for the HDFS but is unfortunately very slow. which makes me wonder whether this type of approach is practical (i.e. having good performance, can update index easily, optimization won't takes too long, etc) Cedric On Jan 31, 2008 6:59 PM, Karl Wettin <[EMAIL PROTECTED]> wrote: > 31 jan 2008 kl. 09.42 skrev Cedric Ho: > > > I am wondering if there exist any implemenation of > > org.apache.lucene.store.Directory which can be distributed across > > multiple machines with comparable performance to a local FSDirectory > > index, or is such an idea feasible in the first place. > > > > By comparable performance I mean a 100G index distributed in 10 > > machines should achieve the same performance as a 10G index on a local > > FSDirectory. > > I never used these things and don't know about their caveats, but > perhaps a combination of > > <http://lucene.apache.org/java/2_3_0/api/org/apache/lucene/search/RemoteSearchable.html > > > > and > > <http://lucene.apache.org/java/2_3_0/api/org/apache/lucene/search/ParallelMultiSearcher.html > > > > can help you? > > > karl > > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: [EMAIL PROTECTED] > For additional commands, e-mail: [EMAIL PROTECTED] > > --------------------------------------------------------------------- To unsubscribe, e-mail: [EMAIL PROTECTED] For additional commands, e-mail: [EMAIL PROTECTED]
