Re: Hadoop + Lucene integration: possible? how?

2007-01-15 Thread Andrzej Bialecki
[EMAIL PROTECTED] wrote: I'm new to lucene and Hadoop but what I can't seem to find in the docs, internet... is how (and if possible?) to use Hadoop as the underlying FS for Lucene? Could anyone explain me how these can be tied together? Some small code/configuration example would be nice

Re: Hadoop + Lucene integration: possible? how?

2007-01-15 Thread Andrzej Bialecki
[EMAIL PROTECTED] wrote: Thanks Andrzej, let's me quickly explain my situation: I'm developing an application which is partially based upon 'tags' (the new hype lolz), instead of suing rdmbs for full text searching the tag list / item I'll be using Lucene. The application will have about

Re: Hadoop + Lucene integration: possible? how?

2007-01-15 Thread Doug Cutting
Andrzej Bialecki wrote: It's possible to use Hadoop DFS to host a read-only Lucene index and use it for searching (Nutch has an implementation of FSDirectory for this purpose), but the performance is not stellar ... Right, the best practice is to copy Lucene indexes to local drives in order