I don't think so (but I don't run nutch) To actually run searches, the search engines copy the index to local storage. Having them in HDFS is very nice, however, as a way to move them to the right place.
On 12/13/07 10:59 AM, "Eugeny N Dzhurinsky" <[EMAIL PROTECTED]> wrote: > On Thu, Dec 13, 2007 at 11:36:31AM +0200, Enis Soztutar wrote: >> Hi, >> >> nutch indexes the documents in the org.apache.nutch.indexer.Indexer class. >> In the reduce phase, the documents are output wrapped in ObjectWritable. >> The OutputFormat opens a local indexwriter(FileSystem.startLocalOutput()), >> and adds all the documents that are collected. Then puts the index in >> dfs(FileSystem.completeLocalOutput()). The resulting index has numReducer >> partitions. >> > > This means Lucene can work with indexes on DFS or nutch doesn't use Lucene?
