wouldn't link analysis be a problem?
----- Original Message -----
From: "Chris Schneider" <[EMAIL PROTECTED]>
To: <[email protected]>
Sent: Saturday, February 04, 2006 6:44 AM
Subject: Hosting segments in NDFS
Gang,
Would it be possible to modify Nutch so that a set of search servers
each had a local index, but that this index referred to segments
living in NDFS? Doing so would allow us to skip exporting the
segments from NDFS to the local FS. Of course, it would be ideal to
keep the crawling machines separate from the search servers, but
resource constraints do have a way of intruding... It seems like this
setup might provide sufficient performance, because only the
summaries in the current page of search results require segment
reading.
While we're on the subject of exporting segments to support
searching, which subdirs within the segment directories are required
for searching, building summaries, and displaying hits?
Thanks,
- Chris
--
------------------------
Chris Schneider
TransPac Software, Inc.
[EMAIL PROTECTED]
------------------------
-------------------------------------------------------
This SF.net email is sponsored by: Splunk Inc. Do you grep through log files
for problems? Stop! Download the new AJAX search engine that makes
searching your log files as easy as surfing the web. DOWNLOAD SPLUNK!
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=103432&bid=230486&dat=121642
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general
