>Does anybody have recommendations as to index size per machine using 
>distributed searching.
>
>We are currently doing about 1M pages per index with each index on a 
>separate machine.  That seems work fast.  Just wanted to know what 
>stats other people were using.
>
>Also I thought I remembered seeing a post from Doug a while back 
>about overall performance settings but couldn't find it, anybody 
>know where that is?

We have 2M documents per index, with two indexes (on two different 
drives) per searcher. This seems to work well, especially with lots 
of ram (e.g. 8GB) and disks with fast spindle/low seek times (e.g. WD 
Raptor SATA disks).

-- Ken
-- 
Ken Krugler
Krugle, Inc.
+1 530-210-6378
"Find Code, Find Answers"

-------------------------------------------------------------------------
Using Tomcat but need to do more? Need to support web services, security?
Get stuff done quickly with pre-integrated technology to make your job easier
Download IBM WebSphere Application Server v.1.0.1 based on Apache Geronimo
http://sel.as-us.falkag.net/sel?cmd=lnk&kid=120709&bid=263057&dat=121642
_______________________________________________
Nutch-general mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/nutch-general

Reply via email to