Hi all Just have a couple more questions which remain unclear to me at this stage.
1. I'm fetching urls on a P4 2.8ghz machine with 1GB ram and 100mbps connection. Based on this config what would you recommend the maximum fetcher threads should be? 2. Does anyone know of a script or plugin that can automate the segment/fetch/indexing process? Basicallly I'm fetching about 20 million pages and I have to run the segment, fetch and index process myself in a shell (which takes some time). I really would like some sort of a shell script that I can run and the whole process can run as a daemon in the background and I can worry about other issues. Thank you in advance!!!! -- Regards Justin Hartman PGP Key ID: 102CC123
