Stefan. > I know people having >500 mio pages index and I personal run crawls with ~300 pages per second.
Sorry, but I have to ask: what kind of setup do you have (network, hw, nutch version) that you manage so many pages per second? Unless this is a "company secret", it would be very nice to know how you manage this. Rgrds, Thomas
