Hi, Does anybody know what the maximum number of pages that have ever been fetched and indexed with nutch is? I know Yahoo Research did fetch 100M pages about 3 years ago, but they stopped after that. Is there any real large scale (like, google and yahoo) Webdb out there that has been fetched by nutch?
Thanks, Nima
