Re: Missing pages.

[Lyndon Maydwell]

For example, on the sites that I'm crawling, all addresses starting
with www.x are  simply redirects to x.