since redirects are usually on the root of the website (the index.html's
of this world), it's easy to manage, since you just specify the
redirected URL in the channel setup rather than the original. i've
never managed a site with redirects either. my rule is just copy the
address bar in my web
Yes, that would work, but that means we have to go test-and-grab the URL
from a site we think we know the address of. Plus redirects are there for
a reason, and may change.
Tony
At 10:27 AM 9/23/2002 +0200, Kevin O'Shaughnessy wrote:
since redirects are usually on the root of the
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Yes, that would work, but that means we have to go test-and-grab the URL
from a site we think we know the address of. Plus redirects are there for
a reason, and may change.
Blame the authors of the core Python code we use for spidering.
3 matches
Mail list logo
