Orjan Sandland wrote:
> Author: Orjan Sandland
> Email: [EMAIL PROTECTED]
> Message:
> I've got 315.000 URLs indexed now, and about 50.000 of them have status 302 - Moved
>Temporarily.
> I have no experience with this, but I think it's a rather high number.
>
> Any thoughts?
If the servers you have indexed have a lot of folders you will see a lot of 302's ....
ie....
telnet host.domain.com 80
Trying 127.0.0.1...
Connected host.domain.com.
Escape character is '^]'.
GET /downloads HTTP/1.0
Should return something like:
HTTP/1.1 302 Moved Temporarily
Server: Netscape-Enterprise/3.6 SP2
Date: Sun, 25 Mar 2001 23:58:33 GMT
Location: http://host.domain.com/download/
Content-length: 0
Content-type: text/html
Connection: close
where as:
telnet host.domain.com 80
Trying 127.0.0.1...
Connected to host.domain.com.com.
Escape character is '^]'.
GET /download/ HTTP/1.0
Will return:
HTTP/1.1 200 OK
Server: Netscape-Enterprise/3.6 SP2
Date: Sun, 25 Mar 2001 23:59:26 GMT
Content-type: text/html
Connection: close
<TITLE>Index of /download/</TITLE>
<h1>Index of /download/</h1>
<PRE><IMG SRC="/mc-icons/blank.gif" ALT=" "> Name Last modified
Size Description
<HR>
etc...
Similar goes for 301's (Moved permenantly) - it depends on the server configuration on
how their directories are stored and on which paths....
Yours
Mat
begin:vcard
n:Sullivan;Matthew
tel;cell:+61 (0)414 861 744
tel;fax:+61 (0)3 9693 7699
tel;home:+61 (0)3 9397 4859
tel;work:+61 (0)3 9693 7640
x-mozilla-html:TRUE
url:http://people.netscape.com/matthews/
org:<TABLE cols=2 width=350 spacing=0 rows=1><TR><TD width=50><img src="http://people.netscape.com/matthews/penguin.gif"></TD><TD><TABLE width=250 spacing=0 border=0><TR><TD><FONT SIZE=2>Senior Technical Support Engineer<TR><TD><FONT SIZE=2>iPlanet E-Commerce Solutions<TR><TD><FONT SIZE=2>Netscape Communications Australia Pty Ltd<TR><TD><FONT SIZE=2>A division of America On Line Inc.</TABLE></TABLE>
version:2.1
email;internet:[EMAIL PROTECTED]
adr;quoted-printable:;;Netscape Communications Australia=0D=0A;Level 1, The Tea House, 28 Clarendon Street;South Melbourne;VIC 3205;Australia
x-mozilla-cpt:nemesis.netscape.com;28656
fn:Matthew Sullivan
end:vcard
S/MIME Cryptographic Signature
