On 9/20/07, Darrin Thompson <[EMAIL PROTECTED]> wrote:
> So I tried to be the bot and looked at what it would have seen:
>
> $ curl -s -I http://****.com/HTTP/1.1 200 OK
> Vary: Cookie
> Content-Type: text/html; charset=utf-8
> Date: Thu, 20 Sep 2007 15:44:33 GMT
> Server: lighttpd/1.4.13
>
> I can see how conservative crawlers would decide to leave.

I don't see anything here which would scare off a bot... what,
precisely, are you thinking is the problem here?

(also: my blog was, for over a year, served from lighttpd doing the
flup/FastCGI thing, and was consistently indexed and well-treated by
search engines. Perhaps you're focusing on the wrong things?)


-- 
"Bureaucrat Conrad, you are technically correct -- the best kind of correct."

--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups 
"Django users" group.
To post to this group, send email to [email protected]
To unsubscribe from this group, send email to [EMAIL PROTECTED]
For more options, visit this group at 
http://groups.google.com/group/django-users?hl=en
-~----------~----~----~----~------~----~------~--~---

Reply via email to