Simon Waters wrote:
Seeing issues with Googlebots retrying on large PDF files.
Apache logs a 200 for the HTTP 1.0 requests.
Squid logs an HTTP 1.1 request that looks to have stopped early (3MB out of
13MB).
This pattern is repeated with slight variation in the amount of data served to
the Googlebots, and after about 14 attempts it gives up and goes away.
Anyone else seeing same?
Not seeing this, but.... do you have correct Expires: and Cache-Control
headers on those .pdf? and is GoogleBot not obeying them?
Amos
--
Please use Squid 2.7.STABLE4 or 3.0.STABLE9
