On Thu, 28 Sep 2006 09:22:00 +1200 Volker Kuhlmann <[EMAIL PROTECTED]> wrote:
> > > And that causes repeated downloads of the same .pdf how?? > > > ...by repeatedly rescanning your website, and repeatedly picking up > > the same things to upload, which is what you'd expect. > > No index page was fetched in between the .pdf downloads of the same > .pdf. > > > Tell you what, why not just change it to something more sensible, and > > see if the problem goes away? > > I don't get you here - why can't I have a link on my page to > http://volker.dnsalias.net/ ? That's what links are all about... > (And it wasn't my own website) You can, and it obviously works. But it's inefficient, requiring dns where not necessary as it's on the same server ( and actually a link to the current page ), and it *MAY* confuse a googlebot into repeatedly downloading files. > > C.H. - cable is always static. Besides google spiders by website, not > IP, so shouldn't matter if it was dynamic. All the .pdf are static > content, so playing with expiry times doesn't seem to be a good idea to > me? I haven't set any expiry anywhere. > > Here's another example from this morning: > > [20060928T051227+1200] -|[EMAIL PROTECTED] 461240 200 - 201 > "/linux/presentation/Photo-Linux-part2.pdf" - > [20060928T051542+1200] -|[EMAIL PROTECTED] 255782 200 - 204 > "/linux/presentation/Photo-Linux-part2-notes.pdf" - > [20060928T052217+1200] -|[EMAIL PROTECTED] 597 200 - 0 "/Jokes/html/" - > [20060928T051857+1200] -|[EMAIL PROTECTED] 461240 200 - 209 > "/linux/presentation/Photo-Linux-part2.pdf" - > [20060928T052218+1200] -|[EMAIL PROTECTED] 255782 200 - 229 > "/linux/presentation/Photo-Linux-part2-notes.pdf" - > [20060928T052550+1200] -|[EMAIL PROTECTED] 461240 200 - 100 > "/linux/presentation/Photo-Linux-part2.pdf" - > [20060928T052842+1200] -|[EMAIL PROTECTED] 255782 200 - 200 > "/linux/presentation/Photo-Linux-part2-notes.pdf" - > [20060928T053817+1200] -|[EMAIL PROTECTED] 0 304 - 0 > "/soft/patch/suse8.1/susewmif-colours-fix-8.1.diff" - > [20060928T053503+1200] -|[EMAIL PROTECTED] 255782 200 - 199 > "/linux/presentation/Photo-Linux-part2-notes.pdf" - > [20060928T054123+1200] -|[EMAIL PROTECTED] 255782 200 - 205 > "/linux/presentation/Photo-Linux-part2-notes.pdf" - > > Unless apache isn't logging properly? Log the size of the file, not the > number of bytes actually transferred? > > Volker > > -- > Volker Kuhlmann is list0570 with the domain in header > http://volker.dnsalias.net/ Please do not CC list postings to me. Why not try a little empirical testing, and maybe we'll all learn something from it? Steve
