Quoting seanadams <[EMAIL PROTECTED]> on Thu, Feb 21 15:33:
>
> Interesting... we have a robots.txt which should stop (well behaved)
> crawlers. I'd be surprised if google.com weren't obeying it.
> 
> Make sure it comes up on your server at /robots.txt

I got curious and looked at this file on my machine, with version
7.0-17225 and 7.0-17682 on Debian unstable the file is missing a final
newline:

0 > od -a /usr/share/squeezecenter/HTML/EN/robots.txt
0000000   U   s   e   r   -   a   g   e   n   t   :  sp   *  nl   D   i
0000020   s   a   l   l   o   w   :  sp   /
0000031

I have no idea if that would cause issues, but it seems likely it could.

-- 
Disk crunch - please clean up.
_______________________________________________
discuss mailing list
[email protected]
http://lists.slimdevices.com/lists/listinfo/discuss

Reply via email to