[CentOS] favicon.ico and robots.txt

2009-08-28 Thread Dave
Hello, I'm running an apache 2.2 webserver on centos 5.3. I'm seeing frequent requests for robots.txt and favicon.ico from the logs those files should be in the document root area. What are these files, is this something the rpm installs, or do i have to retrieve or generate them? Thanks.

Re: [CentOS] favicon.ico and robots.txt

2009-08-28 Thread Brian Mathis
favicon.ico: http://lmgtfy.com/?q=favicon.ico robots.txt: http://lmgtfy.com/?q=robots.txt On Fri, Aug 28, 2009 at 11:46 AM, Davedave.meh...@gmail.com wrote: Hello,        I'm running an apache 2.2 webserver on centos 5.3. I'm seeing frequent requests for robots.txt and

Re: [CentOS] favicon.ico and robots.txt

2009-08-28 Thread Taproot
Robots.txt is a file that allows or denies robots from indexing or crawling the site if they behave as they should. Favicon.ico is an icon image that shows up in the address bar of a browser generally to the left of the uri. Neither are completely necessary and both are items you would create

Re: [CentOS] favicon.ico and robots.txt

2009-08-28 Thread centos
On Fri, 28 Aug 2009 08:54:02 -0700 Taproot webmas...@taproothosting.com wrote: Robots.txt is a file that allows or denies robots from indexing or crawling the site if they behave as they should. It's a common misconception. Robots.txt does NOT allow or deny... Robots.txt only SUGGESTs what