Robots.txt is a file that allows or denies robots from indexing or crawling the site if they behave as they should. Favicon.ico is an icon image that shows up in the address bar of a browser generally to the left of the uri. Neither are completely necessary and both are items you would create and store in the public html directory as you had noted.
Cheers, Chad Dave wrote: > Hello, > I'm running an apache 2.2 webserver on centos 5.3. I'm seeing > frequent requests for robots.txt and favicon.ico from the logs those files > should be in the document root area. What are these files, is this something > the rpm installs, or do i have to retrieve or generate them? > Thanks. > Dave. > > _______________________________________________ > CentOS mailing list > [email protected] > http://lists.centos.org/mailman/listinfo/centos > -- Chad Dahlstrom [email protected] Green webhosting and website design www.taproothosting.com 503.349.0392 Follow us on Twitter: http://twitter.com/pdxgreenwebhost _______________________________________________ CentOS mailing list [email protected] http://lists.centos.org/mailman/listinfo/centos
