On Fri, 12 Jul 2013 15:34:22 +0000 (UTC) mrl <[email protected]> wrote: > Is there a way to block .php from being indexed by crawlers, but > allow other type files to be indexed? When the crawlers access the > php files, they are executed, creating lots of error messages (and > taking up cpu cycles). Thanks.
Google for "robots.txt". -- D'Arcy J.M. Cain System Administrator, Vex.Net http://www.Vex.Net/ IM:[email protected] Voip: sip:[email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
