>From what I think I heard on another group was that it dosent matter what stylesheet you use, it will just read the file, getting words and following links. Cant remember where I read this, think it was a forum, and they were argueing about robots and whether they follow links specified in JavaScript.
One person said he was going to do a link to a page which only robots will follow, say do it on a 1*1 pixel so no chance of a user to follow it. And on that page do list of keywords as most robots ignore to many keywords in meta tags. This would mean doing the limit robot meta tags to only the home page and the robot page. So you could do a page with your links on, that is linked from the home page but hard to click on! And do the meta tags on other pages to stop robots. Could work?! Love, Steve XX > > does anybody know a way to make a distinction > > between robots and users? > > should I use the user agent? Or is this not a safe method. > > If the visitor is a spider/robot I want to include some script > > containing extra URL's for the robot. > > I am very interested too in this, as I received visits from a site with a > rather strange user agent (well, at least, that I did not expect) on a web > site of mine. The user agent was something like > > "SurveyBot/2.2 <a href=\'http://www.whois.sc\'>Whois Source</a>" > > I really don't know how I should generate my pages in this case, what kind > of stylesheet I should include to make the page correct (if I even have to). > > Anyway, the real question behind is : > > Is there a good way to handle the user agent info? > > > Vincent Vandemeulebrouck > http://www.leguerriersorde.com/ > > > -- > PHP General Mailing List (http://www.php.net/) > To unsubscribe, visit: http://www.php.net/unsub.php > -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
