On Sat, 26 Nov 2011, Markus Ernst wrote:
Viewing the logs of applications I wrote, I noticed that a considerable
number of requests are from robots following links of types such as Add
to shopping cart or Remember this item - links that typically point
to the same page they are clicked
Hello
Viewing the logs of applications I wrote, I noticed that a considerable
number of requests are from robots following links of types such as Add
to shopping cart or Remember this item - links that typically point
to the same page they are clicked on, with some GET variable that
triggers
Le 26 nov. 2011 à 07:20, Markus Ernst a écrit :
Viewing the logs of applications I wrote, I noticed that a considerable
number of requests are from robots following links of types such as Add to
shopping cart or Remember this item - links that typically point to the
same page they are
On Sat, Nov 26, 2011 at 2:20 PM, Markus Ernst derer...@gmx.ch wrote:
Trying to find a solution to tell robots not to follow these links, I came
across microformat Robots Exclusion Profile
http://microformats.org/wiki/robots-exclusion and the @rel=nofollow
attribute. While the latter does not
