Some people think that not only do the forces of darkness have search 'bots trawling the net for signs of artist names and track titles to find anyone that might possibly be hosting music on the net but that when these 'bots see robots.txt telling them where they can't go these particular ones go straight to the place they're asked not to on the assumption something hidden is worth looking at.
As I say I don't know much about these things - my original question after all was does this all actually happen? Seems to me that while it's likely some conspiracy theorist would say it was even if it was far fetched it happens that it's not far fetched at all - it's easy enough to build a search engine (the PC magazine I got last week while trying to gain enough knowledge to decide what laptop to buy had a "make your own search engine" article in the back) so why wouldn't PRS, RIAA etc. do this? And having done it would they configure it to respect what I think (?) is only a convention? People may get angry if a 'bot disregards robots.txt but I don't think there's like the death penalty or anything. Of course I'm sure such reputable organisations would always make sure their actions were beyond reproach.......... > From: /0 [mailto:[EMAIL PROTECTED] > Sent: 13 February 2008 00:38 > > robots.txt? > > no good? > > > > Da : "[EMAIL PROTECTED]" > > Data : Tue, 12 Feb 2008 13:22:50 -0000 > > > >> Putting that stuff up about mixes brought to mind to ask > >> what people think about whether PRS / RIAA etc. do have > >> robots searching song titles / artists on sites - and > >> whether or that includes small label stuff?
