-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 On 14/02/13 10:55, Fabio Pietrosanti (naif) wrote:
> Tor2web software by default: - setup a robots.txt to prevent search > engine scraping - block a wide set of Crawler UA to further block > search activities - prevent hotlinking (from an internet resource > to do <img src="https://blahblah.tor2web.org/image.jpg"> This seems like a strange default to me. I can see why people would want to create hidden services that can be discovered using ordinary channels on the Internet such as search engines. If a hidden service operator actually wanted to block search engines, they'd know to create their own robots.txt file, or to add appropriate meta tags to their HTML, or to simply block based on the User-Agent header... - -- Mike Cardwell https://grepular.com/ http://cardwellit.com/ OpenPGP Key 35BC AF1D 3AA2 1F84 3DC3 B0CF 70A5 F512 0018 461F XMPP OTR Key 8924 B06A 7917 AAF3 DBB1 BF1B 295C 3C78 3EF1 46B4 -----BEGIN PGP SIGNATURE----- iQGGBAEBCgBwBQJRHVcLMBSAAAAAACAAB3ByZWZlcnJlZC1lbWFpbC1lbmNvZGlu Z0BwZ3AuY29tcGdwbWltZTgUgAAAAAAVABpwa2EtYWRkcmVzc0BnbnVwZy5vcmdt aWtlLmNhcmR3ZWxsQGdyZXB1bGFyLmNvbQAKCRCdJiMBwdHnBLOwCACCs2fUrRcc AZG/g0XGrJ08cZT+yHpWz0W9hpX4OZNmSIeoEB3HXVZImJLF7SLYa2PUFWyo5tbG nFzk3lQOv7NWH01o8cqKhyT24onj4J52b1yTHN7zEPArVKqPIiIoQDEGITInbc3a fbkvK4ToMqinCLphfGMWPLdg0JPOu/TCH1l72m9vi5CIowlRIZndWkgI8U1QpExC Gy7wx2sObsgCSwRmlJtQvcIg1WEIE0Ewh6MLraMdqzDHjV0AbZY2qS9hPy3AU8er 9dYLScx/UvMTJCXMAm0BC4jHZBOH3a5aXtDjKH0m8zmUHcWQH/+Grz3dlm5dq139 cAc9PDN9/1Ol =lMQy -----END PGP SIGNATURE----- _______________________________________________ tor-talk mailing list [email protected] https://lists.torproject.org/cgi-bin/mailman/listinfo/tor-talk
