Am 2013-12-24 um 13:18 schrieb Ferran Jorba <[email protected]>: > Hello Henning, > >> different spiders/bots frequently call the /HNAP1/? uri on my server. >> Where does that come from? > >> My robots.txt should disallow everything. > > I don't know this one, but now all robots are very polite (Baidu is > very aggresive, but at least it respects the robots.txt restrictions). > In some very nasty cases, I had to add something like > > Deny from xxx.yyy.zzz.kkk > > in my Apache conf file, if it helps.
Hi Ferran, thank you, but my problem is not blocking spiders (I don’t care so much) but avoiding unnecessary exception alarms. The HNAP1 address doesn’t exist, I didn’t configure it anywhere, and I’d like to know why spiders try it - and why I get an exception where a 404 for the client would be enough. Greetlings, Hraban --- http://www.fiee.net https://www.cacert.org (I'm an assurer)
