Hi,
I use some search engines, which work so far fine, but step into unwanted
crawling behaviour when they encounter certain http response header
information from the responding web servers.
For instance: the http response header
expires
is fine for browser, but aks the search enginge to revisit as soon as
possible after expiration date/time.
Questions:
1. is it possible to unset http response headers depending on the
name of the user agent or ip-address?
2. is it possible to strip or set http response headers by proxy like
tools?
regards
Harald
---------------------------------------------------------------------
The official User-To-User support forum of the Apache HTTP Server Project.
See <URL:http://httpd.apache.org/userslist.html> for more info.
To unsubscribe, e-mail: [EMAIL PROTECTED]
" from the digest: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
