Randal,
This is a nice package, but I have some questions:
> my $host = $r->get_remote_host;
> return DECLINED if $host =~ /\.(holdit|stonehenge)\.com$/;
You have host name lookups turned on? That's not very performance friendly.
And you've just published how to get around your thro
> "Jay" == Jay J <[EMAIL PROTECTED]> writes:
Jay> I just tried it using IE5 for NT4 ..
Jay> What you're seeing is when someone has used "Make available
Jay> offline" followed by:
Jay> "If this favorite links to other pages, would you like to make
Jay> those pages available offline too? [y/n
Randal L. Schwartz ([EMAIL PROTECTED]) said, on [991028 10:52]:
>
> The only thing in common with these rude intrusions is a windows-IE
> user agent, along with a new string "DigExt".
>
> Is it a new version of IE that permits heavy rapid download?
>
Yup. Microsoft have had problems before with
- Original Message -
From: Randal L. Schwartz <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>; <[EMAIL PROTECTED]>
Sent: Thursday, October 28, 1999 9:50 AM
Subject: "DigExt" in user-agent hammering my site
>
> In the past week or so, I've been seeing
Randal,
This is IE5. It has to do with the offline reading feature, it will try and
download as much of your site as it can depending on what the user has specified
in number of levels to download. It totaly ignores robots.txt.
Frank
"Randal L. Schwartz" wrote:
> In the past week or so, I've
Randal,
this is definitely Internet Explorer 5. I've seen the same several times on
my site and here's how it works: In IE5 you can make web pages available
for offline reading, you just need to go to Favorites/Add to Favorites ...
and select the number of levels you want to download. IE5 will ha
In the past week or so, I've been seeing many many portions of my site
sucked down in rapid fire. These sucks followed patterns of being a
spider -- some autogenerated URLs from pod2html are definitely bad,
and I saw these bad hits, indicating that someone is following every
link in every one of
