-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
> David, what did you see? What I saw on my system was that it held the
> pluck to the host, which is what I would expect given that --stayonhost is
> more rigid than --stayondomain. Other than that, it functioned normally.
Look even closer. images.slashdot.org is not fetched (though still
is part of the --stayondomain construct of slashdot.ort), when --stayonhost
is used. If you omit --stayonhost, you will properly get all the pages from
images.slashdot.org as well as slashdot.org content.
Incidentally, I talked to Rob Malda today (original author of
Slashcode) about the AvantGo 403 errors on their main page, and he thinks
that pounding on Slashdot's main page with spiders and crawlers will
most-certainly get us blocked and banned from being able to do so in the
future. A few snippets from our conversation:
"I'd be careful with those crawlers. Those *will* get you banned.
we have many scripts that automate it to keep the more overzealous
users under control.."
and later..
"Great. All I need is more crawlers hammering our site. Just put a
reasonable delay in there- our policy is a very strict - anyone who
loads more than a few hundred palm or rss pages gets banned. You
might wanna code your app to respect that.."
"I don't see why you can't simply load http://slashdot.org/palm/..";
So basically, don't pound the main page. Use the lean page, always,
or use the RSS content they make available (or use the slashpluck script,
which does the same thing).
> I just overlooked that possibility because it's a radio button (i.e.
> mutually exclusive) in Desktop.
Bleh, radio button. My shell script doesn't include radio buttons,
so remember that what you might use as your interface, may not be the same
that others use for theirs. Your changes affect more than your GUI
interface. Great work overall, keep it up.
d.
perldoc -qa.j | perl -lpe '($_)=m("(.*)")'
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.1.92 (GNU/Linux)
iD8DBQE9l5jYkRQERnB1rkoRAjlMAKCbjYjbh7guFDa+y8XezF14U3Y7sQCfaBFP
IPaP0/oygQb1btsD7FcnRO4=
=NiN7
-----END PGP SIGNATURE-----
_______________________________________________
plucker-list mailing list
[EMAIL PROTECTED]
http://lists.rubberchicken.org/mailman/listinfo/plucker-list
