Hi,
I've had that, maybe once a month some bright user on a dynamic home connection
free isp dialup account comes and tries to snag our jobs database, and the only
user agent we know of is teleport pro (responsible for the majority of this kind
of attack).
One nasty customer prompted us to do something about it. He did a massive suck
in less than 2 hours, around midday. He then proceeded to email everyone on the
database with a headhunting spam, which luckily went to our marketing director,
who happened to be on the database too.. :)
We are in the process of setting up something that does what marco is doing:
redirect to error page.
My friendly sysadmin tells me we could put together a program that does this
regardless of what the user agent is, but it's not quick-hack territory.
As well as keeping a list of known commercial site sucking crawlers, could we
share secrets on doing this too?
I think in the end, clever people will always get through, if they try hard
enough, but it's usually very silly people who do this...
Ale
ps: marco, the pictures give 404s on your teleport page!
On Wed, 14 Jun 2000, you wrote:
>*This message was transferred with a trial version of CommuniGate(tm) Pro*
>Hi all!
>
>I see some urchins grab my whole olive site using Teleport.
>I'm not very concerned about our informations, but I prefer to give away
>the whole site as an unique compressed file to reduce my traffic and to see
>*why* people is so much interested in olives.
>
>So I ask our Apache-master to add mod_rewrite commands to lock Teleport and
>some email-sucking progs, sending them to a page without links ;)
>
>Has somebody user-agent identifications for similar programs (e.g.
>sitesnagger, emailsiphon) so I can lock other intruders?
>I have some u-a lists, but they don't contain infos about these programs,
>so I risk to stop useful robots.
>
>BTW, who need to see what will be grabbed by snaggers can look the page
>http://www.taggiasca.com/teleport.shtml
>
>Thanks in advance!
>
>Marco Bernardini
>
>
>^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>Warning: Dates in calendar
>are closer than they appear.
>^^^^^^^^^^^^^^^^^^^^^^^^^^^^
>
>------------------------------------------------------------------------
>This is the analog-help mailing list. To unsubscribe from this
>mailing list, send mail to [EMAIL PROTECTED]
>with "unsubscribe" in the main BODY OF THE MESSAGE.
>List archived at http://www.mail-archive.com/[email protected]/
>------------------------------------------------------------------------
--
Alejandro Fernandez
Webmaster
Sift Group plc., 100 Victoria Street, BRISTOL, BS1 6HZ
tel:+44 117 915 9600 fax:+44 117 915 9630 http://www.sift.co.uk
------------ "Vertical B2B Communities"
------------------------------------------------------------------------
This is the analog-help mailing list. To unsubscribe from this
mailing list, send mail to [EMAIL PROTECTED]
with "unsubscribe" in the main BODY OF THE MESSAGE.
List archived at http://www.mail-archive.com/[email protected]/
------------------------------------------------------------------------
