Has anyone used wpoison with htdig and able to share a How-I-Did-It?
http://www.monkeys.com/wpoison/
Basically, you put a hidden link to a perl script that generates a
pseudo WWW page just chock full of "email addresses" for email
scrounging bots. I store a number of lists, including htdig-general,
that I use htdig to index so I can access the information via my WWW.
Unfortunately I regularly get bots ignoring robots.txt, which disallows
/lists where all these are stored, and they proceed to read 40K+
messages. Just great for tying up my line.
Since it is a cgi script, I'm assuming it will be easy to tell htdig to
ignore this particule "page", but was wondering if anyone else has done
this and had any "gotcha's" to share.
--
Terry Collins {:-)}}} Ph(02) 4627 2186 Fax(02) 4628 7861
email: [EMAIL PROTECTED] www: http://www.woa.com.au
WOA Computer Services <lan/wan, linux/unix, novell>
"People without trees are like fish without clean water"
_______________________________________________
htdig-general mailing list <[EMAIL PROTECTED]>
To unsubscribe, send a message to <[EMAIL PROTECTED]> with a
subject of unsubscribe
FAQ: http://htdig.sourceforge.net/FAQ.html
