Thanks Christian:
Hello Everyone:
  This is a very cool page.  It says it is a high performance robot.  Isn't
that in opposition to good robot ettiquette?  Also there is a warning to not
let this bot loose on WWW at large.  What steps would be required to let it
do this?  Also I am considering building a non-profit page that is an
indexed search of Programming Source code and related pages.  The engine
will therefore be very Hueristic and even attempt to classify what language
the indexed pages are covering.  Does anyone have any interest in joining my
noble efforts?  I anticipate the need the help of one or two other people at
most?  There is no money involved (myself included) just much job
satisfaction.  I think this effort will lead to something else further on up
the road for participants.  Also if anyone knows of such a page that already
exists please let me know.  If it exists I still intend to build what I have
discussed.

Regards
Mark Wardell

-----Original Message-----
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On Behalf Of
Christian Brunner
Sent: Thursday, April 13, 2000 4:18 AM
To: [EMAIL PROTECTED]
Subject: Re: help about web robot


Sandeep,

have a look at the implementation of the libwww robot:

        http://www.w3.org/Robot/

It is a highly portable C library and is IMHO a good starting point.

Regards,

Christian


Sandeep Mehta wrote:
[snip]
> work and how they crawl the web etc. so just help me
> by providing information about web robot.
[snip]
--
CSK Computer Services Kaisha Deutschland GmbH
Christian Brunner     | Tel: (+49) 69 / 50952-234
Holzhausenstrasse 44  | Fax: (+49) 69 / 50952-299
60322 Frankfurt a. M. | E-Mail: [EMAIL PROTECTED]

Reply via email to