On 2004.08.18, Jim Wilcoxson <[EMAIL PROTECTED]> wrote:
> Hi - To put spiders in a separate thread pool, mapping requests to
> thread pools by url doesn't work.  You have to map by regular
> expression on the User-Agent header or by IP address, assuming you can
> figure out where Google's robots live.  That's why I was suggesting
> that the dispatching algorithm needs to be a registered proc.

Perhaps it could be both.  I definitely think being able to register a
callback (a C or Tcl one, but not both at the same time) that also acts
as a "thread pool selector" is a necessity.

Perhaps once we iron out the last remaining issues with the current
implementation in 4.1, I'll add that in.

-- Dossy

--
Dossy Shiobara                       mail: [EMAIL PROTECTED]
Panoptic Computer Network             web: http://www.panoptic.com/
  "He realized the fastest way to change is to laugh at your own
    folly -- then you can let go and quickly move on." (p. 70)


--
AOLserver - http://www.aolserver.com/

To Remove yourself from this list, simply send an email to <[EMAIL PROTECTED]> with the
body of "SIGNOFF AOLSERVER" in the email message. You can leave the Subject: field of 
your email blank.

Reply via email to