----- Original Message ----- From: "Andrzej Bialecki" <[EMAIL PROTECTED]>
Sent: Tuesday, June 05, 2007 4:56 PM

[...]
You can achieve a somewhat similar effect by controlling the number of fetcher threads. I realize this is not as accurate as a specific control mechanism, but so far it was sufficient for most users.

If this feature is important to you, please provide a patch that implements it, and we'll consider it for inclusion.

I think that for the time being I'll just channel the traffic through a Squid proxy, and use its "delay pools" feature to throttle the bandwidth (and also its DNS caching, which, as I mentioned a few days ago, I also need...). For Nutch, it might make sense to find the original patch. I'll try to get n touch with Matthias Jaekle, who authored that wiki page where fetcher.throttle.bandwidth was referenced.

Thanks anyway,

Enzo


Reply via email to