Hi Folks,

It is very common for us to see logging such as the following

fetching
> http://www.eclap.eu/drupal/?q=en-US/node/65229/og/forum&sort=asc&order=Topic
> -activeThreads=20, spinWaiting=19, fetchQueues.totalSize=414

What I've noticed for some time is that fetchQueues.totalSize never seems
to exceed 2500. Some primitive log analysis will verify this observation.
What this value represents (above) is that there are 414 items currently
queued up to be fetched. The fetching task will be more or less complete
once every member of the queue has been fetched.

The problem I see here is that when the fetchQueues.totalSize=2500, this is
actually not a true reflection of how many URLs are queued! This value
seems to be feeding from some other parent value > 2500.

I'm going to debug and investigate what is going on here however I thought
I would ask if anyone else knows why the value seems to hit the ceiling at
2500.

Thanks
Lewis

-- 
*Lewis*

Reply via email to