On Tue, 2008-09-30 at 00:45 +0200, Thorsten Scherler wrote:
> On Mon, 2008-09-29 at 03:07 +0000, [EMAIL PROTECTED] wrote:
> ...
> > NOTE, maxDepth and maxSize concepts still need to be added back...
> >     <property name="maxDepth" value="${droids.queue.maxDepth}"/>
> >     <property name="maxSize" value="${droids.queue.maxSize}"/>
> 
> For the web crawler this concepts is essential. Actually I think it is
> important as general concept and should go into the queue code
> directly. 

One other important thing is that crawler should use 
https://svn.apache.org/repos/asf/labs/droids/branch/LABS-144/src/core/java/org/apache/droids/impl/SimpleTaskQueueWithHistory.java

to prevent endless loops.

salu2
-- 
Thorsten Scherler                                 thorsten.at.apache.org
Open Source Java                      consulting, training and solutions


---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Reply via email to