Re: Fetch jumps to 1.0 complete

[Dennis Kubes]

I moved off of the most recent dev branches for our "production" system 
and put them on the release version for 0.8.  I only noticed it recently 
although it may have been happening before and I just didn't notice it.  
The one change that I did do that may have made it worse was I removed 
the crawl-url filter regular expressions for [EMAIL PROTECTED] and 
-.*(/.+?)/.*?\1/.*?\1/.  Andrzej , didn't you say awhile back when we 
were looking at regular expressions for a different stalling problem 
that you don't use these in your production systems?

Dennis
Andrzej Bialecki wrote:
Dennis Kubes wrote:
Hi Everybody,

I am running some fetches and some of the task are going along fine 
and are about 20% complete and then they will mysteriously jump to 
100% complete  Each time I get the "Aborting with N hung threads" in 
the logs.  Is anybody else seeing this?  It there anyway to get 
around the fetcher just stopping like this?

Please see NUTCH-339. Is this something that you noticed only 
recently, or was it like that before? There might have been some 
recent change that made this problem worse (it was always there to 
some degree) ...