Ferdy Galema created NUTCH-1352:
-----------------------------------

             Summary: Improve regex urlfilters/normalizers synchronization
                 Key: NUTCH-1352
                 URL: https://issues.apache.org/jira/browse/NUTCH-1352
             Project: Nutch
          Issue Type: Improvement
            Reporter: Ferdy Galema
             Fix For: nutchgora


I noticed that during fetching a lot of the time the fetcherthreads are 
blocking on a monitor because of outlink normalizing/filtering. The cause of 
this: Some of the regex plugins use single lock synchronization.

This patch improves throughput by removing synchronization locks and replace 
them with threadlocals were needed.

It has been extensively tested in production. I will commit this later today 
when no objection.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to