[ https://issues.apache.org/jira/browse/NUTCH-1352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13295801#comment-13295801 ]
Hudson commented on NUTCH-1352: ------------------------------- Integrated in Nutch-trunk #1869 (See [https://builds.apache.org/job/Nutch-trunk/1869/]) NUTCH-1352 Improve regex urlfilters/normalizers synchronization (Revision 1349227) Result = SUCCESS markus : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1349227 Files : * /nutch/trunk/CHANGES.txt * /nutch/trunk/src/plugin/lib-regex-filter/src/java/org/apache/nutch/urlfilter/api/RegexRule.java * /nutch/trunk/src/plugin/lib-regex-filter/src/java/org/apache/nutch/urlfilter/api/RegexURLFilterBase.java * /nutch/trunk/src/plugin/urlfilter-regex/src/java/org/apache/nutch/urlfilter/regex/RegexURLFilter.java * /nutch/trunk/src/plugin/urlnormalizer-basic/src/java/org/apache/nutch/net/urlnormalizer/basic/BasicURLNormalizer.java * /nutch/trunk/src/plugin/urlnormalizer-regex/src/java/org/apache/nutch/net/urlnormalizer/regex/RegexURLNormalizer.java > Improve regex urlfilters/normalizers synchronization > ---------------------------------------------------- > > Key: NUTCH-1352 > URL: https://issues.apache.org/jira/browse/NUTCH-1352 > Project: Nutch > Issue Type: Improvement > Reporter: Ferdy Galema > Fix For: nutchgora, 1.6 > > Attachments: NUTCH-1352-1.6-1.patch, NUTCH-1352.patch > > > I noticed that during fetching a lot of the time the fetcherthreads are > blocking on a monitor because of outlink normalizing/filtering. The cause of > this: Some of the regex plugins use single lock synchronization. > This patch improves throughput by removing synchronization locks and replace > them with threadlocals were needed. > It has been extensively tested in production. I will commit this later today > when no objection. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira