[
https://issues.apache.org/jira/browse/NUTCH-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18057681#comment-18057681
]
Hudson commented on NUTCH-3150:
-------------------------------
FAILURE: Integrated in Jenkins build Nutch » Nutch-trunk #219 (See
[https://ci-builds.apache.org/job/Nutch/job/Nutch-trunk/219/])
NUTCH-3150 Expand Caching Hadoop Counter References (#892) (github:
[https://github.com/apache/nutch/commit/f7c7e1a03cf46cdbbedfe923c0d7a97c34fbf2aa])
* (edit) src/java/org/apache/nutch/hostdb/ResolverThread.java
* (edit) src/java/org/apache/nutch/fetcher/Fetcher.java
* (edit) src/java/org/apache/nutch/util/SitemapProcessor.java
* (edit) src/java/org/apache/nutch/tools/warc/WARCExporter.java
* (edit) src/java/org/apache/nutch/crawl/Generator.java
* (edit) src/java/org/apache/nutch/util/DomainStatistics.java
* (edit) src/java/org/apache/nutch/crawl/CrawlDbFilter.java
* (edit) src/java/org/apache/nutch/indexer/CleaningJob.java
* (edit) src/java/org/apache/nutch/scoring/webgraph/WebGraph.java
* (edit) src/java/org/apache/nutch/hostdb/UpdateHostDbReducer.java
* (edit) src/java/org/apache/nutch/crawl/Injector.java
* (edit) src/java/org/apache/nutch/crawl/CrawlDbReducer.java
* (edit) src/java/org/apache/nutch/hostdb/UpdateHostDbMapper.java
* (edit) src/java/org/apache/nutch/crawl/DeduplicationJob.java
> Expand Caching Hadoop Counter References
> ----------------------------------------
>
> Key: NUTCH-3150
> URL: https://issues.apache.org/jira/browse/NUTCH-3150
> Project: Nutch
> Issue Type: Sub-task
> Components: metrics
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.22
>
>
> This issue expands on initial work to cache counters in hot paths only. See
> NUTCH-3141.
> After some analysis this issue can be scoped as follows
> 9 files to modify (~45 counters total):
> * Fetcher.java - 5 counters (main fetch loop)
> * ResolverThread.java - 10 counters (DNS resolution)
> * Generator.java - 9 counters (URL generation)
> * CrawlDbReducer.java - Dynamic counters with Map
> * Injector.java - 6 counters (mapper + reducer)
> * CrawlDbFilter.java - 3 counters
> * WebGraph.java - 2 counters
> * DeduplicationJob.java - 1 counter
> * CleaningJob.java - 1 counter
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
