[
https://issues.apache.org/jira/browse/NUTCH-3150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18057700#comment-18057700
]
Lewis John McGibbney commented on NUTCH-3150:
---------------------------------------------
Investigating build failure...
org.apache.nutch.protocol.http.TestProtocolHttpByProxy.testRequestByProxy()
Error Message
expected: <true> but was: <false>
h3. Stacktrace
org.opentest4j.AssertionFailedError: expected: <true> but was: <false> at
org.junit.jupiter.api.AssertionFailureBuilder.build(AssertionFailureBuilder.java:151)
at
org.junit.jupiter.api.AssertionFailureBuilder.buildAndThrow(AssertionFailureBuilder.java:132)
at org.junit.jupiter.api.AssertTrue.failNotTrue(AssertTrue.java:63) at
org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:36) at
org.junit.jupiter.api.AssertTrue.assertTrue(AssertTrue.java:31) at
org.junit.jupiter.api.Assertions.assertTrue(Assertions.java:183) at
org.apache.nutch.protocol.http.TestProtocolHttpByProxy.testRequestByProxy(TestProtocolHttpByProxy.java:90)
at java.base/java.lang.reflect.Method.invoke(Method.java:569) at
java.base/java.util.ArrayList.forEach(ArrayList.java:1511) at
java.base/java.util.ArrayList.forEach(ArrayList.java:1511)
> Expand Caching Hadoop Counter References
> ----------------------------------------
>
> Key: NUTCH-3150
> URL: https://issues.apache.org/jira/browse/NUTCH-3150
> Project: Nutch
> Issue Type: Sub-task
> Components: metrics
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.22
>
>
> This issue expands on initial work to cache counters in hot paths only. See
> NUTCH-3141.
> After some analysis this issue can be scoped as follows
> 9 files to modify (~45 counters total):
> * Fetcher.java - 5 counters (main fetch loop)
> * ResolverThread.java - 10 counters (DNS resolution)
> * Generator.java - 9 counters (URL generation)
> * CrawlDbReducer.java - Dynamic counters with Map
> * Injector.java - 6 counters (mapper + reducer)
> * CrawlDbFilter.java - 3 counters
> * WebGraph.java - 2 counters
> * DeduplicationJob.java - 1 counter
> * CleaningJob.java - 1 counter
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
