[
https://issues.apache.org/jira/browse/NUTCH-2839?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17471239#comment-17471239
]
Lewis John McGibbney commented on NUTCH-2839:
---------------------------------------------
Really interesting [~abstractdog]. Your short message has reminded me to to
_assume_ or _take for granted_ things like counters not being implemented. It
looks like the preliminary phase of having Nutch run on Tez is uncovering a new
use case... which is great. I'll make the rest of my comments over on TEZ-4371.
> Implement Tez counters in Injector job
> --------------------------------------
>
> Key: NUTCH-2839
> URL: https://issues.apache.org/jira/browse/NUTCH-2839
> Project: Nutch
> Issue Type: Sub-task
> Components: injector, tez
> Affects Versions: 1.18
> Reporter: Lewis John McGibbney
> Assignee: Lewis John McGibbney
> Priority: Major
> Fix For: 1.19
>
>
> When running the Injector job on Tez, counters are not populated. This makes
> sense as all existing counters are created using MapReduce framework Context
> objects. This presents a major issue however. Counters are a requirement as
> they are key to regular inspections of ongoing crawls, finding errors and
> debugging. The [org.apache.tez.common.counters
> |https://tez.apache.org/releases/0.9.2/tez-api-javadocs/index.html?org/apache/tez/common/counters/package-summary.html]
> package may offer a equivalent replacement. This issue will be investigated
> in this ticket.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
