Sebastian Nagel created NUTCH-2519:
--------------------------------------
Summary: Log mapreduce job counters in local mode
Key: NUTCH-2519
URL: https://issues.apache.org/jira/browse/NUTCH-2519
Project: Nutch
Issue Type: Improvement
Affects Versions: 1.14, 2.3.1
Reporter: Sebastian Nagel
Fix For: 2.4, 1.15
A simple change in the log4j.properties would make the Hadoop job counters
appear in the hadoop.log also in local mode:
{noformat}
log4j.logger.org.apache.hadoop.mapreduce.Job=INFO
{noformat}
This may provide useful information for debugging, esp. if counters are not
explicitly logged by tools (see
[@user|https://lists.apache.org/thread.html/1dd5410b479bd536fb3df98612db4b832cd0a97533099b0dc632eba9@%3Cuser.nutch.apache.org%3E]).
This would make the output also more similar to (pseudo)distributed mode
(Nutch is called via {{hadoop jar}}) Job counters and progress info are
obligatorily logged.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
