Arun C Murthy wrote:
Eugeny N Dzhurinsky wrote:

Hello there!

Could somebody please explain is it possible to get some statistics for the
certain job? For instance, get some numbers of how many data tuples were
processed yet, and how many tuples needs to be processed to complete the job?


http://lucene.apache.org/hadoop/mapred_tutorial.html#Job+Control

Specifically:
http://lucene.apache.org/hadoop/api/org/apache/hadoop/mapred/JobClient.html#submitJob(org.apache.hadoop.mapred.JobConf)
and
http://lucene.apache.org/hadoop/api/org/apache/hadoop/mapred/RunningJob.html

To clarify, you can get the average progress of the maps and reduces (individually) from RunningJob, however not task-level details.

Arun

Reply via email to