Arun C Murthy wrote:
Eugeny N Dzhurinsky wrote:
Hello there!
Could somebody please explain is it possible to get some statistics
for the
certain job? For instance, get some numbers of how many data tuples were
processed yet, and how many tuples needs to be processed to complete
the job?
http://lucene.apache.org/hadoop/mapred_tutorial.html#Job+Control
Specifically:
http://lucene.apache.org/hadoop/api/org/apache/hadoop/mapred/JobClient.html#submitJob(org.apache.hadoop.mapred.JobConf)
and
http://lucene.apache.org/hadoop/api/org/apache/hadoop/mapred/RunningJob.html
To clarify, you can get the average progress of the maps and reduces
(individually) from RunningJob, however not task-level details.
Arun