Have a look at the mapred.task.profile property - this should help you get some of the information you need.
Tom On 25/02/2008, Alexander Mont <[EMAIL PROTECTED]> wrote: > I am interested in examining a MapReduce execution in order to determine > the amount of time it takes to execute each of the following parts of a > MapReduce job: > > - Loading of data onto mappers > - Executing map operation > - Sorting/partitioning of map output > - Loading map output onto reducers > - Executing reduce operation > - Writing output of reducers to data files > > Does Hadoop have a built-in mechanism to profile a MapReduce application > in this way, and if not, have other mechanisms to do this been developed? > > -Alex Mont >
