job history has most of the details you are looking for at each task levels
On Tue, Jul 10, 2012 at 4:07 AM, Mike S <mikesam...@gmail.com> wrote: > Is there any Hadoop specific tool that can profile a job time? For > instance, if a job took x amount of time, the tool can profile how > this time was consumed at different stage likes time spent to read, to > map, to reduce reduce , shuttle move that and the different steps of > a Hadoop M/R job? > > If not, how do you recommend finding the map/reduce job bottle neck? > -- Nitin Pawar
