you can see those stats for each job in the job tracker web interface
http://yourdfsmaster.com:50030/jobtracker.jsp
click on the job link to get the stats
since its in the web interface there is probably a command to get it.
Shirley Cohen wrote:
Hi,
I would like to measure the disk i/o performance of our hadoop
cluster. However, running iostat on 16 nodes is rather cumbersome.
Does dfs keep track of any stats like the number of blocks or bytes
read and written? From scanning the api, I found a class called
"org.apache.hadoop.fs.FileSystem.Statistics" that could be relevant.
Does anyone know if this is what I'm looking for?
Thanks,
Shirley
