HDFS counters

I am analyzing some HDFS counters, and I have these questions? 1 - The "HDFS: Number of bytes read" as long as the map tasks read data from the HDFS, or it is a pre-calculated sum before the mappers start to read? 2 - With these metrics, it was written some data in the HDFS before the

Re: FILE and HDFS counters

ss the phases. On Sun, Apr 24, 2011 at 4:52 PM, Pedro Costa wrote: > Hi, > > the Hadoop MapReduce counters has the parameters FILE_BYTES_READ, > FILE_BYTES_WRITTEN, HDFS_BYTES_READ and HDFS_BYTES_WRITTEN. > What the FILE and HDFS counters represents? > > > Thanks, > > > > -- > Pedro > -- Harsh J

FILE and HDFS counters

Hi, the Hadoop MapReduce counters has the parameters FILE_BYTES_READ, FILE_BYTES_WRITTEN, HDFS_BYTES_READ and HDFS_BYTES_WRITTEN. What the FILE and HDFS counters represents? Thanks, -- Pedro