[
https://issues.apache.org/jira/browse/MAPREDUCE-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13065303#comment-13065303
]
Hudson commented on MAPREDUCE-2365:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #737 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/737/])
MAPREDUCE-2365. Adding newer files.
MAPREDUCE-2365. Add counters to track bytes (read,written) via
File(Input,Output)Format. Contributed by Siddharth Seth.
acmurthy :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1146517
Files :
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/input/FileInputFormatCounter.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/input/FileInputFormatCounter.properties
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/output/FileOutputFormatCounter.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/output/FileOutputFormatCounter.properties
acmurthy :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1146515
Files :
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapred/ReduceTask.java
* /hadoop/common/trunk/mapreduce/CHANGES.txt
* /hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapred/MapTask.java
* /hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapred/Counters.java
* /hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapred/Task.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/input/LineRecordReader.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/output/FileOutputFormat.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/TaskCounter.java
*
/hadoop/common/trunk/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestJobCounters.java
*
/hadoop/common/trunk/mapreduce/src/test/mapred/org/apache/hadoop/mapreduce/TestMapReduceLocal.java
*
/hadoop/common/trunk/mapreduce/src/test/mapred/org/apache/hadoop/mapred/TestMiniMRDFSSort.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/TaskCounter.properties
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/input/FileInputFormat.java
*
/hadoop/common/trunk/mapreduce/src/java/org/apache/hadoop/mapreduce/lib/input/SequenceFileRecordReader.java
> Add counters for FileInputFormat (BYTES_READ) and FileOutputFormat
> (BYTES_WRITTEN)
> ----------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2365
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2365
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Owen O'Malley
> Assignee: Siddharth Seth
> Fix For: 0.20.203.0, 0.23.0
>
> Attachments: MR2365.patch
>
>
> MAP_INPUT_BYTES and MAP_OUTPUT_BYTES will be computed using the difference
> between FileSystem
> counters before and after each next(K,V) and collect/write op.
> In case compression is being used, these counters will represent the
> compressed data sizes. The uncompressed size will
> not be available.
> This is not a direct back-port of 5710. (Counters will be computed in MapTask
> instead of in individual RecordReaders).
> 0.20.100 ->
> New API -> MAP_INPUT_BYTES will be computed using this method
> Old API -> MAP_INPUT_BYTES will remain unchanged.
> 0.23 ->
> New API -> MAP_INPUT_BYTES will be computed using this method
> Old API -> MAP_INPUT_BYTES likely to use this method
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
