Statistics (records read by each mapper and reducer)

                 Key: PIG-626
             Project: Pig
          Issue Type: New Feature
          Components: impl
    Affects Versions: types_branch
            Reporter: Shubham Chopra
            Priority: Minor

This uses the counters framework that hadoop has. Initially, I am just 
interested in finding out the number of records read by each mapper/reducer 
particularly for the last job in any script. A sample code to access the 
statistics for the last job:

String reducePlan = 
        if(reducePlan == null) {
            System.out.println("Records written : " + 
        } else {
            System.out.println("Records written : " + 
The patch contains 7 test cases. These include tests PigStorage and BinStorage 
along with one for multiple MR jobs case.

This message is automatically generated by JIRA.
You can reply to this email to add a comment to the issue online.

Reply via email to