Hi, is there any possibility to dump all MR counters to console when pig script is finished? I also work with Scalding, they have cool feature. You can implement flow listener (flow ifs a kind of Pig execution DAG). And listen to "flow finished" event. Then you can get access to FlowStats object and get all counters from all stages. Counters with the same names will be merged (input records, output records and other default MR counters), but I don't care, I need to get all my user-defined counters. They have unique names.
Is it possible to find something similar in pig? I don't want to iterate over 100500 jobs on my JobHistory server. :)