Support for metrics aggregation module in JobTracker
----------------------------------------------------

                 Key: HADOOP-1918
                 URL: https://issues.apache.org/jira/browse/HADOOP-1918
             Project: Hadoop
          Issue Type: New Feature
          Components: mapred
            Reporter: Senthil Subramanian


JobTracker should support starting up and shutting down a generic metrics 
aggregation module. We are currently thinking about plugging in a module that 
gets time series data from the task trackers, aggregates it and log this data 
into a global DFS so that it is analysed later (even after the map reduce 
cluster is shutdown). Some of this data can also be plotted on the JobTracker 
UI in realtime. This is particulary useful for analyzing data from dynamic 
mapreduce cluster like the ones deployed using HOD.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

Reply via email to