Raphael, Not sure if this is what you are after, but SPM <http://sematext.com/spm/> will collect and graph all Storm metrics, let you do alerting and anomaly detection on them, etc. If you want to graph custom metrics (e.g. something from your bolts), you can send them in as custom metrics <https://sematext.atlassian.net/wiki/display/PUBSPM/Custom+Metrics> and again graph them, alert on them, do anomaly detection on them, stick them on dashboards, etc. If you want to emit events from your bolts, you can send events to SPM <https://sematext.atlassian.net/wiki/display/PUBSPM/Events+Integration>, too, or you can send them to Logsene <http://www.sematext.com/logsene/>... can be handy for correlation with alerts and performance graphs when troubleshooting. Here are some Storm metrics graph: http://blog.sematext.com/2014/01/30/announcement-apache-storm-monitoring-in-spm/
I hope this helps. Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ On Fri, Sep 19, 2014 at 6:12 PM, Raphael Hsieh <[email protected]> wrote: > Hi, > Using Storm/Trident, how do I register a metrics consumer to log the data > I get in the StormUI ? > I want to look at historical data of my topology, for example the execute > latency of the topology over time, as this would give me good insight as to > where things might be going wrong when the system breaks. > > I have been following the steps outlined in the BigData CookBook here: > http://www.bigdata-cookbook.com/post/72320512609/storm-metrics-how-to > > However I am not wanting to create my own metrics, instead I just want to > log the metrics that already exist built in to Storm. It is unclear to me > how I am supposed to go about doing that. > > Thanks > > -- > Raphael Hsieh > > > >
