Hi Gezim, On Fri, Sep 19, 2014 at 7:27 PM, Gezim Musliaj <gmusl...@gmail.com> wrote:
> Hey Otis, I was just registered at sematext and I can say that this is > what I have been looking for.I have just one question, what about the > delays between the SPM and the Storm Cluster (if they do exist), whats the > worst case? I mean because these metrics are not calculated locally, but > using an internet connection. > The worst case is that somebody unplugs your servers from the network, but if that happens you have bigger problems to deal with. In all seriousness, Storm (local) => SPM (remote/cloud/saas) is not really a problem -- lots of people successfully use SPM for monitoring Storm, Hadoop, Kafka, and other types of systems. Otis -- Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr & Elasticsearch Support * http://sematext.com/ > Thanks ! > > On Sat, Sep 20, 2014 at 1:15 AM, Otis Gospodnetic < > otis.gospodne...@gmail.com> wrote: > >> Raphael, >> >> Not sure if this is what you are after, but SPM >> <http://sematext.com/spm/> will collect and graph all Storm metrics, let >> you do alerting and anomaly detection on them, etc. If you want to graph >> custom metrics (e.g. something from your bolts), you can send them in as >> custom >> metrics >> <https://sematext.atlassian.net/wiki/display/PUBSPM/Custom+Metrics> and >> again graph them, alert on them, do anomaly detection on them, stick them >> on dashboards, etc. If you want to emit events from your bolts, you can send >> events to SPM >> <https://sematext.atlassian.net/wiki/display/PUBSPM/Events+Integration>, >> too, or you can send them to Logsene <http://www.sematext.com/logsene/>... >> can be handy for correlation with alerts and performance graphs when >> troubleshooting. Here are some Storm metrics graph: >> http://blog.sematext.com/2014/01/30/announcement-apache-storm-monitoring-in-spm/ >> >> >> I hope this helps. >> >> Otis >> -- >> Monitoring * Alerting * Anomaly Detection * Centralized Log Management >> Solr & Elasticsearch Support * http://sematext.com/ >> >> >> On Fri, Sep 19, 2014 at 6:12 PM, Raphael Hsieh <raffihs...@gmail.com> >> wrote: >> >>> Hi, >>> Using Storm/Trident, how do I register a metrics consumer to log the >>> data I get in the StormUI ? >>> I want to look at historical data of my topology, for example the >>> execute latency of the topology over time, as this would give me good >>> insight as to where things might be going wrong when the system breaks. >>> >>> I have been following the steps outlined in the BigData CookBook here: >>> http://www.bigdata-cookbook.com/post/72320512609/storm-metrics-how-to >>> >>> However I am not wanting to create my own metrics, instead I just want >>> to log the metrics that already exist built in to Storm. It is unclear to >>> me how I am supposed to go about doing that. >>> >>> Thanks >>> >>> -- >>> Raphael Hsieh >>> >>> >>> >>> >> >> >
