Hi, I'm working on a project that leverages both collectd and Heka. For reference, the project is called Logging, Monitoring and Alerting collector [1] and is related to the monitoring of OpenStack clouds. In a nutshell, we use collectd for getting metrics (including application metrics thanks to the Python plugin) and Heka for streaming logs and reading messages from RabbitMQ. Since Heka is the central piece in our design, we ship collectd data to Heka over HTTP using the JSON protocol [2] + HTTPListenInput plugin [3] on the Heka side. We wrote a very simple Lua decoder [4] for parsing the collectd data. Although the code is specific to our project, it might help you. Eventually I'd like to try using the collectd network plugin [5]: that should be more efficient since it works over UDP. But it would imply to write a custom decoder that understands the collectd wire format. HTH, Simon
[1] https://github.com/stackforge/fuel-plugin-lma-collector [2] https://collectd.org/wiki/index.php/Plugin:Write_HTTP [3] http://hekad.readthedocs.org/en/latest/config/inputs/httplisten.html [4] https://github.com/stackforge/fuel-plugin-lma-collector/blob/master/deployment_scripts/puppet/modules/lma_collector/files/plugins/decoders/collectd.lua [5] https://collectd.org/wiki/index.php/Plugin:Network On Thu, Mar 26, 2015 at 3:37 AM, Sean Bigdatafun <[email protected]> wrote: > I buy the idea that "one agent fits all" could have a huge benefit. > > But given that agents like CollectD has a long history and therefore a > large out-of-box functionality set, how can Heka catch up? Most of the > users (like me) just want to enjoy the out-of-box experience. I may want to > write my specific plug-ins, but not whole lot. Any comment on this? > > Also, the same question goes to Logstash-forwarder replacement. > > > > Thanks, > --Sean > > > _______________________________________________ > Heka mailing list > [email protected] > https://mail.mozilla.org/listinfo/heka > >
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
