We should probably be using the Hindsight list https://mail.mozilla.org/ listinfo/hindsight for this but I will provide a short answer here: Hindsight is agnostic when it comes to push or pull in an I/O plugin. It is a function of the plugin and there are currently examples of both. However, as Eric commented there is no HTTP server implementation available in a sandbox yet (although there are a few options). See https://github.com/mozilla-services/lua_sandbox_ extensions/blob/master/socket/sandboxes/heka/output/heka_tcp_matcher.lua for an example of a TCP subscription based output plugin.
Trink On Wed, Sep 21, 2016 at 2:28 AM, Eric LEMOINE <[email protected]> wrote: > On Wed, Sep 21, 2016 at 10:48 AM, Mathieu Parent <[email protected]> > wrote: > > Hello (again), > > > > Hindsight is using a push-model (i.e Nagios passive checks). This is > > great, but I want to plug it with Prometheus which uses pull-model > > [1]. > > > > I see several ways to handle this: > > - use the prometheus push-gateway [2]. This has several drawbacks listed > below > > - introduce pull model in hindsight > > - add a new daemon, based on lua_sandbox too, but using pull model > > > > The drawbacks of prometheus push-gateway are: > > - Unnecessary polling of data (data is grabbed even if not pulled by > prometheus > > - time lag, between data grabbing and data pulling > > - To sum up : to reduce time lag, you increase polling rate, when us > > decrease polling, you increase time lag. > > > > The push model may work like this: > > > You mean "pull" here I guess. > > > > - Adding pull_message_matcher config to inputs (defaults to FALSE) > > - Adding process_pull_message() function to inputs, returning a table > > of messages (or should it be inject_pull_message() + return 0?) > > - Adding request_pull_message() function to outputs, which maps to > > matching process_pull_message() and concatenates the results in a > > table. This function is blocking. > > > > Opinions? > > If there was an "http listen" extension in lua_sandbox_extensions then > I think it would be easy to write an output plugin compatible with > Prometheus, without specific support for pull in Hindsight. The > problem is that there's "http listen" extension in > lua_sandbox_extensions right now, see [*] for a bit more information > on this. > > [*] <https://mail.mozilla.org/pipermail/heka/2016-September/001107.html> > _______________________________________________ > Heka mailing list > [email protected] > https://mail.mozilla.org/listinfo/heka >
_______________________________________________ Heka mailing list [email protected] https://mail.mozilla.org/listinfo/heka
