Re: [heka] Hinsight in pull mode

2016-09-21 Thread Michael Trinkala
Message are sent when the external source requests them (no cache in this plugin so it is just a live stream). From the external source perspective this is a pull. It could have simply been an HTTP request for the current circular buffer time series data which is what I believe you want for

Re: [heka] Lua coroutines: Does it scales?

2016-09-21 Thread Mathieu Parent
2016-09-21 16:01 GMT+02:00 Michael Trinkala : > It depends on the application but there can be benefits see (it has some > performance comparisons): http://www.lua.org/pil/9.4.html Thanks. This is what I need. -- Mathieu ___

Re: [heka] Hinsight in pull mode

2016-09-21 Thread Mathieu Parent
2016-09-21 15:57 GMT+02:00 Michael Trinkala : > We should probably be using the Hindsight list > https://mail.mozilla.org/listinfo/hindsight for this Didn't knew about this list. Subscribing... > but I will provide a > short answer here: Hindsight is agnostic when it comes

Re: [heka] Lua coroutines: Does it scales?

2016-09-21 Thread Michael Trinkala
It depends on the application but there can be benefits see (it has some performance comparisons): http://www.lua.org/pil/9.4.html Trink On Wed, Sep 21, 2016 at 1:20 AM, Mathieu Parent wrote: > Hi, > > I'm currently trying to write a "syslog tcp" input. I've read

Re: [heka] Hinsight in pull mode

2016-09-21 Thread Michael Trinkala
We should probably be using the Hindsight list https://mail.mozilla.org/ listinfo/hindsight for this but I will provide a short answer here: Hindsight is agnostic when it comes to push or pull in an I/O plugin. It is a function of the plugin and there are currently examples of both. However, as

Re: [heka] Hinsight in pull mode

2016-09-21 Thread Eric LEMOINE
On Wed, Sep 21, 2016 at 10:48 AM, Mathieu Parent wrote: > Hello (again), > > Hindsight is using a push-model (i.e Nagios passive checks). This is > great, but I want to plug it with Prometheus which uses pull-model > [1]. > > I see several ways to handle this: > - use the

[heka] Hinsight in pull mode

2016-09-21 Thread Mathieu Parent
Hello (again), Hindsight is using a push-model (i.e Nagios passive checks). This is great, but I want to plug it with Prometheus which uses pull-model [1]. I see several ways to handle this: - use the prometheus push-gateway [2]. This has several drawbacks listed below - introduce pull model in

[heka] Lua coroutines: Does it scales?

2016-09-21 Thread Mathieu Parent
Hi, I'm currently trying to write a "syslog tcp" input. I've read heka_tcp input as inspiration which uses coroutines. I'm wondering, given that "Only one coroutine ever runs at a time" [1], does it scales well? How are you handling this at Mozilla? Cheers, [1]