Re: Metrics: (1) Histogram in prometheus and (2) meter by event_time

Hello Kostas, Thank you very much for the details. Also thanks for that "feel free to disagree" (however, I don't have any desire to disagree here :) thanks a lot) Regarding that mainStream.windowAll, did you mean that checkpointing of the two branches (the main one and the monitoring one) will b

Re: Metrics: (1) Histogram in prometheus and (2) meter by event_time

Hi Averell, > On Sep 27, 2018, at 3:09 PM, Averell wrote: > > Hi Kostas, > > Yes, I want them as metrics, as they are purely for monitoring purpose. > There's no need of fault tolerance. > > If I use side-output, for example for that metric no.1, I would need a > tumbling AllWindowFunction, wh

Re: Metrics: (1) Histogram in prometheus and (2) meter by event_time

Hi Kostas, Yes, I want them as metrics, as they are purely for monitoring purpose. There's no need of fault tolerance. If I use side-output, for example for that metric no.1, I would need a tumbling AllWindowFunction, which, as I understand, would introduce some delay to both the normal processin

Re: Metrics: (1) Histogram in prometheus and (2) meter by event_time

Hi Averell, From what I understand for your use case, it is possible to do what you want with Flink. If you are implementing a function, then you have access to the metric system through the runtime context (see [1] for more information). Some things to take into consideration: 1) Metrics are

Metrics: (1) Histogram in prometheus and (2) meter by event_time

Good day everyone, I have a stream with two timestamps (ts1 and ts2) inside each record. My event time is ts1. This ts1 has value truncated to a quarter (like 23:30, 23:45, 00:00,...) I want to report two metrics: 1. A meter which counts number of records per value of ts1. (fig.1)