Re: Flink metrics missing from UI 1.7.2

2019-03-23 Thread Padarn Wilson
Aha! This is almost certainly it. I remembered thinking something like this might be a problem. I'll need to change the deployment a bit to add this (not straightforward to edit the YAML in my case, but thanks! On Sun, Mar 24, 2019 at 10:01 AM dawid <

Re: Flink metrics missing from UI 1.7.2

2019-03-23 Thread dawid
Padarn Wilson-2 wrote > I am running Fink 1.7.2 on Kubernetes in a setup with task manager and job > manager separate. > > I'm having trouble seeing the metrics from my Flink job in the UI > dashboard. Actually I'm using the Datadog reporter to expose most of my > metrics, but latency tracking

Re: Flink metrics missing from UI 1.7.2

2019-03-23 Thread Padarn Wilson
Thanks David. I cannot see the metrics there, so let me play around a bit more and make sure they are enabled correctly. On Sat, Mar 23, 2019 at 9:19 PM David Anderson wrote: > > I have done this (actually I do it in my flink-conf.yaml), but I am not > seeing any metrics at all in the Flink UI,

Re: Flink metrics missing from UI 1.7.2

2019-03-23 Thread David Anderson
> I have done this (actually I do it in my flink-conf.yaml), but I am not seeing any metrics at all in the Flink UI, > let alone the latency tracking. The latency tracking itself does not seem to be exported to datadog (should it be?) The latency metrics are job metrics, and are not shown in the

Re: Flink metrics missing from UI 1.7.2

2019-03-23 Thread David Anderson
Because latency tracking is expensive, it is turned off by default. You turn it on by setting the interval; that looks something like this: env.getConfig().setLatencyTrackingInterval(1000); The full set of configuration options is described in the docs:

Flink metrics missing from UI 1.7.2

2019-03-23 Thread Padarn Wilson
Hi User, I am running Fink 1.7.2 on Kubernetes in a setup with task manager and job manager separate. I'm having trouble seeing the metrics from my Flink job in the UI dashboard. Actually I'm using the Datadog reporter to expose most of my metrics, but latency tracking does not seem to be