Re: Flink Metrics - PrometheusReporter
Ok, I configured the PrometheusReporter's ports to be a range and now every TaskManager has it's own port where I can see it's metrics. Thank you very much! Sidney Feiner / Data Platform Developer M: +972.528197720 / Skype: sidney.feiner.startapp [emailsignature] From: Chesnay Schepler Sent: Wednesday, January 22, 2020 6:07 PM To: Sidney Feiner ; flink-u...@apache.org Subject: Re: Flink Metrics - PrometheusReporter Metrics are exposed via reporters by each process separately, whereas the WebUI aggregates metrics. As such you have to configure Prometheus to also scrape the TaskExecutors. On 22/01/2020 16:58, Sidney Feiner wrote: Hey, I've been trying to use the PrometheusReporter and when I used in locally on my computer, I would access the port I configured and see all the metrics I've created. In production, we use High Availability mode and when I try to access the JobManager's metrics in the port I've configured on the PrometheusReporter, I see some very basic metrics - default Flink metrics, but I can't see any of my custom metrics. Weird thing is I can see those metrics through Flink's UI in the Metrics tab: [cid:part1.8D6219CF.AA6B4229@apache.org] Does anybody have a clue why my custom metrics are configured but not being reported in high availability but are reported when I run the job locally though IntelliJ? Thanks Sidney Feiner / Data Platform Developer M: +972.528197720 / Skype: sidney.feiner.startapp [emailsignature]
Re: Flink Metrics - PrometheusReporter
Metrics are exposed via reporters by each process separately, whereas the WebUI aggregates metrics. As such you have to configure Prometheus to also scrape the TaskExecutors. On 22/01/2020 16:58, Sidney Feiner wrote: Hey, I've been trying to use the PrometheusReporter and when I used in locally on my computer, I would access the port I configured and see all the metrics I've created. In production, we use High Availability mode and when I try to access the JobManager's metrics in the port I've configured on the PrometheusReporter, I see some very basic metrics - default Flink metrics, but I can't see any of my custom metrics. Weird thing is I can see those metrics through Flink's UI in the Metrics tab: Does anybody have a clue why my custom metrics are configured but not being reported in high availability but are reported when I run the job locally though IntelliJ? Thanks *Sidney Feiner**/*Data Platform Developer M: +972.528197720 */*Skype: sidney.feiner.startapp emailsignature
Flink Metrics - PrometheusReporter
Hey, I've been trying to use the PrometheusReporter and when I used in locally on my computer, I would access the port I configured and see all the metrics I've created. In production, we use High Availability mode and when I try to access the JobManager's metrics in the port I've configured on the PrometheusReporter, I see some very basic metrics - default Flink metrics, but I can't see any of my custom metrics. Weird thing is I can see those metrics through Flink's UI in the Metrics tab: [cid:dc6050e2-a947-4856-8339-5daea66b6a77] Does anybody have a clue why my custom metrics are configured but not being reported in high availability but are reported when I run the job locally though IntelliJ? Thanks Sidney Feiner / Data Platform Developer M: +972.528197720 / Skype: sidney.feiner.startapp [emailsignature]