model,
> or the current one, with the existing data model.
>
> Best regards,
>
> Martijn
>
> [1] https://github.com/prometheus/client_java/releases/tag/parent-0.10.0
>
> On Fri, Jun 30, 2023 at 4:23 PM Ryan van Huuksloot
> wrote:
>
> > I'd have to check but the ori
Ryan van Huuksloot created FLINK-32508:
--
Summary: Flink-Metrics Prometheus - Native Histograms / Native
Counters
Key: FLINK-32508
URL: https://issues.apache.org/jira/browse/FLINK-32508
Project
ave to check but the original plan is to upgrade the client but keep
> the flink-metrics-prometheus implementation the same. This should keep the
> metrics collection consistent even with the client upgrade - this would
> need to be verified.
>
> But if that is the worry then we
I'd have to check but the original plan is to upgrade the client but keep
the flink-metrics-prometheus implementation the same. This should keep the
metrics collection consistent even with the client upgrade - this would
need to be verified.
But if that is the worry then we could create a new
29, 2023 at 5:56 PM Ryan van Huuksloot
> > wrote:
> >
> > > Hi Martijn,
> > >
> > > Our team shared the same concern. We've considered a few options:
> > >
> > >
> > > *1. Add a new package such as `flink-metrics-prometheus-native` and
>
> Our team shared the same concern. We've considered a few options:
> >
> >
> > *1. Add a new package such as `flink-metrics-prometheus-native` and
> > eventually deprecate the original.*
> > *Pros:*
> > - Supports backward compatibility.
> > *Cons:*
> &
it
with Flink 2.0 imho.
Best regards,
Martijn
On Thu, Jun 29, 2023 at 5:56 PM Ryan van Huuksloot
wrote:
> Hi Martijn,
>
> Our team shared the same concern. We've considered a few options:
>
>
> *1. Add a new package such as `flink-metrics-prometheus-native` and
> eventually d
Hi Martijn,
Our team shared the same concern. We've considered a few options:
*1. Add a new package such as `flink-metrics-prometheus-native` and
eventually deprecate the original.*
*Pros:*
- Supports backward compatibility.
*Cons:*
- Two packages to maintain in the interim.
- Not consistent
Hi Ryan,
I think there definitely is an interest in the
flink-metrics-prometheus, but I do see some challenges as well. Given
that the Prometheus simpleclient doesn't yet have a major version,
there are breaking changes happening in that. If we would update this,
it can/probably breaks
Following up, any interest in flink-metrics-prometheus? It is quite a stale
package. I would be interested in contributing - time permitting.
Ryan van Huuksloot
Sr. Production Engineer | Streaming Platform
[image: Shopify]
<https://www.shopify.com/?utm_medium=salessignatures_source=hs_em
Hello,
Internally we use the flink-metrics-prometheus jar and we noticed that the
code is a little out of date. Primarily, there are new metric types in
Prometheus that would allow for the exporter to write Counters and
Histograms as Native metrics in prometheus (vs writing as Gauges).
I noticed
钟洋洋 created FLINK-29970:
---
Summary: Prometheus cannot collect flink metrics
Key: FLINK-29970
URL: https://issues.apache.org/jira/browse/FLINK-29970
Project: Flink
Issue Type: Bug
Components
From: "Oliveira, Joao / Kuehne + Nagel / Opo MI-DH"
Date: Wednesday, 3 August 2022 at 09:54
To: "u...@flink.apache.org"
Cc: "Melo, Jose / Kuehne + Nagel / Opo MI-DH"
Subject: 1.13.2 - Flink Metrics not updated during job execution
Hi Flink team,
My nam
Gyula Fora created FLINK-27914:
--
Summary: Integrate JOSDK metrics with Flink Metrics reporter
Key: FLINK-27914
URL: https://issues.apache.org/jira/browse/FLINK-27914
Project: Flink
Issue Type
jiangchunyang created FLINK-27661:
-
Summary: [Metric]Flink-Metrics pushgateway support authentication
Key: FLINK-27661
URL: https://issues.apache.org/jira/browse/FLINK-27661
Project: Flink
hao wang created FLINK-27163:
Summary: Fix typo issue in Flink Metrics documentation
Key: FLINK-27163
URL: https://issues.apache.org/jira/browse/FLINK-27163
Project: Flink
Issue Type: Bug
Chesnay Schepler created FLINK-26230:
Summary: [JUnit5 Migration] Module: flink-metrics-core
Key: FLINK-26230
URL: https://issues.apache.org/jira/browse/FLINK-26230
Project: Flink
Issue
Chesnay Schepler created FLINK-26229:
Summary: [JUnit5 Migration] Module: flink-metrics-datadog
Key: FLINK-26229
URL: https://issues.apache.org/jira/browse/FLINK-26229
Project: Flink
Chesnay Schepler created FLINK-26228:
Summary: [JUnit5 Migration] Module: flink-metrics-dropwizard
Key: FLINK-26228
URL: https://issues.apache.org/jira/browse/FLINK-26228
Project: Flink
Chesnay Schepler created FLINK-26227:
Summary: [JUnit5 Migration] Module: flink-metrics-graphite
Key: FLINK-26227
URL: https://issues.apache.org/jira/browse/FLINK-26227
Project: Flink
Chesnay Schepler created FLINK-26226:
Summary: [JUnit5 Migration] Module: flink-metrics-influxdb
Key: FLINK-26226
URL: https://issues.apache.org/jira/browse/FLINK-26226
Project: Flink
Chesnay Schepler created FLINK-26225:
Summary: [JUnit5 Migration] Module: flink-metrics-jmx
Key: FLINK-26225
URL: https://issues.apache.org/jira/browse/FLINK-26225
Project: Flink
Issue
Chesnay Schepler created FLINK-26221:
Summary: [JUnit5 Migration] Module: flink-metrics-prometheus
Key: FLINK-26221
URL: https://issues.apache.org/jira/browse/FLINK-26221
Project: Flink
Chesnay Schepler created FLINK-26219:
Summary: [JUnit5 Migration] Module: flink-metrics-slf4j
Key: FLINK-26219
URL: https://issues.apache.org/jira/browse/FLINK-26219
Project: Flink
Issue
Chesnay Schepler created FLINK-26215:
Summary: [JUnit5 Migration] Module: flink-metrics-statsd
Key: FLINK-26215
URL: https://issues.apache.org/jira/browse/FLINK-26215
Project: Flink
Yun Gao created FLINK-24896:
---
Summary: Failed to execute goal
com.github.siom79.japicmp:japicmp-maven-plugin:0.11.0:cmp (default) on project
flink-metrics-core
Key: FLINK-24896
URL: https://issues.apache.org/jira
Alok Singh created FLINK-24514:
--
Summary: Incorrect Flink Metrics on Job-Internal-Restart:
Key: FLINK-24514
URL: https://issues.apache.org/jira/browse/FLINK-24514
Project: Flink
Issue Type: Bug
Chesnay Schepler created FLINK-21773:
Summary: Remove dependency from flink-metrics-statsd
Key: FLINK-21773
URL: https://issues.apache.org/jira/browse/FLINK-21773
Project: Flink
Issue
Chesnay Schepler created FLINK-21772:
Summary: Remove dependency from flink-metrics-slf4j
Key: FLINK-21772
URL: https://issues.apache.org/jira/browse/FLINK-21772
Project: Flink
Issue
Chesnay Schepler created FLINK-21761:
Summary: Remove dependency from flink-metrics-influxdb
Key: FLINK-21761
URL: https://issues.apache.org/jira/browse/FLINK-21761
Project: Flink
Issue
Chesnay Schepler created FLINK-21762:
Summary: Remove dependency from flink-metrics-prometheus
Key: FLINK-21762
URL: https://issues.apache.org/jira/browse/FLINK-21762
Project: Flink
Chesnay Schepler created FLINK-21760:
Summary: Remove dependency from flink-metrics-jmx
Key: FLINK-21760
URL: https://issues.apache.org/jira/browse/FLINK-21760
Project: Flink
Issue Type
zhangyunyun created FLINK-18573:
---
Summary: plugins/metrics-influx/flink-metrics-influxdb-1.11.0.jar
META-INF has no dir named "services" , but "service"
Key: FLINK-18573
URL: https://issues.ap
Tammy zhang created FLINK-17556:
---
Summary: FATAL: Thread
'flink-metrics-akka.remote.default-remote-dispatcher-3' produced an uncaught
exception. Stopping the process... java.lang.OutOfMemoryError: Direct buffer
memory
Key: FLINK
Till Rohrmann created FLINK-16635:
-
Summary: Incompatible okio dependency in flink-metrics-influxdb
module
Key: FLINK-16635
URL: https://issues.apache.org/jira/browse/FLINK-16635
Project: Flink
static-max created FLINK-15832:
--
Summary: Artifact flink-metrics-core-tests will be uploaded twice
Key: FLINK-15832
URL: https://issues.apache.org/jira/browse/FLINK-15832
Project: Flink
Issue
Forward Xu created FLINK-15356:
--
Summary: Add applicationId to existing flink metrics running on
yarn
Key: FLINK-15356
URL: https://issues.apache.org/jira/browse/FLINK-15356
Project: Flink
ouyangwulin created FLINK-14831:
---
Summary: When edit flink-metrics-influxdb, need add metrics.md by
hand
Key: FLINK-14831
URL: https://issues.apache.org/jira/browse/FLINK-14831
Project: Flink
Hello,
I have been working on a flink project and need some help with the metric
system.
I have a logic inside a process function which side outputs a particular
message on certain failure parameters.
This process function has a parallelism > 1. How do I keep track of the
failed messages
Armstrong Nova created FLINK-12423:
--
Summary: Add Timer metric type for flink-metrics module
Key: FLINK-12423
URL: https://issues.apache.org/jira/browse/FLINK-12423
Project: Flink
Issue
Fan weiwen created FLINK-11174:
--
Summary: flink Metrics Prometheus labels support chinese
Key: FLINK-11174
URL: https://issues.apache.org/jira/browse/FLINK-11174
Project: Flink
Issue Type
Till Rohrmann created FLINK-11014:
-
Summary: Relocate flink-metrics-graphite's dropwizard dependencies
Key: FLINK-11014
URL: https://issues.apache.org/jira/browse/FLINK-11014
Project: Flink
Chesnay Schepler created FLINK-10998:
Summary: flink-metrics-ganglia has LGPL dependency
Key: FLINK-10998
URL: https://issues.apache.org/jira/browse/FLINK-10998
Project: Flink
Issue Type
Seth Wiesman created FLINK-10423:
Summary: Forward RocksDB memory metrics to Flink metrics reporter
Key: FLINK-10423
URL: https://issues.apache.org/jira/browse/FLINK-10423
Project: Flink
vinoyang created FLINK-10221:
Summary: Flink metrics documentation io section table layout error
Key: FLINK-10221
URL: https://issues.apache.org/jira/browse/FLINK-10221
Project: Flink
Issue Type
Nico Kruber created FLINK-10035:
---
Summary: ConcurrentModificationException with flink-metrics-slf4j
Key: FLINK-10035
URL: https://issues.apache.org/jira/browse/FLINK-10035
Project: Flink
Issue
Bowen Li created FLINK-8553:
---
Summary: switch flink-metrics-datadog to async mode
Key: FLINK-8553
URL: https://issues.apache.org/jira/browse/FLINK-8553
Project: Flink
Issue Type: Improvement
Colin Williams created FLINK-7907:
-
Summary: Flink Metrics documentation missing Scala examples
Key: FLINK-7907
URL: https://issues.apache.org/jira/browse/FLINK-7907
Project: Flink
Issue
t;>> [2].
>>>
>>> To monitor the same metrics from Prometheus, I would like to use labels
>>> to differentiate them.
>>> Under the job/task/operator scope, it words fine to me. However, its not
>>> convenient to me to monitor partitions' states from Kak
like current commit offset will be a unique metric in Prometheus.
It's hard to use visualization tool such as Grafana to monitor them.
My question is: Is it possible to add tags on Metric, instead of using
`.addGroup()`?
If not, will it be a new feature on Flink Metrics in the future? Since I
am not su
or them.
>
> My question is: Is it possible to add tags on Metric, instead of using
> `.addGroup()`?
> If not, will it be a new feature on Flink Metrics in the future? Since I
> am not sure about how other reporters work, I am afraid that it is not a
> good design to just fulfill the
l partition states
> like current commit offset will be a unique metric in Prometheus. It's hard
> to use visualization tool such as Grafana to monitor them.
>
> My question is: Is it possible to add tags on Metric, instead of using
> `.addGroup()`?
> If not, will it be a new feature on F
will be a unique metric in Prometheus.
It's hard to use visualization tool such as Grafana to monitor them.
My question is: Is it possible to add tags on Metric, instead of using
`.addGroup()`?
If not, will it be a new feature on Flink Metrics in the future? Since I am
not sure about how other reporters work, I
Chesnay Schepler created FLINK-6431:
---
Summary: Activate strict checkstyle for flink-metrics
Key: FLINK-6431
URL: https://issues.apache.org/jira/browse/FLINK-6431
Project: Flink
Issue Type
ache.org
> *Sent:* Monday, October 17, 2016 12:52 AM
> *Subject:* Re: Flink Metrics
>
> Hi Govind,
>
> I think the DropwizardMeterWrapper implementation is just a reference
> implementation where it was decided to report the minute rate. You can
> define your own
ubject: Re: Flink Metrics
Hi Govind,
I think the DropwizardMeterWrapper implementation is just a reference
implementation where it was decided to report the minute rate. You can
define your own meter class which allows to configure the rate interval
accordingly.
Concerning Timers, I think nobody
nstrumenting my pipeline with
> flink metrics. One small suggestion I have is currently the Meter interface
> only supports getRate() which is always the one minute rate.
>
> It would great if all the rates (1 min, 5 min & 15 min) are exposed to get
> a better picture in terms of
Hi,
I am currently using flink 1.2 snapshot and instrumenting my pipeline with
flink metrics. One small suggestion I have is currently the Meter interface
only supports getRate() which is always the one minute rate.
It would great if all the rates (1 min, 5 min & 15 min) are exposed to
Robert Metzger created FLINK-4186:
-
Summary: Expose Kafka metrics through Flink metrics
Key: FLINK-4186
URL: https://issues.apache.org/jira/browse/FLINK-4186
Project: Flink
Issue Type
Till Rohrmann created FLINK-4173:
Summary: Replace maven-assembly-plugin by maven-shade-plugin in
flink-metrics
Key: FLINK-4173
URL: https://issues.apache.org/jira/browse/FLINK-4173
Project: Flink
60 matches
Mail list logo
