Ben Marini created FLINK-12103:
----------------------------------
Summary: Extend builtin operator metrics with user defined scope
and variables
Key: FLINK-12103
URL: https://issues.apache.org/jira/browse/FLINK-12103
Project: Flink
Issue Type: Wish
Components: Runtime / Metrics
Affects Versions: 1.7.2
Reporter: Ben Marini
I'm looking for a way to extend the builtin throughput and latency metrics for
operators with my own metric variables.
My specific use case:
I have a job that defines a list of independent source -> sink streams. I would
like to add my own metric variables to each of these independent streams. For
example, something like this:
{code:scala}
class MyFilter extends RichFilterFunction {
override def open(parameters: Configuration): Unit = {
val mg = getRuntimeContext.getMetricGroup // Includes "streamName" -> "A|B"
// Init some user defined metrics here...
}
}
// Stream A
// Native operator metrics and user defined metrics in rich operators include
"streamName" -> "A"
streamA = env.withMetricGroup((mg) => mg.addGroup("streamName",
"A").addSource(...).filter(new MyFilter).addSink(...)
// Stream B
// Native operator metrics and user defined metrics in rich operators include
"streamName" -> "B"
streamB = env.withMetricGroup((mg) => mg.addGroup("streamName",
"B").addSource(...).filter(new MyFilter).addSink(...)
{code}
Is this possible? Would a new hook into StreamTransformation have to be added?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
