[ 
https://issues.apache.org/jira/browse/FLINK-4840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

zhuhaifeng updated FLINK-4840:
------------------------------
    Description: 
We should expose the following Metrics on the OperatorIOMetricGroup:
 1. latency(ms): record processing time as a histogram metric.
 2. procTimeCostPerSecond(ms): record processing time accumulated per second, 
it measure record processing percentage to check if it's a main time costing
 3. delay(ms): the time between upstream emit record and downstream start 
record processing 

  was:
There will introduces the OperatorSystemMetricGroup, which encapsulates the 
insantiation of TPS meter, lantency/proc_time_cost histograms. 
Operator related System metrics are not instantiated directly by the specific 
Operator, but instead within the OperatorSystemMetricGroup contained in the 
respective OperatorMetricGroup. They are then later accessed by relevant 
components(maybe different places), instead of instantiated them identically 
with static name constants. Other system scope metrics (maybe 
delay/queue_in/queue_out) can add into the OperatorSystemMetricGroup some later.

TPS: collect records per second(StreamSource), processed elements per 
second(other operator)
lantency/proc_time_cost : collect an record time cost(StreamSource), processed 
an element time cost (other operator)


> Measure latency/delay of record processing and expose it as a metric
> --------------------------------------------------------------------
>
>                 Key: FLINK-4840
>                 URL: https://issues.apache.org/jira/browse/FLINK-4840
>             Project: Flink
>          Issue Type: Improvement
>          Components: Metrics
>            Reporter: zhuhaifeng
>            Assignee: zhuhaifeng
>            Priority: Minor
>             Fix For: 1.2.0
>
>
> We should expose the following Metrics on the OperatorIOMetricGroup:
>  1. latency(ms): record processing time as a histogram metric.
>  2. procTimeCostPerSecond(ms): record processing time accumulated per second, 
> it measure record processing percentage to check if it's a main time costing
>  3. delay(ms): the time between upstream emit record and downstream start 
> record processing 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to