[ 
https://issues.apache.org/jira/browse/FLINK-8162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Cristian updated FLINK-8162:
----------------------------
    Description: 
When reading from Kinesis streams, one of the most valuable metrics is 
"MillisBehindLatest" (see 
https://github.com/aws/aws-sdk-java/blob/25f0821f69bf94ec456f602f2b83ea2b0ca15643/aws-java-sdk-kinesis/src/main/java/com/amazonaws/services/kinesis/model/GetRecordsResult.java#L187-L201).

Flink should use its metrics mechanism to report this value as a gauge, tagging 
it with the shard id.

  was:
When reading from Kinesis streams, one of the most valuable metrics is 
"MillisBehindLatest" 
([see](https://github.com/aws/aws-sdk-java/blob/25f0821f69bf94ec456f602f2b83ea2b0ca15643/aws-java-sdk-kinesis/src/main/java/com/amazonaws/services/kinesis/model/GetRecordsResult.java#L187-L201)).

Flink should use its metrics mechanism to report this value as a gauge, tagging 
it with the shard id.


> Kinesis Connector to report millisBehindLatest metric
> -----------------------------------------------------
>
>                 Key: FLINK-8162
>                 URL: https://issues.apache.org/jira/browse/FLINK-8162
>             Project: Flink
>          Issue Type: Improvement
>          Components: Kinesis Connector
>            Reporter: Cristian
>            Priority: Minor
>              Labels: kinesis
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> When reading from Kinesis streams, one of the most valuable metrics is 
> "MillisBehindLatest" (see 
> https://github.com/aws/aws-sdk-java/blob/25f0821f69bf94ec456f602f2b83ea2b0ca15643/aws-java-sdk-kinesis/src/main/java/com/amazonaws/services/kinesis/model/GetRecordsResult.java#L187-L201).
> Flink should use its metrics mechanism to report this value as a gauge, 
> tagging it with the shard id.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to