[ 
https://issues.apache.org/jira/browse/FLINK-7689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Martin Eden updated FLINK-7689:
-------------------------------
    Description: 
As confirmed by the Flink community in the following mailing list 
[message|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/metrics-for-Flink-sinks-td15200.html]
  using off the shelf Flink sinks like the JDBC sink, Redis sink or Cassandra 
sink etc does not expose any sink specific metrics.

The purpose of this ticket is to add some relevant metrics to the 
JDBCOutputFormat:
- Meters for when a flush is made.
- Histograms for the jdbc batch count and batch execution latency.

These would allow deeper understanding of the runtime behaviour of performance 
critical jobs writing to external databases using this generic interface.


  was:
As confirmed by the Flink community in the following mailing list 
[message|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/metrics-for-Flink-sinks-td15200.html]
  using off the shelf Flink sinks like the JDBC sink, Redis sink or Cassandra 
sink etc does not expose any sink specific metrics.

The purpose of this ticket is to add some relevant metrics to the 
JDBCSinkFunction and JDBCOutputFormat:
- Meters for when a flush is made or snapshot state is called.
- Histograms for the jdbc batch count and batch execution latency.

These would allow deeper understanding of the runtime behaviour of performance 
critical jobs writing to external databases using this generic interface.



> Instrument the Flink JDBC sink
> ------------------------------
>
>                 Key: FLINK-7689
>                 URL: https://issues.apache.org/jira/browse/FLINK-7689
>             Project: Flink
>          Issue Type: Improvement
>          Components: Streaming Connectors
>    Affects Versions: 1.4.0
>            Reporter: Martin Eden
>            Priority: Minor
>              Labels: jdbc, metrics
>             Fix For: 1.4.0
>
>   Original Estimate: 24h
>  Remaining Estimate: 24h
>
> As confirmed by the Flink community in the following mailing list 
> [message|http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/metrics-for-Flink-sinks-td15200.html]
>   using off the shelf Flink sinks like the JDBC sink, Redis sink or Cassandra 
> sink etc does not expose any sink specific metrics.
> The purpose of this ticket is to add some relevant metrics to the 
> JDBCOutputFormat:
> - Meters for when a flush is made.
> - Histograms for the jdbc batch count and batch execution latency.
> These would allow deeper understanding of the runtime behaviour of 
> performance critical jobs writing to external databases using this generic 
> interface.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to