Re: Flink Sinks

2020-07-18 Thread David Anderson
Prasanna, The Flink project does not have an SQS connector, and a quick google search hasn't found one. Nor does Flink have an HTTP sink, but with a bit of googling you can find that various folks have implemented this themselves. As for implementing SQS as a custom sink, if you need exactly

Flink Sinks

2020-07-17 Thread Prasanna kumar
Hi , I did not find out of box flink sink connector for http and SQS mechanism. Has anyone implemented it? Wanted to know if we are writing a custom sink function , whether it would affect semantic exactly one guarantees ? Thanks , Prasanna

Re: metrics for Flink sinks

2017-08-30 Thread Elias Levy
> >> Just 3 quick questions both related to Flink metrics, especially around >> sinks: >> >> 1. In the Flink UI Sources always have 0 input records / bytes and Sinks >> always have 0 output records / bytes? Why is it like that? >> >> 2. What is t

Re: metrics for Flink sinks

2017-08-30 Thread Martin Eden
e 0 input records / bytes and Sinks > always have 0 output records / bytes? Why is it like that? > > 2. What is the best practice for instrumenting off the shelf Flink sinks? > > Currently the only metrics available are num records/bytes in and out at > the operator and task

Re: metrics for Flink sinks

2017-08-29 Thread Chesnay Schepler
always have 0 output records / bytes? Why is it like that? 2. What is the best practice for instrumenting off the shelf Flink sinks? Currently the only metrics available are num records/bytes in and out at the operator and task scope. For the task scope there are extra buffer metrics. However

metrics for Flink sinks

2017-08-28 Thread Martin Eden
Hi all, Just 3 quick questions both related to Flink metrics, especially around sinks: 1. In the Flink UI Sources always have 0 input records / bytes and Sinks always have 0 output records / bytes? Why is it like that? 2. What is the best practice for instrumenting off the shelf Flink sinks