Re: Kafka Sink Kafka Producer metrics?

[Andrew Otto]

Wow, not sure how I missed that.  Thank you.



On Mon, Feb 6, 2023 at 9:22 PM Mason Chen  wrote:

> Hi Andrew,
>
> I misread the docs: `register.producer.metrics` is mentioned here, but it
> is not on by default.
> https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kafka/#kafka-connector-metrics
>
> Best,
> Mason
>
> On Mon, Feb 6, 2023 at 6:19 PM Mason Chen  wrote:
>
>> Hi Andrew,
>>
>> Unfortunately, the functionality is undocumented, but you can set the
>> property `register.producer.metrics` to true in your Kafka client
>> properties map. This is a JIRA to document the feature:
>> https://issues.apache.org/jira/browse/FLINK-30932
>>
>> Best,
>> Mason
>>
>> On Mon, Feb 6, 2023 at 11:49 AM Andrew Otto  wrote:
>>
>>> Hi!
>>>
>>> Kafka Source will emit KafkaConsumer metrics
>>> 
>>> .
>>>
>>> It looks like Kafka Sink
>>> 
>>> does not emit KafkaProducer metrics
>>> .  Is this
>>> correct?  If so, why not?
>>>
>>> Thanks,
>>> -Andrew Otto
>>>  Wikimedia Foundation
>>>
>>

Re: Kafka Sink Kafka Producer metrics?

[Mason Chen]

Hi Andrew,

I misread the docs: `register.producer.metrics` is mentioned here, but it
is not on by default.
https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kafka/#kafka-connector-metrics

Best,
Mason

On Mon, Feb 6, 2023 at 6:19 PM Mason Chen  wrote:

> Hi Andrew,
>
> Unfortunately, the functionality is undocumented, but you can set the
> property `register.producer.metrics` to true in your Kafka client
> properties map. This is a JIRA to document the feature:
> https://issues.apache.org/jira/browse/FLINK-30932
>
> Best,
> Mason
>
> On Mon, Feb 6, 2023 at 11:49 AM Andrew Otto  wrote:
>
>> Hi!
>>
>> Kafka Source will emit KafkaConsumer metrics
>> 
>> .
>>
>> It looks like Kafka Sink
>> 
>> does not emit KafkaProducer metrics
>> .  Is this
>> correct?  If so, why not?
>>
>> Thanks,
>> -Andrew Otto
>>  Wikimedia Foundation
>>
>

Re: Kafka Sink Kafka Producer metrics?

[Mason Chen]

Hi Andrew,

Unfortunately, the functionality is undocumented, but you can set the
property `register.producer.metrics` to true in your Kafka client
properties map. This is a JIRA to document the feature:
https://issues.apache.org/jira/browse/FLINK-30932

Best,
Mason

On Mon, Feb 6, 2023 at 11:49 AM Andrew Otto  wrote:

> Hi!
>
> Kafka Source will emit KafkaConsumer metrics
> 
> .
>
> It looks like Kafka Sink
> 
> does not emit KafkaProducer metrics
> .  Is this
> correct?  If so, why not?
>
> Thanks,
> -Andrew Otto
>  Wikimedia Foundation
>

Kafka Sink Kafka Producer metrics?

[Andrew Otto]

Hi!

Kafka Source will emit KafkaConsumer metrics

.

It looks like Kafka Sink

does not emit KafkaProducer metrics
.  Is this
correct?  If so, why not?

Thanks,
-Andrew Otto
 Wikimedia Foundation