[jira] [Commented] (KAFKA-2376) Add Copycat metrics

2017-02-03 Thread Randall Hauch (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852164#comment-15852164
 ] 

Randall Hauch commented on KAFKA-2376:
--

I agree with [~criccomini]. It's be great to be able for connectors to add 
their own metrics using the same framework. 

> Add Copycat metrics
> ---
>
> Key: KAFKA-2376
> URL: https://issues.apache.org/jira/browse/KAFKA-2376
> Project: Kafka
>  Issue Type: Improvement
>  Components: KafkaConnect
>Affects Versions: 0.9.0.0
>Reporter: Ewen Cheslack-Postava
>  Labels: needs-kip
>
> Copycat needs good metrics for monitoring since that will be the primary 
> insight into the health of connectors as they copy data.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-2376) Add Copycat metrics

2017-02-03 Thread Chris Riccomini (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851926#comment-15851926
 ] 

Chris Riccomini commented on KAFKA-2376:


One thing we'd like to see here is the ability to hook into the Kafka Connect 
metrics from our connectors. That way we can add connector-specific metrics, 
and have them flow through the same pipeline.

> Add Copycat metrics
> ---
>
> Key: KAFKA-2376
> URL: https://issues.apache.org/jira/browse/KAFKA-2376
> Project: Kafka
>  Issue Type: Improvement
>  Components: KafkaConnect
>Affects Versions: 0.9.0.0
>Reporter: Ewen Cheslack-Postava
>  Labels: needs-kip
>
> Copycat needs good metrics for monitoring since that will be the primary 
> insight into the health of connectors as they copy data.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (KAFKA-2376) Add Copycat metrics

2017-02-02 Thread Ewen Cheslack-Postava (JIRA) 

[ 
https://issues.apache.org/jira/browse/KAFKA-2376?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15851186#comment-15851186
 ] 

Ewen Cheslack-Postava commented on KAFKA-2376:
--

Not quite a direct comparison, but some helpful ideas about framework-level 
metrics we could add:
{quote}
One thing we found super helpful in samza was giving a metric that rolls up the 
percent of time getting records, time processing records, and time sending 
records to be able to debug these bottleneck issues. Technically you can kind 
of get this from the clients, but might be nice to roll that up to make it easy.
{quote}

We still will need to expose connector-specific metrics, but these are generic 
ones that can add a lot of value.

> Add Copycat metrics
> ---
>
> Key: KAFKA-2376
> URL: https://issues.apache.org/jira/browse/KAFKA-2376
> Project: Kafka
>  Issue Type: Improvement
>  Components: KafkaConnect
>Affects Versions: 0.9.0.0
>Reporter: Ewen Cheslack-Postava
>  Labels: needs-kip
>
> Copycat needs good metrics for monitoring since that will be the primary 
> insight into the health of connectors as they copy data.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)