[jira] [Comment Edited] (KAFKA-6498) Add RocksDB statistics via Streams metrics
[
https://issues.apache.org/jira/browse/KAFKA-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347963#comment-16347963
]
james chien edited comment on KAFKA-6498 at 2/2/18 9:01 AM:
[~guozhang] I want to pick it up!
For my comprehension is that we want to expose RockDB stats via Streams metrics
so that user can use Streams metrics simply to monitor RockDB stats but not to
access RockDB directly.
was (Author: james.c):
[~guozhang] I want to pick it up!
For my comprehension is that we want to expose RockDB stats via Streams metrics
so that user can use Streams metrics simply to monitor RockDB stats but not to
access RockDB directly which means `KStream` should be extended.
> Add RocksDB statistics via Streams metrics
> --
>
> Key: KAFKA-6498
> URL: https://issues.apache.org/jira/browse/KAFKA-6498
> Project: Kafka
> Issue Type: Improvement
> Components: metrics, streams
>Reporter: Guozhang Wang
>Assignee: james chien
>Priority: Major
> Labels: needs-kip
>
> RocksDB's own stats can be programmatically exposed via
> {{Options.statistics()}} and the JNI `Statistics` has indeed implemented many
> useful settings already. However these stats are not exposed directly via
> Streams today and hence for any users who wants to get access to them they
> have to manually interact with the underlying RocksDB directly, not through
> Streams.
> We should expose such stats via Streams metrics programmatically for users to
> investigate them without trying to access the rocksDB directly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (KAFKA-6498) Add RocksDB statistics via Streams metrics
[
https://issues.apache.org/jira/browse/KAFKA-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16347963#comment-16347963
]
james chien edited comment on KAFKA-6498 at 2/2/18 8:47 AM:
[~guozhang] I want to pick it up!
For my comprehension is that we want to expose RockDB stats via Streams metrics
so that user can use Streams metrics simply to monitor RockDB stats but not to
access RockDB directly which means `KStream` should be extended.
was (Author: james.c):
[~guozhang] I want to pick it up!
As my comprehension is that we want to expose RockDB stats via Streams metrics
so that user can use Streams metrics simply to monitor RockDB stats but not to
access RockDB directly.
> Add RocksDB statistics via Streams metrics
> --
>
> Key: KAFKA-6498
> URL: https://issues.apache.org/jira/browse/KAFKA-6498
> Project: Kafka
> Issue Type: Improvement
> Components: metrics, streams
>Reporter: Guozhang Wang
>Assignee: james chien
>Priority: Major
> Labels: needs-kip
>
> RocksDB's own stats can be programmatically exposed via
> {{Options.statistics()}} and the JNI `Statistics` has indeed implemented many
> useful settings already. However these stats are not exposed directly via
> Streams today and hence for any users who wants to get access to them they
> have to manually interact with the underlying RocksDB directly, not through
> Streams.
> We should expose such stats via Streams metrics programmatically for users to
> investigate them without trying to access the rocksDB directly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Comment Edited] (KAFKA-6498) Add RocksDB statistics via Streams metrics
[
https://issues.apache.org/jira/browse/KAFKA-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16348347#comment-16348347
]
james chien edited comment on KAFKA-6498 at 2/1/18 10:26 AM:
-
I have one more question is that source of stats is limited in db of kafka?
was (Author: james.c):
I have one more question is that source of stats is limited in db of kafka or
any?
> Add RocksDB statistics via Streams metrics
> --
>
> Key: KAFKA-6498
> URL: https://issues.apache.org/jira/browse/KAFKA-6498
> Project: Kafka
> Issue Type: Improvement
> Components: metrics, streams
>Reporter: Guozhang Wang
>Assignee: james chien
>Priority: Major
> Labels: needs-kip
>
> RocksDB's own stats can be programmatically exposed via
> {{Options.statistics()}} and the JNI `Statistics` has indeed implemented many
> useful settings already. However these stats are not exposed directly via
> Streams today and hence for any users who wants to get access to them they
> have to manually interact with the underlying RocksDB directly, not through
> Streams.
> We should expose such stats via Streams metrics programmatically for users to
> investigate them without trying to access the rocksDB directly.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
