[ https://issues.apache.org/jira/browse/KAFKA-266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13396503#comment-13396503 ]
Evan Chan commented on KAFKA-266: --------------------------------- BTW, just some thoughts. I'm thinking of not so much a web console for individual Kafka brokers, but a web console for an entire Kafka cluster, targetting mostly smaller clusters. This would grab information from ZK and from JMX (or JMX-over-HTTP) for individual brokers to put together reports like: - Status of different Kafka brokers in the cluster, including overall read and write rates, etc. - Information on consumers (at least the high level consumers registered in ZK), outstanding messages or how far behind they are, etc. > Kafka web console design > ------------------------ > > Key: KAFKA-266 > URL: https://issues.apache.org/jira/browse/KAFKA-266 > Project: Kafka > Issue Type: New Feature > Components: contrib > Reporter: Evan Chan > Original Estimate: 672h > Remaining Estimate: 672h > > This issue is created to track a community-contributed Kafka Web UI. > Here is an initial list of goals: > - Be able to easily see which brokers are up > - Be able to see lists of topics, connected producers, consumer groups, > connected consumers > - Be able to see, for each consumer/partition, its offset, and more > importantly, # of bytes unconsumed (== largest offset for partition - current > offset) > - (Wish list) have a graphical view of the offsets > - (Wish list) be able to clean up consumer state, such as stale claimed > partitions > List of challenges/questions: > - Which framework? Play! for Scala? > - Is all the data available from JMX and ZK? Hopefully, watching the files > on the filesystem can be avoided.... > - How to handle large numbers of topics, partitions, consumers, etc. > efficiently -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira