Joris,
You checkout Burrow https://github.com/linkedin/Burrow which gives you
monitoring and alerting capability for offset stored in Kafka
On Wed, 16 Sep 2015 at 23:05 Joris Peeters <j.peet...@wintoncapital.com>
wrote:
> I intend to write some bespoke monitoring for our internal kafka system.
> Amongst others, it should give us warning if some topics are lagging behind
> too much (i.e. production much faster than consumption).
>
> What would currently be the neatest way to get a list of all topics,
> partitions and consumergroups? It's the latter that I'm most unsure about.
> I imagine I could actually consume the "__consumer_offsets" topic (we're
> using the offsets-are-committed-in-kafka approach), but perhaps there is a
> neater api exposed. I couldn't immediately find it, though.
>
> (I am working in Java/Scala, with the latest official java kafka client).
>
> As always, any help would be appreciated!
> -J
>
>
>
> Winton Capital Management Limited ("Winton") is a limited company
> registered in England and Wales with its registered offices at 16 Old
> Bailey, London, EC4M 7EG (Registered Company No. 3311531). Winton is
> authorised and regulated by the Financial Conduct Authority in the United
> Kingdom, registered as an investment adviser with the US Securities and
> Exchange Commission, registered with the US Commodity Futures Trading
> Commission and a member of the National Futures Association in the United
> States.
>
> This communication, including any attachments, is confidential and may be
> privileged. This email is for use by the intended recipient only. If you
> receive it in error, please notify the sender and delete it. You should not
> copy or disclose all or any part of this email.
>
> This email does not constitute an offer or solicitation and nothing
> contained in this email constitutes, and should not be construed as,
> investment advice. Prospective investors should request offering materials
> and consult their own advisers with respect to investment decisions and
> inform themselves as to applicable legal requirements, exchange control
> regulations and taxes in the countries of their citizenship, residence or
> domicile. Past performance is not indicative of future results.
>
> Winton takes reasonable steps to ensure the accuracy and integrity of its
> communications, including emails. However Winton accepts no liability for
> any materials transmitted. Emails are not secure and cannot be guaranteed
> to be error free.
>
