Re: [ANNOUNCE] New Committer: Vahid Hashemian

Congratulations Vahid! On Wed, Jan 16, 2019 at 10:13 AM Edoardo Comar wrote: > Bravo Vahid!!! > > Edo > > > > From: Mickael Maison > To: Users > Cc: dev > Date: 16/01/2019 08:48 > Subject:Re: [ANNOUNCE] New Committer: Vahid Hashemian > > > > Congratulations Vahid! Well

Re: Total Volume metrics of Kafka

Peter, Thanks for the inputs. I am interested in aggregate bytes published into a topic. The approach of metrics collector along with graphing tool seems appealing. I can volume ingested over arbitrary periods of time which is exactly what I am looking for. Can you please point to some metrics

Total Volume metrics of Kafka

Hi I am interested in getting total volume of data that a topic ingested in a period of time. Does Kafka collect any such metrics? I check JMX console but I only found rate metrics. Regards, Amitav

Re: Total Volume metrics of Kafka

Amitav, When you say total volume, do you want a topic’s size on disk, taking into account replication and retention, or do you want the aggregate bytes published into a topic? If you have a metrics collector and a graphing tool such as grafana, you can transform the rate metrics to a byte sum

Prioritized Topics for Kafka

Hi all, On the dev list we’ve been discussing a proposed new feature (prioritized topics). In a nutshell, when consuming from a set of topics with assigned priorities, consumption from lower-priority topics only occurs if there’s no data flowing in from a higher-priority topic.

Re: Total Volume metrics of Kafka

On each broker, we have a process (scheduled with cron) that polls the kafka jmx api every 60 seconds. It sends the metrics data to graphite (https://graphiteapp.org). We have graphite configured as a data source for grafana (https://grafana.com) and use it to build various dashboards to

Re: [ANNOUNCE] New Committer: Vahid Hashemian

Bravo Vahid!!! Edo From: Mickael Maison To: Users Cc: dev Date: 16/01/2019 08:48 Subject:Re: [ANNOUNCE] New Committer: Vahid Hashemian Congratulations Vahid! Well done! On Wed, Jan 16, 2019 at 6:42 AM Dongjin Lee wrote: > > Congratulations, Vahid!! > > On Wed, Jan

Re: Urgent : Kafka-Client Download installation

Hello Kumar, you can either build your own .jar client from the source or download from a repository like https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients/2.1.0 and use the artefact you need (mvn, SBT, gradle, ivy...) The

Re: [ANNOUNCE] New Committer: Vahid Hashemian

Congratulations Vahid! Well done! On Wed, Jan 16, 2019 at 6:42 AM Dongjin Lee wrote: > > Congratulations, Vahid!! > > On Wed, Jan 16, 2019 at 3:32 PM Dong Lin wrote: > > > Congratulations Vahid! > > > > On Tue, Jan 15, 2019 at 2:45 PM Jason Gustafson > > wrote: > > > > > Hi All, > > > > > >

rebalancing latency spikes on high throughput kafka-streams services

Dear all, we are starting to work with Kafka streams, our service is a very simple stateless consumer. We have tight requirements on latency, and we are facing too high latency problems when the consumer group is rebalancing. In our scenario, rebalancing will happen relatively often: rolling

RE: Urgent : Kafka-Client Download installation

HI Team, We have downloaded and configured the kafka_2.11-2.1.0 on kafka server (Linux). Now we need to install Kafka-client with same version on different server(Linux). Could you please let me know from where we can download Kafka-Client with instruction of configurations. Thanks, Anil