Fwd: [DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-30 Thread Jiuming Tao
的邮件: > > 发件人: Asaf Mesika > 主题: 回复:[DISCUSS] Introduce FlowControl to metrics endpoint > 日期: 2022年8月30日 GMT+8 下午8:02:12 > 收件人: dev@pulsar.apache.org > 回复-收件人: dev@pulsar.apache.org > >> >> I'd like to add a new aspect to the proposal: there might be other >>

Re: [DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-30 Thread Asaf Mesika
> > I'd like to add a new aspect to the proposal: there might be other > solutions that would be useful in the case of large amount of topics in a > Pulsar cluster. > Rate limiting on the /metrics endpoint doesn't sound like the correct > approach. > > When there's a huge about of metrics, instead

[DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-29 Thread Jiuming Tao
Thanks, Tao Jiuming > 下面是被转发的邮件: > > 发件人: Lari Hotari > 主题: 回复:[DISCUSS] Introduce FlowControl to metrics endpoint > 日期: 2022年8月29日 GMT+8 下午6:40:38 > 收件人: dev@pulsar.apache.org > 回复-收件人: dev@pulsar.apache.org > > Good reiteration of the problem and good points, Asaf.

Re: [DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-29 Thread Lari Hotari
Good reiteration of the problem and good points, Asaf. I'd like to add a new aspect to the proposal: there might be other solutions that would be useful in the case of large amount of topics in a Pulsar cluster. Rate limiting on the /metrics endpoint doesn't sound like the correct approach. When

Re: [DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-29 Thread Asaf Mesika
Hi Jiuming, I would reiterate the problem statement to make it clear (at least for me): There are cases where a very large amount of topics exists (> 10k per broker) and are used in Pulsar. Those topics usually have multiple producers and multiple consumers. There are metrics that are in the gran

Re: [DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-18 Thread Jiuming Tao
bump Jiuming Tao 于2022年8月8日周一 18:19写道: > Hi Pulsar community, > > In the situation of expose metrics data which has a big size, it will lead > to: > 1. A sudden increase of network usage > 2. The latency of pub/sub rising > > For the purpose of resolving these problems, I’d opened a PR: > https:

[DISCUSS] Introduce FlowControl to metrics endpoint

2022-08-08 Thread Jiuming Tao
Hi Pulsar community, In the situation of expose metrics data which has a big size, it will lead to: 1. A sudden increase of network usage 2. The latency of pub/sub rising For the purpose of resolving these problems, I’d opened a PR: https://github.com/apache/pulsar/pull/16452