> On Nov 6, 2018, at 4:22 PM, Elias Levy wrote:
>
> Also note that there is a pending PR to allow the Cassandra sink to back
> pressure, so that the cluster does not get overwhelmed.
Yes, I’ve been following the development on that pull request. Unfortunately,
we have to go live very soon
Also note that there is a pending PR to allow the Cassandra sink to back
pressure, so that the cluster does not get overwhelmed.
On Tue, Nov 6, 2018 at 12:46 PM Ning Shi wrote:
> > for rate limiting, would quota at Kafka brokers help?
>
> Thanks, Steven. This looks very promising. I'll try it
> for rate limiting, would quota at Kafka brokers help?
Thanks, Steven. This looks very promising. I'll try it out.
--
Ning
for rate limiting, would quota at Kafka brokers help?
On Tue, Nov 6, 2018 at 10:29 AM Ning Shi wrote:
> On Tue, Nov 06, 2018 at 07:44:50PM +0200, Nicos Maris wrote:
> > Ning can you provide another example except for rate limiting?
>
> Our main use case and concern is rate limiting because
On Tue, Nov 06, 2018 at 07:44:50PM +0200, Nicos Maris wrote:
> Ning can you provide another example except for rate limiting?
Our main use case and concern is rate limiting because without it we
could potentially overwhelm downstream systems (Cassandra) when the job
plays catch up or replay
Ning can you provide another example except for rate limiting?
On Tue, Nov 6, 2018, 6:20 PM Piotr Nowojski Hi,
>
> Sorry but none that I’m aware of. As far as I know, the only way to
> dynamically configure Kafka source would be for you to copy and modify it’s
> code.
>
> Piotrek
>
> > On 6 Nov
Hi,
Sorry but none that I’m aware of. As far as I know, the only way to dynamically
configure Kafka source would be for you to copy and modify it’s code.
Piotrek
> On 6 Nov 2018, at 15:19, Ning Shi wrote:
>
> In the job I'm implementing, there are a couple of configuration
> variables that I
In the job I'm implementing, there are a couple of configuration
variables that I wnat to change at runtime, such as rate limit at the
Kafka source. I know it's possible to use a control stream and join it
with the normal stream to configure things in certain operators, but
this doesn't work for
