Re: when use kafka streams to(topic) method sometime throw error?

[Sharat Joshi]

unsubscribe

On Mon, Mar 5, 2018 at 7:23 PM, ? ?  wrote:

>
> hi:
> I meet a problem today.
> when I use kafka stream to consumer one topic and do mapValues() method,
> and to another topic then .sometimes throw an error
> this is code sample:
> new StreamsBuilder().stream(xxxtopic, Consumed.with(Serdes.String(),
> Serdes.String())).mapValus(method).to(newTopic).
> sometimes it's work well but sometime it's throw error
>
> to topic newTopic due to org.apache.kafka.common.errors.TimeoutException:
> Expiring 6 record(s) for newTopic-2: 30030 ms has passed since last attempt
> plus backoff time
>
> 
> funk...@live.com
>

Re: when use kafka streams to(topic) method sometime throw error?

[Matthias J. Sax]

Yes.

It's a known bug. You can read details here:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-91+Provide+Intuitive+User+Timeouts+in+The+Producer

You can avoid it, by increasing the `request.timeout.ms` parameter for
the producer.


-Matthias

On 3/5/18 9:46 PM, 杰 杨 wrote:
> it seems i don't config ProducerConfig in stream application.
> should I config that ?
> 
> 
> 
> 
> funk...@live.com
> 
> From: funk...@live.com<mailto:funk...@live.com>
> Date: 2018-03-06 11:23
> To: users<mailto:users@kafka.apache.org>
> Subject: when use kafka streams to(topic) method sometime throw error?
> 
> hi:
> I meet a problem today.
> when I use kafka stream to consumer one topic and do mapValues() method,
> and to another topic then .sometimes throw an error
> this is code sample:
> new StreamsBuilder().stream(xxxtopic, Consumed.with(Serdes.String(), 
> Serdes.String())).mapValus(method).to(newTopic).
> sometimes it's work well but sometime it's throw error
> 
> to topic newTopic due to org.apache.kafka.common.errors.TimeoutException: 
> Expiring 6 record(s) for newTopic-2: 30030 ms has passed since last attempt 
> plus backoff time
> 
> 
> funk...@live.com
> 



signature.asc
Description: OpenPGP digital signature

Re: when use kafka streams to(topic) method sometime throw error?

[杰 杨]

it seems i don't config ProducerConfig in stream application.
should I config that ?




funk...@live.com

From: funk...@live.com<mailto:funk...@live.com>
Date: 2018-03-06 11:23
To: users<mailto:users@kafka.apache.org>
Subject: when use kafka streams to(topic) method sometime throw error?

hi:
I meet a problem today.
when I use kafka stream to consumer one topic and do mapValues() method,
and to another topic then .sometimes throw an error
this is code sample:
new StreamsBuilder().stream(xxxtopic, Consumed.with(Serdes.String(), 
Serdes.String())).mapValus(method).to(newTopic).
sometimes it's work well but sometime it's throw error

to topic newTopic due to org.apache.kafka.common.errors.TimeoutException: 
Expiring 6 record(s) for newTopic-2: 30030 ms has passed since last attempt 
plus backoff time


funk...@live.com

when use kafka streams to(topic) method sometime throw error?

[? ?]

hi:
I meet a problem today.
when I use kafka stream to consumer one topic and do mapValues() method,
and to another topic then .sometimes throw an error
this is code sample:
new StreamsBuilder().stream(xxxtopic, Consumed.with(Serdes.String(), 
Serdes.String())).mapValus(method).to(newTopic).
sometimes it's work well but sometime it's throw error

to topic newTopic due to org.apache.kafka.common.errors.TimeoutException: 
Expiring 6 record(s) for newTopic-2: 30030 ms has passed since last attempt 
plus backoff time


funk...@live.com