Re: Kafka component error handling - consumer keeps leaving and rejoining the group

2020-04-27 Thread Claus Ibsen
Hi Thanks for all your findings, this is great insight. You are surely welcome to create a JIRA ticket about this bug. We can then together work on a fix, and you can help test it. Yeah it seems catching KafkaException is maybe too wide. And lets see if we also can incorporate bridge error

Re: Kafka component error handling - consumer keeps leaving and rejoining the group

2020-04-27 Thread Joseph M'BIMBI-BENE
digging into the code (version 3.2.0 i repeat), i can see in the class `org.apache.camel.component.kafka.KafkaConsumer.KafkaFetchRecords.doRun`, lign 406: ``` catch (KafkaException e) { // some kind of error in kafka, it may happen during // unsubscribing or during normal processing if

Re: Kafka component error handling - consumer keeps leaving and rejoining the group

2020-04-27 Thread Joseph M'BIMBI-BENE
I forgot to tell i am using version 3.2.0 On Sun, 26 Apr 2020 at 20:45, Joseph M'BIMBI-BENE wrote: > Hello everyone, > > I'm having a problem with the Kafka component: > When the kafka consumer can't read a message (caused by some avro errors > after investigation), it continuously leaves the

Kafka component error handling - consumer keeps leaving and rejoining the group

2020-04-27 Thread Joseph M'BIMBI-BENE
Hello everyone, I'm having a problem with the Kafka component: When the kafka consumer can't read a message (caused by some avro errors after investigation), it continuously leaves the group and joins again. I would like it to just throw an exception and let me decide how to handle it: dlq,

Re: Kafka component error handling - consumer keeps leaving and rejoining the group

2020-04-27 Thread Joseph M'BIMBI-BENE
I also realize that the property "bridgeErrorHandler" seems to never be used, while another one, like "breakOnFirstError". Also, going back to the exception handling, at least a couple other subclasses of KafkaException would deserve not to be retried on. Just a few examples: -

Re: camel s3 consumer filename

2020-04-27 Thread Andrea Cosentino
When you're consuming file from S3, the name is set in the header CamelAwsS3Key So you could do something like I didn't test this. Il giorno lun 27 apr 2020 alle ore 14:34 Axel Bock < axel.bock.mail+l...@gmail.com> ha scritto: > hi list, since you (read: andrea ;) helped a lot on my last

Re: camel s3 consumer filename

2020-04-27 Thread Andrea Cosentino
Let me correct myself, it's Il giorno lun 27 apr 2020 alle ore 15:11 Andrea Cosentino ha scritto: > When you're consuming file from S3, the name is set in the > header CamelAwsS3Key > > So you could do something like > > /> > > > I didn't test this. > > Il giorno lun 27 apr 2020 alle ore

[ANNOUNCEMENT] Apache Camel-kafka-connector 0.1.0 Released

2020-04-27 Thread Andrea Tarocchi
The Camel community announces the immediate availability of Apache Camel-kafka-connector 0.1.0 The artifacts are published and ready for you to download either from the Apache mirrors or from maven central. For more info please visit the project GitHub repository[1]. Many thanks to all who made

camel s3 consumer filename

2020-04-27 Thread Axel Bock
hi list, since you (read: andrea ;) helped a lot on my last question, I have another one. I consume files from s3. but the files are saved under generic file names in my target directory, which I don't want. I actually want to save them under the name they have in s3. this is my config (broken up

Camel Mongo findById // empty results

2020-04-27 Thread Reji Mathews
Hello Camel Community I am trying to use camel to query records based on mongo id with operation "findById". Following is the route snippet public void configure() throws Exception { from("jetty:http://0.0.0.0:8081/mongo?httpMethodRestrict=GET;)

Re: Concepts: microservices

2020-04-27 Thread Som Lima
Thank you Sir. You have given me what I needed. An authoritative over view. On Mon, 27 Apr 2020, 06:46 Ralf Claussnitzer, < ralf.claussnit...@slub-dresden.de> wrote: > Hi, > > On 4/26/20 9:50 PM, Som Lima wrote: > > Hi, > > > > 1. What is a micro service ? > I recommend you have a look at

Re: Concepts: microservices

2020-04-27 Thread Som Lima
Sorry. I wish you good health and happiness In these troubling times. On Mon, 27 Apr 2020, 15:27 Som Lima, wrote: > Thank you Sir. > You have given me what I needed. > An authoritative over view. > > > > > > On Mon, 27 Apr 2020, 06:46 Ralf Claussnitzer, < > ralf.claussnit...@slub-dresden.de>

camelContex cpu and memory usage

2020-04-27 Thread Mikhail Lukyanov
Is there way monitoring cpu and memory usage specific camelContext or route?