Re: Camel 4 migration blog post - Feedback welcome

one thing that got us was, since we were using kafka with security but not using Kafka idempotency, we had to add the following flag. As usual, kafka messages were not helpful. camel.component.kafka.enable-idempotence=false On Fri, Oct 6, 2023 at 3:49 AM Claus Ibsen wrote: > Hi > > If you have

Re: Camel Kafka consumer dynamic topic

; > It would require ReST to be idempotent and return or more complex - > persisting routes and reloading them. > > ચિરાગ/चिराग/Chirag > -- > Sent from My Gmail Account > > > On Thu, Oct 5, 2023 at 12:44 AM Mark Nuttall wrote: > > > &

Re: Camel Kafka consumer dynamic topic

ic at runtime and create a kafka > consumer from it. > > - Girish > > On Wed, Oct 4, 2023, 2:58 AM Mark Nuttall wrote: > > > Pretty sure I've done this kind of thing before. I think the info is here > > > > > https://stackoverflow.com/questions/48380456/dynamic-

Re: Camel Kafka consumer dynamic topic

Pretty sure I've done this kind of thing before. I think the info is here https://stackoverflow.com/questions/48380456/dynamic-routing-apache-camel On Tue, Oct 3, 2023, 3:22 AM Claus Ibsen wrote: > Hi > > If you use Java RouteBuilder, then you can maybe use spring dependency > injection, to

Re: How to receive Server side events

https://www.baeldung.com/spring-server-sent-events On Tue, Aug 15, 2023 at 4:00 PM Claus Ibsen wrote: > Hi > > There is no component that out of the box supports SSE with Camel (to my > knowledge). > > We have a JIRA about this > https://issues.apache.org/jira/browse/CAMEL-16431 > > If you run

Re: Camel Kafka Consumer Node -1 disconnected error

Yeah, typically most camel config is in properties. It looks like all the config is on the URI and i dont see any security settings. It is very highly likely what Claus said. Or, your service does not have the correct access. I have used Kafka with AWS MSK and Confluent and have seen this error

Re: Consume Kafka messages in a batch

it's pretty easy for us to miss bug reports and interesting feature > suggestions - as yours.If possible, try to provide a pseudo-code, a > reproducer or a unit test that the community can look at and work with. > > > Thanks > > On Wed, Mar 15, 2023 at 1:31 PM Mark Nuttall

Consume Kafka messages in a batch

I know consuming Kafka messages in a batch is not currently supported. I googled and I didn't find any real options. I looked at hacking the Camel classes to implement it and decided that it was too risky. So for now we are falling back to using a Spring Kafka Consumer. The issue with that is I

Re: How to trigger Messages at specific times

we need to do to > trigger Camel? > > On Tue, 31 Jan 2023 at 21:51, Mark Nuttall wrote: > > > Use quartz outside of camel and let camel do the rest. This is what we > are > > doing in a current product and I've done this before in the past. > > > > On Tue

Re: How to trigger Messages at specific times

Use quartz outside of camel and let camel do the rest. This is what we are doing in a current product and I've done this before in the past. On Tue, Jan 31, 2023, 3:58 AM Yash Ganthe wrote: > Hi, > > We have a DB table where every row has a text message and a timestamp. E.g. > Mesg1 09:00 >

Re: Jdbc Aggregation and K8s

JIRA issue? > > Regards, > Karen Lease > > On 10/03/2022 23:30, Mark Nuttall wrote: > > FYI we tried using ClusterJDBCAggregationRepository, but we can’t use > > because it requires instance_id. > > Also, our organization does not have support for StatefulSet so we ca

Re: Jdbc Aggregation and K8s

FYI we tried using ClusterJDBCAggregationRepository, but we can’t use because it requires instance_id. Also, our organization does not have support for StatefulSet so we can't use that. On Thu, Mar 10, 2022 at 5:14 PM Mark Nuttall wrote: > Sorry Claus, I should have included that. I was jump

Re: Jdbc Aggregation and K8s

2022 at 5:54 PM Mark Nuttall wrote: > > > > Has anyone successfully gotten JDBC Aggregation to work with K8s > > (Kubernetes)? We are struggling to make it work and maybe we are just > > missing something. > > > > Each instance (pod) gets a list of aggregat

Jdbc Aggregation and K8s

Has anyone successfully gotten JDBC Aggregation to work with K8s (Kubernetes)? We are struggling to make it work and maybe we are just missing something. Each instance (pod) gets a list of aggregating exchanges, then populates information about the exchanges, and if an exchange completes in

Re: .process vs .to(bean: ?

e Camel's > error handling and retries. > > -Steve > > > -Original Message- > > From: Mark Nuttall > > Sent: Friday, September 10, 2021 3:51 PM > > To: users@camel.apache.org > > Subject: Re: .process vs .to(bean: ? > > > > You should use

Re: .process vs .to(bean: ?

You should use the Camel Processing to do retries. Also, look at using something like OpenFeign to reduce the boilerplate HTTP call. It can be very few lines of code. or you should use the Camel HTTP component. On Fri, Sep 10, 2021 at 2:00 AM Matthee, Elmar [elm...@sun.ac.za] <

Re: Springboot creating new Kakfa components

Fyi, using Spring Boot and/or Camel, you can and should specify kafka properties in property / yaml files. You dont need to create a Kafka Component. Spring/Camel will do that for you. That is what they do. That way it will be configured correctly.

Re: Update Logging Levels of Camel routes using Spring Boot Actuator

controllers > TestLoggersController.java > - routes > TestLoggersRoute.java > MyApplication.java > > Kind Regards > Simon > > From: Mark Nuttall > Date: Tuesday, 18 May 2021 at 04:08 > To: users@camel.apache.org > Subject: Re: U

Re: Update Logging Levels of Camel routes using Spring Boot Actuator

It looks like your route Builder classes in the root package. That usually is not good as if that's the case. I suggest moving it to the same package as the controller. I don't know if that will make any difference but sometimes having classes in the root package causes issues. Other than that I

Re: kafka consumer to kafka producer parition key issue

ka > <https://camel.apache.org/components/3.9.x/vertx-kafka-component.html> > component > and see if this solves the problem? > > Regards, > Omar > > On Mon, Apr 19, 2021 at 5:26 PM Mark Nuttall wrote: > > > Setting the message key does not help. :( > &

Re: kafka consumer to kafka producer parition key issue

Setting the message key does not help. :( On Mon, Apr 19, 2021 at 11:20 AM Mark Nuttall wrote: > I've never set the message key. I might give that a shot. > > The route is pretty simple. And the only headers being set are the > partition key and another string value i need

Re: kafka consumer to kafka producer parition key issue

dy that you set, that could > help us here to troubleshoot the issue. Also, how many partitions do you > have in your topic? > > Regards, > Omar > > On Fri, Apr 16, 2021 at 5:10 PM Mark Nuttall wrote: > > > Camel version: 3.9.0 > > > > Issue: when consuming f

kafka consumer to kafka producer parition key issue

Camel version: 3.9.0 Issue: when consuming from one kafka topic and producing to another, setting the partition key causes the write to fail. After a few seconds it will fail with this error: Error during processing. Exchange[2729AA824AE4E97-]. Caused by:

Re: Camel Springboot + telegraf-plugin + Grafana

It directly into influxdb On Tue, Mar 30, 2021, 4:54 PM SRIKANT MVS wrote: > Thanks Mark, Let me look into the springboot metrics. > > -Regards > Srikant > > On Tue, Mar 30, 2021 at 7:07 PM Mark Nuttall wrote: > > > Also if you are using routes to call Kafka o

Re: Camel Springboot + telegraf-plugin + Grafana

Also if you are using routes to call Kafka or external http or whatever then you will have metrics for that provided by camel metrics On Mon, Mar 29, 2021, 6:05 PM SRIKANT MVS wrote: > Hi Team, > I want to send metrics from my camel-springboot application to > telegraf-plugins which would

Re: Camel Springboot + telegraf-plugin + Grafana

You should use spring boots metrics support On Mon, Mar 29, 2021, 6:05 PM SRIKANT MVS wrote: > Hi Team, > I want to send metrics from my camel-springboot application to > telegraf-plugins which would further be visible in the Grafana dashboard. > This action should happen periodically. > > I

Re: Properties in java config

Based on what you've said, this is a Spring Boot related (ish) issue only because it is loading the properties. I suggest doing this the Spring Boot way and letting the Spring Boot/Apache Camel integration just work. If you've not see how Spring Boot resolves properties -

Re: EXTERNAL: Re: Can't get routes to Start in SpringBoot / Camel 3.5.0

> Thank you very much! > > Sincerely, > > Jeremy Cox > Software Engineer > Universal Gateway at Progeny Systems > > Urgent contact: Text 859.322.3214 > Emailjeremy@progeny.net > > > -Original Message- > From: Mark Nuttall [mailto:mknutt...@

Re: EXTERNAL: Re: Can't get routes to Start in SpringBoot / Camel 3.5.0

Did you try something simple like a direct route? If that does work and the quartz one doesn't work then it is configured wrong. If neither do, try ensuring the Component is being created. Put a log statement in the configure method. I don't see the package names in your code but if "beans"

Re: Maximum version of Spring Boot for Camel 2.25.2?

go to start.spring.io/info. It will tell you compatible versions. On Mon, Aug 31, 2020 at 3:42 PM Mikael Andersson Wigander wrote: > I have read somewhere on the site the maximum dependency for Spring Boot > for Camel 2.x but can't find it. > What's the recommendation? > > We have an app

Re: Enabling global CORS support

I am pretty sure it is because the annotation is Spring and the other is Camel and Spring is in control, not Camel. For a global way with spring, see this - https://spring.io/guides/gs/rest-service-cors/ On Fri, Aug 7, 2020 at 1:57 AM Ron Cecchini wrote: > > Hi, guys. > > I have a Camel (3.4.2)

Re: Unmarshal Map to POJO with Jackson data format

you could add an inline processor and specifically call the ObjectMapper method you need. Or some variant of that. While it is not an OOTB camel component, it is one less conversion. On Mon, Aug 3, 2020 at 9:49 PM Jeremy Ross wrote: > Hey Sneharghya, > > Thanks, that is my workaround. Just

Re: Prometheus metrics for success/failure

Failures and exceptions should be identified via logs. Camel will log those. You shouldn't have enough of them to warrant metrics. Premethius is a metrics system. JMX is just a to access things in the jvm. Micrometer will do some of what JMX will do. Camel is going to use micrometer to create the

Re: Pause the processing of file

nges > > if the route that was consuming messages from the first route is suspended. > does not that mean that there will be no demand now and the first route > will pause generating exchanges? > > > On Fri, Jun 12, 2020 at 5:15 PM Mark Nuttall wrote: > > > The reason the

Re: Pause the processing of file

The reason the first does not work is because direct routes are just like one method in a class calling another. And stopping the second is like removing the method. What I do when processing the file is read whole file and write to a topic/queue and then have the second route read from the

Re: Camel plugin no longer shows up in hawtio

Might be a version issue. I had the same problem and that is what it was. Also, debugging is not there unless I drop back camel versions. On Thu, Jun 4, 2020, 7:38 PM Jeremy Ross wrote: > Hey camel folks, > > At some point the Camel plugin stopped showing up in hawtio. I can access > hawtio

Re: reactive java question

Without seeing the actual code I can't say for sure but I would use producer template do you send a message to a direct route and have that direct route to be in the from to start the processing in the route On Tue, May 26, 2020, 10:31 PM Bing Lu wrote: > I have to incorporate a third party

Re: Communicating a value between a route and the RouteBuilder class

I'm not seeing all the code of course but remember that spring beans by default are Singletons. So values set at the class level are not thread safe. On Fri, Dec 13, 2019, 1:05 AM Ron Cecchini wrote: > > On December 12, 2019 at 11:16 AM Claus Ibsen > wrote: > > > > You can also name your

Re: Spring configuring a bean

if you have the bean defined in XML and also the one in Java, then what is happening is the Java one is "winning" and say is never set. On Mon, Aug 26, 2019 at 11:24 AM Ron Cecchini wrote: > I apologize ahead of time, because I feel like I've taken a few steps > backward and am now hung up on a

Re: Camel + Spring Boot as a backend?

I use Spring Boot extensively with Camel. It is a perfect pair for what you are asking about. I have i running locally on servers and also in aws in EC2. Works great both ways. Start by going to start.spring.io and pick Camel and JDBC (or JPA,etc), or if you have IntelliJ or STS you can just use

Re: Java DSL route now needs a MS SQL .to( How do I declare connection info?

=org.hibernate.dialect.SQLServer2012Dialect run app as spring boot app On Mon, Jul 30, 2018 at 2:08 PM, John F. Berry wrote: > I desire NOT to incorporate Spring with the mix I have. I will if that > is the standard way, but not sure how you would do that. > > On Monday, July 30, 2018, 12:29:20 PM EDT,

Re: Java DSL route now needs a MS SQL .to( How do I declare connection info?

Are you using Spring with the Java DSL? Just not sure if you are / aren't. On Mon, Jul 30, 2018 at 11:45 AM, John F. Berry wrote: > Thanks Quinn for the helping hand. > > I've been looking for examples of how to declare the servername/instance > name, username password to utilize a MS SQL

Re: Spring boot gives null pointer in xml based camel configutaions

Can you switch to Java routes instead XML? I am deploying Spring Boot Camel Java routes as war's with no issues. On Wed, Jun 27, 2018 at 2:09 PM, David Karlsen wrote: > No - it is not wrong to create .war's: > https://docs.spring.io/spring-boot/docs/1.5.14.RELEASE/ >

Re: Cannot send files bigger then 256kb to service bus via amqps

the following link on stackoverflow seems to indicate it is an Azure service bus limitation https://stackoverflow.com/questions/22384193/azure-service-bus-message-size-technology-limit-and-pricing On Fri, Jun 22, 2018 at 10:09 AM, Tunikov, Eugeniy wrote: > I am new to camel framework so I

Re: Need some very lite help

My suggestion is to use camel with spring boot. They are a fantastic combo. And make getting up and running easy. On Fri, May 11, 2018, 5:55 PM Michael Joyner wrote: > Hi all! I am moving from Mulesoft to Camel. I was wondering if there was > anyone that could help

Re: Recommendation/Best Practice for shutting down Camel Spring Boot App

even though your app is not a web app, adding "web" and actuator add value for things like metrics and health status and things like this. Why not just add those two items? That is what i do. And fyi, you might ask this on the spring forums as this really is a Spring Boot question. On Wed,

Re: Enabling message tracing using Jolokia

this seems like a hawtio question. Maybe try this. I only just saw it so i have not tried it. https://github.com/hawtio/hawtio/tree/master/hawtio-sample-springboot On Mon, Apr 2, 2018 at 3:37 PM, Reji Mathews wrote: > Hi guys > > I am currently deploying camel routes

Re: Spring Boot 2

I will help test. I have quite a few things using Spring Boot and Camel and would like to update as soon as i can :) On Fri, Mar 2, 2018 at 10:01 AM, Claus Ibsen wrote: > Hi > > Well when 2.21 is out the door and its 2.21.x branch is setup, then we > would likely fairly

Re: Apache Camel vs Apache Storm

What is it that you are trying to do? There is a plethora of projects on Apache.org. Some do sort of the same thing. Some do some of the same things. Some don't. On Thu, Feb 15, 2018 at 4:30 PM, Guillermo Castro wrote: > Apache Storm is a distributed real-time

Re: Problem with upgrade from camel 2.19.3 to camel 2.20.0

ompared to 2.20.0 ? > > > > On Tue, Oct 24, 2017 at 7:13 PM, Mark Nuttall <mknutt...@gmail.com> wrote: > > > Oh. i missed the "complex use case". Of the code you provided, what is > line > > 66? > > > > On Tue, Oct 24, 2017 at 11:47 AM, Mar

Re: Problem with upgrade from camel 2.19.3 to camel 2.20.0

Oh. i missed the "complex use case". Of the code you provided, what is line 66? On Tue, Oct 24, 2017 at 11:47 AM, Mark Nuttall <mknutt...@gmail.com> wrote: > Is there any reason you are not using the standard Spring Boot + Camel > mechanisms to create the context and route

Re: Problem with upgrade from camel 2.19.3 to camel 2.20.0

Is there any reason you are not using the standard Spring Boot + Camel mechanisms to create the context and routes. I don't readily see any in your code. Doing so might resolve the problem. Let me know if you need help with that.. Mark On Tue, Oct 24, 2017 at 9:36 AM, Dicken George

Re: Camel Spring Boot: Bean initialization skipped in auto-configuration

:( Maybe it doesn't anymore? :) I was only trying to figure out what might possible cause the issue he was seeing. And also to give him a work around. On Thu, Oct 12, 2017 at 8:27 AM, Claus Ibsen <claus.ib...@gmail.com> wrote: > On Thu, Oct 12, 2017 at 2:20 PM, Mark Nuttall <mknutt...@gmai

Re: Camel Spring Boot: Bean initialization skipped in auto-configuration

l Sports Information GmbH > M - > > Plabutscher Straße 63 > F - > > 8051 Graz > E florian.po...@performgroup.com > > Austria > Skype rb.fposch > > > > > W www.performgroup.com > > > -Ursprüngliche Nachricht- > Von: Mark Nuttall [mailto:

Re: Camel Spring Boot: Bean initialization skipped in auto-configuration

I looked at stacktrace and your code here. I agree with the comment about the Map. The same thing can happen with strings. I am not sure what the map does but you might be able to that in Spring properties. If not, either create a class to hold the map and make that class the Bean or provide a

Re: Design: Caching JPA Entities in Apache Camel

if you are going to still use JPA, Spring Boot works very well with camel and makes caching jpa entities seamless (implementation is in property files) On Sat, Oct 7, 2017 at 11:31 AM, Rafael Soares wrote: > If you choose Hibernate as your JPA provider you can activate

Re: REST DSL process multipart/form-data binary file?

it is just a file. any example of processing a file should work. you will be able to save it somewhere and then you will have to call some processor to read/process it. On Fri, Sep 29, 2017 at 7:47 PM, Mark wrote: > I'm trying to figure out how to process a binary file

Re: Out Of Memory Using Camel 2.18.2 , Secure Kafka 0.10.2 , Spring Boot 1.5.1

Was this part of another thread? Anyway, what are the current memory settings? My guess i that you are reading a quite large message into memory. Either increase memory or stream the message to disk (like how the FTP client does it). I am not sure offhand if the Kafka component supports it. On

Re: AWS S3 and Minio (or other S3 emulator)

. On Thu, Apr 27, 2017 at 5:28 PM, <dennyej...@yahoo.com.invalid> wrote: > Why don't u go for a free tier account and use S3? I'm using it with camel > and java sdk .. works well.. > > Sent from my Cyanogen phone > > On Apr 25, 2017 8:59 AM, Mark Nuttall <mknutt...@gmail.com&g

Re: Audit Database with Apache Camel

If you use Hibernate (or Spring JPA with Hibernate (as the provider) with Camel there is Hibernate Envers for RDBMS. Spring also provides "auditing" for web calls too. I don't spend any time with anything else so I am not sure but I have not run across anything. On Tue, Apr 25, 2017 at 10:10 AM,

AWS S3 and Minio (or other S3 emulator)

Does anyone have experience using Camel with an AWS S3 "emulator". I don't currently have access to AWS S3 so i am trying to use Minio (Minio.io) to develop with until I can get the real S3. I have not been successful getting it to work. I have tried creating the AmazonS3Client myself but am

Re: SEDA vs embedded ActiveMQ

subscribe > semantics (JMS Topics), message expiration, Virtual Topics) then an > Embedded ActiveMQ broker makes sense. If SEDA does what you need, I think > I’d stick with that. > > > On Mar 29, 2017, at 6:23 AM, Mark Nuttall <mknutt...@gmail.com> wrote: > > > > Note t

Re: SEDA vs embedded ActiveMQ

he VM terminates while messages are yet to be processed. *If you need > > persistence, reliability or distributed SEDA, try using either JMS > > <http://camel.apache.org/jms.html> or ActiveMQ > > <http://camel.apache.org/activemq.html>.* > > > On Wed, Mar

SEDA vs embedded ActiveMQ

Which would be the better choice? SEDA or _embedded_ ActiveMQ? I've googled and read the docs. I am just doing some low volume, short live processing and need async worker queues. My only other choice is SQS and it seems like overkill and a lot of extra effort.

Re: can Redis BLPOP (and etc) be used in a consumer URI?

orted for consumer. > https://github.com/apache/camel/blob/master/components/camel > -spring-redis/src/main/java/org/apache/camel/component/ > redis/RedisConsumer.java#L54 > > You may want to file a JIRA for the enhancement. > > Thanks, > Tomo > > > On 03/29/2

can Redis BLPOP (and etc) be used in a consumer URI?

I am looking at the documentation and examples and have been testing with the Redis component. It seems that the only command that will work in a consumer URI is SUBSCRIBE and PSUBSCRIBE . It seems that only works with PUBLISH. Pub/Sub in REDIS is not persistent. I need something that is. If i

Re: Recommend a platform for running Camel

It is. :) There are other ways. As fully featured? (aka 12 factored app). I've not found it. FYI - You will need more than just Docker (see the things I mentioned). I was on my tablet at work earlier so it was tough to type and send links. So, for completeness, here is the link to Spring Boot

Re: Recommend a platform for running Camel

You can use spring boot admin to do some admin. Eventually you will want to use something like fabric8\kubernetes or cloudfoundry to manage spring boot apps. All the goodness in it makes it "easy" to manage. Starting with spring boot admin might be a way to go while you figure out kubernetes. On

Re: Camel + Springboot Horizontal Scalability

Check out Fabric8 and Kubernetes On Mar 4, 2017 1:37 PM, "contactreji" wrote: > Hi Guys > > Has anyone tried horizontal scaling of camel springboot apps on cloud > platforms or open stack platforms? If so how can we achieve that? > > Cheers > Reji > > > > - > Reji

Re: CamelConfiguration wires all routes by default

Maybe a code example of what you are trying? I am using spring, well spring boot , and Camel to dynamically create routes on demand. On Feb 10, 2017 1:31 PM, "Luciano Nunes" wrote: Nobody? -- View this message in context: http://camel.465427.n5.nabble.

Re: How to convert property value to array

I did some googling and i cannot find an exact example. But based on what i see in the Simple and Properties pages, i am guessing that it might work like Spring. So in your properties file try this: cool.foos[0]=a cool.foos[0]=b cool.foos[0]=c and in your DSL use: " ${properties:cool.foos} "

Re: How to convert property value to array

Are you using spring? Creating arrays from properties is built in. On Nov 8, 2016 3:07 PM, "imranrazakhan" wrote: > HI, > > I want to convert value to array but couldn't get any idea from docs > > // properties > cool.foo=a,b,c > > > // route > from("direct:start") >

Re: IDE for newer Camel versions using Camel Spring Boot

Fyi STS has property autocompletion with docs :). I recommend Claus's video. I was going to mention it but figured he would. On Oct 24, 2016 3:18 AM, "Claus Ibsen" wrote: > Hi > > There is also the fabric8 Camel forge tooling for Apache Camel >

Re: IDE for newer Camel versions using Camel Spring Boot

Pontus, I only do Java DSL with Spring Boot, so I use STS (I could use Intellij too if I had a license for it). It works very well for me (and my use cases). The guy i use to work with started with XML but it was painful because - XML. He has moved exclusively to Groovy. I am not sure what your

Re: Spring Boot autoconfiguration

It might be easier and better to move that code to a different project. It sounds like you have non camel specific code you want to test. On Oct 20, 2016 11:15 PM, "Minh Tran" wrote: > Hi > > I’m using Camel 2.18.0 and Spring Boot. I’m trying to write a unit test >

Re: Camel Context Metrics

Another way - if you are using Spring, Spring Boot has exporters built in to export metrics. On Mon, Aug 15, 2016 at 12:02 PM, Rajith Muditha Attapattu < rajit...@gmail.com> wrote: > Thank you James! > > On Mon, Aug 15, 2016 at 11:35 AM, James Strachan > wrote: > >

Re: how to poll a Spring Bean in a "from" in a route to get a List to process

ll > the bean to retrieve the list of elements to process and finally process > your elements. > > [1] http://camel.apache.org/timer.html > > > 2016-07-20 14:29 GMT+02:00 Mark Nuttall <mknutt...@gmail.com>: > > > As part of a "From" in a route, I need

how to poll a Spring Bean in a "from" in a route to get a List to process

As part of a "From" in a route, I need to able to "poll" (either by time or schedule) a spring bean (i.e. a Spring Service) and get a List<> by calling a bean's method,so that i can process each item in the list. I've looked at "bean" and "jpa" but i am not seeing this in "bean" and I am not