Hi, We are using Apache ServiceMix (4.3.0-fuse-02-00) which is using Apache Camel(2.4.0.fuse-01-00) and we have services deployed in it. This services uses camel to communicate we each other through camel routes and are configured as below sample.
<!-- These routes are outbound to other services --> <route> <from uri="direct:com.config"/> <bean ref="enrichOutboundExchangeRef"/> <to uri="activemq:queue:com.config?transferException=true"/> </route> <!-- These routes are inbound to this service from all other services --> <route> <from uri="activemq:queue:com.config?transferException=true"/> <to uri="log:com.config.request?level=DEBUG"/> <bean ref="processInboundExchangeEnrichmentsRef"/> <bean ref="configServiceImpl"/> <to uri="log:com.config.response?level=DEBUG"/> </route> In the service, it is consumed as below @Produce(uri = "direct:com.config") private ConfigService configService; We are facing timeout issues when Service A calls Service B which calls Service C at Service B. The call from Service A to Service B is a simple call of validation which is done at Service C(Service B just forwads the request to Service C).Below is exceptions thrown in servicemix.log.Attached the complete log. 17:49:56,333 | DEBUG | qtp-10530939-301 | OutboundExchangeProcessor | ? ? | 147 - com.Common - 1.0.0.SNAPSHOT | Enrich Exchange with properties and headers 17:49:56,334 | WARN | qtp-10530939-301 | BrokerRegistry | ? ? | 43 - org.apache.activemq.activemq-core - 5.4.1.fuse-00-00 | Broker localhost not started so using default instead 17:50:16,586 | ERROR | qtp-10530939-301 | DefaultErrorHandler | ? ? | 69 - org.apache.camel.camel-core - 2.4.0.fuse-01-00 | Failed delivery for exchangeId: 5b161695-caab-4165-9d4e-67a7d201b17d. Exhausted after delivery attempt: 1 caught: org.apache.camel.ExchangeTimedOutException: The OUT message was not received within: 20000 millis. ExchangeMessage: BeanInvocation public abstract void com.service.task.config.ConfigService.authenticateIPAddress(java.lang.String,com.model.config.Component[) with [10.68.221.69, Lcom.model.config.Component;@1fec9db]] org.apache.camel.ExchangeTimedOutException: The OUT message was not received within: 20000 millis. ExchangeMessage: BeanInvocation public abstract void com.service.task.config.ConfigService.authenticateIPAddress(java.lang.String,com.model.config.Component[) with [10.68.221.69, Lcom.model.config.Component;@1fec9db]] at org.apache.camel.component.jms.JmsProducer.processInOut(JmsProducer.java:265) This issue we are seeing intermittenlty not sure of the exact reason why it happens. Since the servicemix.log is kinda of last resort for the logs and also we doubting where the concurrentConsumers(as shown below) is having any impact on this since we have specified to be 5 if we have 5 consumers at that point of time and 6th consumer will wait and might get timeout by 20 Secs if does not get handle to the queue. How to really rootcause this issue since the operation we are doing takes hardly a 1 or 2 Secs and default timeout is 20 Secs(20000 millis). Not sure if just by increasing the concurrentConsumers will solve this problems. <bean id="jmsConfig" class="org.apache.camel.component.jms.JmsConfiguration"> <property name="connectionFactory" ref="jmsConnectionFactory"/> <property name="concurrentConsumers" value="5"/> </bean> I posted same @ http://fusesource.com/forums/thread.jspa?threadID=2981&tstart=15 Thanks Ravi
17:49:56,333 | DEBUG | qtp-10530939-301 | OutboundExchangeProcessor | ? ? | 147 - com.Common - 1.0.0.SNAPSHOT | Enrich Exchange with properties and headers 17:49:56,334 | WARN | qtp-10530939-301 | BrokerRegistry | ? ? | 43 - org.apache.activemq.activemq-core - 5.4.1.fuse-00-00 | Broker localhost not started so using default instead 17:50:16,586 | ERROR | qtp-10530939-301 | DefaultErrorHandler | ? ? | 69 - org.apache.camel.camel-core - 2.4.0.fuse-01-00 | Failed delivery for exchangeId: 5b161695-caab-4165-9d4e-67a7d201b17d. Exhausted after delivery attempt: 1 caught: org.apache.camel.ExchangeTimedOutException: The OUT message was not received within: 20000 millis. Exchange[Message: BeanInvocation public abstract void com.service.task.config.ConfigService.authenticateIPAddress(java.lang.String,com.model.config.Component[]) with [10.68.221.69, [Lcom.model.config.Component;@1fec9db]]] org.apache.camel.ExchangeTimedOutException: The OUT message was not received within: 20000 millis. Exchange[Message: BeanInvocation public abstract void com.service.task.config.ConfigService.authenticateIPAddress(java.lang.String,com.model.config.Component[]) with [10.68.221.69, [Lcom.model.config.Component;@1fec9db]]] at org.apache.camel.component.jms.JmsProducer.processInOut(JmsProducer.java:265) at org.apache.camel.component.jms.JmsProducer.process(JmsProducer.java:147) at org.apache.camel.impl.converter.AsyncProcessorTypeConverter$ProcessorToAsyncProcessorBridge.process(AsyncProcessorTypeConverter.java:50) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.SendProcessor$2.doInAsyncProducer(SendProcessor.java:104) at org.apache.camel.impl.ProducerCache.doInAsyncProducer(ProducerCache.java:272) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:98) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:68) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.processor.interceptor.TraceInterceptor.process(TraceInterceptor.java:99) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:68) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.RedeliveryErrorHandler.processErrorHandler(RedeliveryErrorHandler.java:290) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:202) at org.apache.camel.processor.DefaultChannel.process(DefaultChannel.java:256) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.Pipeline.process(Pipeline.java:143) at org.apache.camel.processor.Pipeline.process(Pipeline.java:78) at org.apache.camel.processor.UnitOfWorkProcessor.process(UnitOfWorkProcessor.java:99) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:68) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:91) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:85) at org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:48) at org.apache.camel.component.bean.CamelInvocationHandler.invoke(CamelInvocationHandler.java:64) at $Proxy93.authenticateIPAddress(Unknown Source) at com.service.task.endpoint.EndpointImpl.authenticateIpaddress(EndpointImpl.java:4128) at com.service.task.endpoint.EndpointImpl.changeSystemState(EndpointImpl.java:836) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[:1.6.0_21] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)[:1.6.0_21] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[:1.6.0_21] at java.lang.reflect.Method.invoke(Method.java:597)[:1.6.0_21] at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:89)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.jaxws.JAXWSMethodInvoker.invoke(JAXWSMethodInvoker.java:60)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:75)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)[:1.6.0_21] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)[:1.6.0_21] at java.util.concurrent.FutureTask.run(FutureTask.java:138)[:1.6.0_21] at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:243)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:111)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiDestination.doMessage(OsgiDestination.java:80)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiServletController.invokeDestination(OsgiServletController.java:321)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiServletController.invoke(OsgiServletController.java:145)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiServlet.invoke(OsgiServlet.java:53)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.SpringOsgiServlet.invoke(SpringOsgiServlet.java:48)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)[78:org.apache.geronimo.specs.geronimo-servlet_2.5_spec:1.1.2] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.ops4j.pax.web.service.jetty.internal.HttpServiceServletHandler.handle(HttpServiceServletHandler.java:64)[83:org.ops4j.pax.web.pax-web-jetty:0.7.3] at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.handle(HttpServiceContext.java:111)[83:org.ops4j.pax.web.pax-web-jetty:0.7.3] at org.ops4j.pax.web.service.jetty.internal.JettyServerHandlerCollection.handle(JettyServerHandlerCollection.java:68)[83:org.ops4j.pax.web.pax-web-jetty:0.7.3] at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.Server.handle(Server.java:326)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:938)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:755)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] 17:50:16,672 | ERROR | qtp-10530939-301 | EndpointImpl | ? ? | 174 - com.EndpointService - 1.0.0.SNAPSHOT | ENDPOINT ERROR, CURRENT STEP: changeSystemState.auth (s/n: GWKY62S), EXCEPTION: null java.lang.reflect.UndeclaredThrowableException at $Proxy93.authenticateIPAddress(Unknown Source) at com.service.task.endpoint.EndpointImpl.authenticateIpaddress(EndpointImpl.java:4128) at com.service.task.endpoint.EndpointImpl.changeSystemState(EndpointImpl.java:836) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)[:1.6.0_21] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)[:1.6.0_21] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)[:1.6.0_21] at java.lang.reflect.Method.invoke(Method.java:597)[:1.6.0_21] at org.apache.cxf.service.invoker.AbstractInvoker.performInvocation(AbstractInvoker.java:173)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:89)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.jaxws.JAXWSMethodInvoker.invoke(JAXWSMethodInvoker.java:60)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.service.invoker.AbstractInvoker.invoke(AbstractInvoker.java:75)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.interceptor.ServiceInvokerInterceptor$1.run(ServiceInvokerInterceptor.java:58)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)[:1.6.0_21] at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)[:1.6.0_21] at java.util.concurrent.FutureTask.run(FutureTask.java:138)[:1.6.0_21] at org.apache.cxf.workqueue.SynchronousExecutor.execute(SynchronousExecutor.java:37)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.interceptor.ServiceInvokerInterceptor.handleMessage(ServiceInvokerInterceptor.java:106)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:243)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:111)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiDestination.doMessage(OsgiDestination.java:80)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiServletController.invokeDestination(OsgiServletController.java:321)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiServletController.invoke(OsgiServletController.java:145)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.OsgiServlet.invoke(OsgiServlet.java:53)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.http_osgi.SpringOsgiServlet.invoke(SpringOsgiServlet.java:48)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.handleRequest(AbstractHTTPServlet.java:179)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.doPost(AbstractHTTPServlet.java:103)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)[78:org.apache.geronimo.specs.geronimo-servlet_2.5_spec:1.1.2] at org.apache.cxf.transport.servlet.AbstractHTTPServlet.service(AbstractHTTPServlet.java:159)[119:org.apache.cxf.bundle:2.2.10.fuse-00-00] at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:390)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.ops4j.pax.web.service.jetty.internal.HttpServiceServletHandler.handle(HttpServiceServletHandler.java:64)[83:org.ops4j.pax.web.pax-web-jetty:0.7.3] at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:765)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.ops4j.pax.web.service.jetty.internal.HttpServiceContext.handle(HttpServiceContext.java:111)[83:org.ops4j.pax.web.pax-web-jetty:0.7.3] at org.ops4j.pax.web.service.jetty.internal.JettyServerHandlerCollection.handle(JettyServerHandlerCollection.java:68)[83:org.ops4j.pax.web.pax-web-jetty:0.7.3] at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.Server.handle(Server.java:326)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:938)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:755)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)[79:org.apache.servicemix.bundles.jetty-bundle:6.1.22.fuse] Caused by: org.apache.camel.ExchangeTimedOutException: The OUT message was not received within: 20000 millis. Exchange[Message: BeanInvocation public abstract void com.service.task.config.ConfigService.authenticateIPAddress(java.lang.String,com.model.config.Component[]) with [10.68.221.69, [Lcom.model.config.Component;@1fec9db]]] at org.apache.camel.component.jms.JmsProducer.processInOut(JmsProducer.java:265) at org.apache.camel.component.jms.JmsProducer.process(JmsProducer.java:147) at org.apache.camel.impl.converter.AsyncProcessorTypeConverter$ProcessorToAsyncProcessorBridge.process(AsyncProcessorTypeConverter.java:50) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.SendProcessor$2.doInAsyncProducer(SendProcessor.java:104) at org.apache.camel.impl.ProducerCache.doInAsyncProducer(ProducerCache.java:272) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:98) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:68) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.processor.interceptor.TraceInterceptor.process(TraceInterceptor.java:99) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:68) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.RedeliveryErrorHandler.processErrorHandler(RedeliveryErrorHandler.java:290) at org.apache.camel.processor.RedeliveryErrorHandler.process(RedeliveryErrorHandler.java:202) at org.apache.camel.processor.DefaultChannel.process(DefaultChannel.java:256) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.Pipeline.process(Pipeline.java:143) at org.apache.camel.processor.Pipeline.process(Pipeline.java:78) at org.apache.camel.processor.UnitOfWorkProcessor.process(UnitOfWorkProcessor.java:99) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:70) at org.apache.camel.processor.DelegateAsyncProcessor.processNext(DelegateAsyncProcessor.java:98) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:89) at org.apache.camel.management.InstrumentationProcessor.process(InstrumentationProcessor.java:68) at org.apache.camel.util.AsyncProcessorHelper.process(AsyncProcessorHelper.java:91) at org.apache.camel.processor.DelegateAsyncProcessor.process(DelegateAsyncProcessor.java:85) at org.apache.camel.component.direct.DirectProducer.process(DirectProducer.java:48) at org.apache.camel.component.bean.CamelInvocationHandler.invoke(CamelInvocationHandler.java:64) ... 44 more