Hi, I am trying to load balance operations in two instances of servicemix. Both instances of servicemix have the same services.
The load is balancing well in a round robin fashion. The back end webservice is being called. However the response from the backend is lost in the servicemix http unit and I get a error message at the front end. I have pasted the logs of the two instances below Same services are available in both systems output in instance A 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | Jsr181Component | emix.common.AsyncBaseLifeCycle 468 | Received exchange: status: Active, role: provider 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | Jsr181Component | emix.common.AsyncBaseLifeCycle 536 | Retrieved correlation id: ID:10.20.3.92-11bd4a60cba-10:5 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | JbiTransport | emix.jsr181.xfire.JbiTransport 62 | Creating new channel for uri: urn:xfire:transport:jbi:121904840075013188119777 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | DefaultEndpoint | fire.transport.DefaultEndpoint 36 | Received message to null 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase dispatch 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase dispatch 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase dispatch 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase service 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase service 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase transport 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase parse 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase pre-dispatch 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase dispatch 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.handler.LocateBindingHandler in phase dispatch 14:03:20,750 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.soap.handler.SoapBodyHandler in phase dispatch 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.handler.DispatchServiceHandler in phase dispatch 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase send 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase policy 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase user 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase pre-invoke 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase service 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.service.binding.ServiceInvocationHandler in phase service 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | XFireProxy | dehaus.xfire.client.XFireProxy 50 | Method [getSCMItem] [<getSCMItem xmlns="http://www.ibm.com/xmlns/db2/cm/api/1.0/schema"> <AuthenticationData connectString="SCHEMA=ICMADMIN" configString=""> <ServerDef> <ServerType>ICM</ServerType> <ServerName>ICMNLSDB</ServerName> </ServerDef> <LoginData> <UserID>scmuser</UserID> <Password>123</Password> </LoginData> </AuthenticationData> <QueryItemRequest QueryCriteria="usersNames" QueryString=""> </QueryItemRequest> </getSCMItem> ] 14:03:20,781 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 64 | adding handler [EMAIL PROTECTED] to phase send 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase post-invoke 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase policy 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase user 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase transport 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase send 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.handler.OutMessageSender in phase send 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | Jsr181Component | emix.common.AsyncBaseLifeCycle 593 | Correlation id retrieved from ThreadLocal: ID:10.20.3.92-11bd4a60cba-10:5 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 458 | SendSync ID:10.20.3.92-11bd4ac8cc6-3:4 in DeliveryChannel{servicemix-jsr181} 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | SecuredBroker | mix.jbi.security.SecuredBroker 66 | send exchange with secure broker 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | SecuredBroker | mix.jbi.security.SecuredBroker 72 | service name :{http://scm}SCMService 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | SecuredBroker | mix.jbi.security.SecuredBroker 73 | operation name :getSCMItem 14:03:20,796 | DEBUG | pool-flow.jms-thread-12 | JMSFlow | emix.jbi.nmr.flow.AbstractFlow 118 | Called Flow send 14:03:20,953 | DEBUG | pool-flow.jms-thread-12 | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 693 | Waiting for exchange ID:10.20.3.92-11bd4ac8cc6-3:4 (1cc8dc9) to be answered in DeliveryChannel{servicemix-jsr181} from sendSync 14:03:25,109 | DEBUG | pool-flow.jms-thread-13 | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 710 | Notifying exchange ID:10.20.3.92-11bd4ac8cc6-3:4(1cc8dc9) in DeliveryChannel{servicemix-jsr181} from processInboundSynchronousExchange 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 704 | Notified: ID:10.20.3.92-11bd4ac8cc6-3:4(1cc8dc9) in DeliveryChannel{servicemix-jsr181} from sendSync 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | JbiProxyFactoryBean | .xfire.JbiProxy$JAXWSJBIClient 244 | XFireFault has no details 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.service.binding.PostInvocationHandler in phase service 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase post-invoke 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase policy 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase user 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase transport 14:03:25,109 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 115 | Invoking phase send 14:03:25,125 | DEBUG | pool-flow.jms-thread-12 | HandlerPipeline | .xfire.handler.HandlerPipeline 129 | Invoking handler org.codehaus.xfire.handler.OutMessageSender in phase send 14:03:25,125 | DEBUG | pool-flow.jms-thread-12 | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 425 | Send ID:10.20.3.92-11bd4a60cba-10:5 in DeliveryChannel{servicemix-jsr181} 14:03:25,125 | DEBUG | pool-flow.jms-thread-12 | SecuredBroker | mix.jbi.security.SecuredBroker 66 | send exchange with secure broker 14:03:25,125 | DEBUG | pool-flow.jms-thread-12 | JMSFlow | emix.jbi.nmr.flow.AbstractFlow 118 | Called Flow send 14:03:25,250 | DEBUG | pool-flow.jms-thread-14 | Jsr181Component | emix.common.AsyncBaseLifeCycle 468 | Received exchange: status: Done, role: provider 14:03:25,250 | DEBUG | pool-flow.jms-thread-14 | Jsr181Component | emix.common.AsyncBaseLifeCycle 536 | Retrieved correlation id: ID:10.20.3.92-11bd4a60cba-10:5 ----------------------------------------------------------------------------------------------------------------------------------------------------------------- output in instance B 14:03:20,656 | DEBUG | btpool1-1 - Acceptor0 [EMAIL PROTECTED]:8192 | JettyContextManager | ntextManager$ThreadPoolWrapper 465 | Dispatching job: [EMAIL PROTECTED],io=0,w=true,b=false|false] 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | REQUEST /vdss/ on [EMAIL PROTECTED] 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | servlet=jbiServlet 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | chain=null 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | servlet holder=jbiServlet 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | ConsumerProcessor | p.processors.ConsumerProcessor 124 | Receiving HTTP request: POST /vdss/ HTTP/1.1 Content-Type: text/xml;charset=UTF-8 SOAPAction: "" User-Agent: Jakarta Commons-HttpClient/3.0.1 Host: localhost:8192 Content-Length: 881 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | HttpComponent | emix.common.AsyncBaseLifeCycle 587 | Created correlation id: ID:10.20.3.92-11bd4a60cba-10:5 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 425 | Send ID:10.20.3.92-11bd4a60cba-10:5 in DeliveryChannel{servicemix-http} 14:03:20,656 | DEBUG | btpool1-2 - /vdss/ | SecuredBroker | mix.jbi.security.SecuredBroker 66 | send exchange with secure broker 14:03:20,687 | DEBUG | btpool1-2 - /vdss/ | SecuredBroker | mix.jbi.security.SecuredBroker 72 | service name :{http://vdssfrontend}Vdssfrontend 14:03:20,687 | DEBUG | btpool1-2 - /vdss/ | SecuredBroker | mix.jbi.security.SecuredBroker 73 | operation name :{http://vdssfrontend}vdssSCMItem 14:03:20,687 | DEBUG | btpool1-2 - /vdss/ | JMSFlow | emix.jbi.nmr.flow.AbstractFlow 118 | Called Flow send 14:03:20,703 | DEBUG | btpool1-2 - /vdss/ | ConsumerProcessor | p.processors.ConsumerProcessor 163 | Suspending continuation for exchange: ID:10.20.3.92-11bd4a60cba-10:5 14:03:20,718 | DEBUG | btpool1-2 | jetty | ervicemix.http.jetty.JCLLogger 70 | continuation [EMAIL PROTECTED],pending 14:03:20,984 | DEBUG | pool-flow.jms-thread-9 | HttpComponent | emix.common.AsyncBaseLifeCycle 468 | Received exchange: status: Active, role: provider 14:03:20,984 | DEBUG | pool-flow.jms-thread-9 | HttpComponent | emix.common.AsyncBaseLifeCycle 536 | Retrieved correlation id: ID:10.20.3.92-11bd4a60cba-10:5 14:03:24,984 | ERROR | pool-flow.jms-thread-9 | HttpComponent | ervicemix.common.BaseLifeCycle 48 | Error processing exchange InOut[ id: ID:10.20.3.92-11bd4ac8cc6-3:4 status: Active role: provider service: {http://scm}SCMService endpoint: SCMService operation: getSCMItem in: <?xml version="1.0" encoding="UTF-8"?><getSCMItem xmlns="http://scm"><sRequestXML><getSCMItem xmlns="http://www.ibm.com/xmlns/db2/cm/api/1.0/schema"> <AuthenticationData connectString="SCHEMA=ICMADMIN" configString=""> <ServerDef> <ServerType>ICM</ServerType> <ServerName>ICMNLSDB</ServerName> </ServerDef> <LoginData> <UserID>scmuser</UserID> <Password>123</Password> </LoginData> </AuthenticationData> <QueryItemRequest QueryCriteria="usersNames" QueryString=""> </QueryItemRequest> </getSCMItem> </sRequestXML></getSCMItem> ] java.net.ConnectException: Connection refused: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:333) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:195) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:519) at java.net.Socket.connect(Socket.java:469) at java.net.Socket.<init>(Socket.java:366) at java.net.Socket.<init>(Socket.java:240) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:79) at org.apache.commons.httpclient.protocol.DefaultProtocolSocketFactory.createSocket(DefaultProtocolSocketFactory.java:121) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:706) at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1321) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:386) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:170) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:396) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:346) at org.apache.servicemix.http.processors.ProviderProcessor.process(ProviderProcessor.java:168) at org.apache.servicemix.common.AsyncBaseLifeCycle.doProcess(AsyncBaseLifeCycle.java:538) at org.apache.servicemix.common.AsyncBaseLifeCycle.processExchange(AsyncBaseLifeCycle.java:490) at org.apache.servicemix.common.BaseLifeCycle.onMessageExchange(BaseLifeCycle.java:46) at org.apache.servicemix.jbi.messaging.DeliveryChannelImpl.processInBound(DeliveryChannelImpl.java:610) at org.apache.servicemix.jbi.nmr.flow.AbstractFlow.doRouting(AbstractFlow.java:172) at org.apache.servicemix.jbi.nmr.flow.jms.AbstractJMSFlow.access$201(AbstractJMSFlow.java:63) at org.apache.servicemix.jbi.nmr.flow.jms.AbstractJMSFlow$4.run(AbstractJMSFlow.java:521) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619) 14:03:25,000 | DEBUG | pool-flow.jms-thread-9 | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 425 | Send ID:10.20.3.92-11bd4ac8cc6-3:4 in DeliveryChannel{servicemix-http} 14:03:25,000 | DEBUG | pool-flow.jms-thread-9 | SecuredBroker | mix.jbi.security.SecuredBroker 66 | send exchange with secure broker 14:03:25,000 | DEBUG | pool-flow.jms-thread-9 | JMSFlow | emix.jbi.nmr.flow.AbstractFlow 118 | Called Flow send 14:03:25,187 | DEBUG | pool-flow.jms-thread-10 | HttpComponent | emix.common.AsyncBaseLifeCycle 468 | Received exchange: status: Active, role: consumer 14:03:25,187 | DEBUG | pool-flow.jms-thread-10 | HttpComponent | emix.common.AsyncBaseLifeCycle 536 | Retrieved correlation id: ID:10.20.3.92-11bd4a60cba-10:5 14:03:25,187 | DEBUG | pool-flow.jms-thread-10 | ConsumerProcessor | p.processors.ConsumerProcessor 101 | Resuming continuation for exchange: ID:10.20.3.92-11bd4a60cba-10:5 14:03:25,187 | DEBUG | btpool1-1 - Acceptor0 [EMAIL PROTECTED]:8192 | JettyContextManager | ntextManager$ThreadPoolWrapper 465 | Dispatching job: [EMAIL PROTECTED],pending,resumed 14:03:25,187 | DEBUG | btpool1-2 | jetty | ervicemix.http.jetty.JCLLogger 70 | resume continuation [EMAIL PROTECTED],pending,resumed 14:03:25,187 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | REQUEST /vdss/ on [EMAIL PROTECTED] 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | servlet=jbiServlet 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | chain=null 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | servlet holder=jbiServlet 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | ConsumerProcessor | p.processors.ConsumerProcessor 124 | Receiving HTTP request: POST /vdss/ HTTP/1.1 Content-Type: text/xml;charset=UTF-8 SOAPAction: "" User-Agent: Jakarta Commons-HttpClient/3.0.1 Host: localhost:8192 Content-Length: 881 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | DeliveryChannelImpl | .messaging.DeliveryChannelImpl 425 | Send ID:10.20.3.92-11bd4a60cba-10:5 in DeliveryChannel{servicemix-http} 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | SecuredBroker | mix.jbi.security.SecuredBroker 66 | send exchange with secure broker 14:03:25,203 | DEBUG | btpool1-2 - /vdss/ | JMSFlow | emix.jbi.nmr.flow.AbstractFlow 118 | Called Flow send 14:03:25,234 | DEBUG | btpool1-2 - /vdss/ | jetty | ervicemix.http.jetty.JCLLogger 70 | RESPONSE /vdss/ 200 14:03:25,234 | DEBUG | btpool1-2 | jetty | ervicemix.http.jetty.JCLLogger 70 | continuation still pending null 14:03:25,250 | DEBUG | btpool1-2 | jetty | ervicemix.http.jetty.JCLLogger 70 | continuation [EMAIL PROTECTED] Pls let me know how to solve the problem. Regards, Ganesh -- View this message in context: http://www.nabble.com/Problems-with-Load-balancing-tp19028232p19028232.html Sent from the ServiceMix - User mailing list archive at Nabble.com.
