Thanks Dan! I too have no clue. Service hosting people enabled sharkwire and they said, they are getting the requests without body. When I checked the http stack trace where our log4j enabled to degug for all including application debug and 3rd party jars, I see content as null.
However, I restarted the server with log4j level as error and the issue is gone without any fix. To replicate the issue, I changed log4j back to debug for all and I see issue again. I repeated it at least 4 times, each time I set log4j to debug for all, including application and 3rd party libs, I see the following issue. I'm not sure how they are related but this is how we can reproduce the issue and fix the issue. Thanks, Shak On Mon, Nov 5, 2012 at 1:52 PM, Daniel Kulp <[email protected]> wrote: > > On Nov 5, 2012, at 10:15 AM, Shak S <[email protected]> wrote: > > > CXF users/team, > > I've WS client that is configured in spring using jax-ws with help of > CXF. > > While the client is calling the service, I see the following exception > but > > it is not recurring. My Client is running on top of weblogic 10. > > > > My question is, who is closing the socket. Is it client or server? How do > > we exactly know from which side I need to troubleshoot the issue. Service > > hosting folks say they could not see any error logs at their end. > > No idea really. The stack trace shows that CXF is trying to flush and > close the output stream. Thus, it looks like the other side has closed > the connection, but no idea why. Since this is an SSL connection, you > could likely turn on the SSL debug traces via the system property: > -Djavax.net.debug=all and see if any information is useful from that, but > that will spit out a TON of stuff. > > Dan > > > > > Thanks, > > Shak > > > > org.apache.cxf.interceptor.Fault: Could not send Message. > >> at > > > org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:64) > >> at > > > org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263) > >> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:269) > >> at > > org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:124) > >> at $Proxy110.addToCart(Unknown Source) > >> at > > > com.frequencymarketing.citi.view.http.struts.action.rewards.client.AddToCartAction.execute(AddToCartAction.java:69) > >> at > > > com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:118) > >> at > > > org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224) > >> at > > org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196) > >> at > > org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:434) > >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:821) > >> at > > > weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227) > >> at > > > weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292) > >> at > > weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:27) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:143) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:71) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.common.app.perf.track.values.PerfDeltaTime.stopTime(PerfDeltaTime.java:70) > >> at > > > com.frequencymarketing.common.app.perf.track.PerfManager.stop(PerfManager.java:82) > >> at > > > com.frequencymarketing.common.app.perf.track.PerfManager.stopCount(PerfManager.java:93) > >> at > > > com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:57) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > weblogicx.servlet.gzip.filter.GZIPFilter.doFilter(GZIPFilter.java:70) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:738) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.VanityURLFilter.doFilter(VanityURLFilter.java:91) > >> at > > > weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496) > >> at > > > weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321) > >> at > > > weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086) > >> at > > > weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406) > >> at weblogic.work.ExecuteThread.run(ExecuteThread.java:173) > >> *Caused by: java.net.SocketException: SocketException invoking > > https://servciehost.com/service: Socket is closed* > >> at > > sun.reflect.GeneratedConstructorAccessor1942.newInstance(Unknown Source) > >> at > > > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > >> at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > >> at > > > org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.mapException(HTTPConduit.java:1385) > >> at > > > org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.close(HTTPConduit.java:1370) > >> at > > > org.apache.cxf.io.CacheAndWriteOutputStream.postClose(CacheAndWriteOutputStream.java:47) > >> at > > org.apache.cxf.io.CachedOutputStream.close(CachedOutputStream.java:188) > >> at > > org.apache.cxf.transport.AbstractConduit.close(AbstractConduit.java:56) > >> at > > org.apache.cxf.transport.http.HTTPConduit.close(HTTPConduit.java:614) > >> at > > > org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:62) > >> at > > > org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:263) > >> at > org.apache.cxf.endpoint.ClientImpl.doInvoke(ClientImpl.java:484) > >> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:414) > >> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:317) > >> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:269) > >> at > > org.apache.cxf.frontend.ClientProxy.invokeSync(ClientProxy.java:73) > >> at > > org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:124) > >> at $Proxy110.addToCart(Unknown Source) > >> at > > > com.frequencymarketing.citi.view.http.struts.action.rewards.client.AddToCartAction.execute(AddToCartAction.java:69) > >> at > > > com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:186) > >> at > > > com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:118) > >> at > > > org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:419) > >> at > > > org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224) > >> at > > org.apache.struts.action.ActionServlet.process(ActionServlet.java:1194) > >> at > > org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432) > >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) > >> at > > > weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227) > >> at > > > weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125) > >> at > > > weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292) > >> at > > weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > > com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:141) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > > com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:69) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > > com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:55) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > > com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > weblogicx.servlet.gzip.filter.GZIPFilter.doFilter(GZIPFilter.java:70) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > > org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:738) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:42) > >> at > > > com.frequencymarketing.citi.view.http.servlet.VanityURLFilter.doFilter(VanityURLFilter.java:91) > >> at > > > weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2180) > >> at > > > weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086) > >> at > > > weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406) > >> at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201) > >> ... 1 more > > *> Caused by: java.net.SocketException: Socket is closed* > > *> at > > > com.sun.net.ssl.internal.ssl.SSLSocketImpl.checkEOF(SSLSocketImpl.java:1316) > > * > >> at > > > com.sun.net.ssl.internal.ssl.SSLSocketImpl.checkWrite(SSLSocketImpl.java:1337) > >> at > > > com.sun.net.ssl.internal.ssl.AppOutputStream.write(AppOutputStream.java:44) > >> at > > java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:66) > >> at > > java.io.BufferedOutputStream.flush(BufferedOutputStream.java:124) > >> at java.io.FilterOutputStream.flush(FilterOutputStream.java:124) > >> at > > > weblogic.net.http.ContentLengthOutputStream.close(ContentLengthOutputStream.java:56) > >> at > > > org.apache.cxf.io.CacheAndWriteOutputStream.closeFlowthroughStream(CacheAndWriteOutputStream.java:43) > >> at > > > org.apache.cxf.transport.http.HTTPConduit$WrappedOutputStream.close(HTTPConduit.java:1352) > >> at > > > org.apache.cxf.io.CacheAndWriteOutputStream.postClose(CacheAndWriteOutputStream.java:48) > >> at > > org.apache.cxf.io.CachedOutputStream.close(CachedOutputStream.java:189) > >> at > > org.apache.cxf.transport.AbstractConduit.close(AbstractConduit.java:56) > >> at > > org.apache.cxf.transport.http.HTTPConduit.close(HTTPConduit.java:614) > >> at > > > org.apache.cxf.interceptor.MessageSenderInterceptor$MessageSenderEndingInterceptor.handleMessage(MessageSenderInterceptor.java:62) > >> at > > > org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:264) > >> at org.apache.cxf.endpoint.ClientImpl.invoke(ClientImpl.java:269) > >> at > > org.apache.cxf.jaxws.JaxWsClientProxy.invoke(JaxWsClientProxy.java:124) > >> at $Proxy110.addToCart(Unknown Source) > >> at > > > com.frequencymarketing.citi.view.http.struts.action.rewards.client.AddToCartAction.execute(AddToCartAction.java:69) > >> at > > > com.frequencymarketing.citi.view.http.struts.BaseAction.execute(BaseAction.java:118) > >> at > > > org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224) > >> at > > org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196) > >> at > > org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:434) > >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:727) > >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:821) > >> at > > > weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227) > >> at > > > weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292) > >> at > > weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:27) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:143) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:71) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.common.app.perf.track.values.PerfDeltaTime.stopTime(PerfDeltaTime.java:70) > >> at > > > com.frequencymarketing.common.app.perf.track.PerfManager.stop(PerfManager.java:82) > >> at > > > com.frequencymarketing.common.app.perf.track.PerfManager.stopCount(PerfManager.java:93) > >> at > > > com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:57) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.AuthFilter.doFilter(AuthFilter.java:143) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.common.view.http.servlet.LoggerFilterBase.doFilter(LoggerFilterBase.java:71) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.common.app.perf.track.values.PerfDeltaTime.stopTime(PerfDeltaTime.java:70) > >> at > > > com.frequencymarketing.common.app.perf.track.PerfManager.stop(PerfManager.java:82) > >> at > > > com.frequencymarketing.common.app.perf.track.PerfManager.stopCount(PerfManager.java:93) > >> at > > > com.frequencymarketing.common.view.http.servlet.TimerFilter.doFilter(TimerFilter.java:57) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.SessionFilter.doFilter(SessionFilter.java:114) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > weblogicx.servlet.gzip.filter.GZIPFilter.doFilter(GZIPFilter.java:70) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > org.tuckey.web.filters.urlrewrite.UrlRewriteFilter.doFilter(UrlRewriteFilter.java:738) > >> at > > > weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:43) > >> at > > > com.frequencymarketing.citi.view.http.servlet.VanityURLFilter.doFilter(VanityURLFilter.java:91) > >> at > > > weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3496) > >> at > > > weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321) > >> at > > > weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2086) > >> at > > > weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1406) > >> ... 1 more > > -- > Daniel Kulp > [email protected] - http://dankulp.com/blog > Talend Community Coder - http://coders.talend.com > >
