I am facing similar issues and the server eventually stops responding. danga version : 2.0.1 apache-tomcat : 6.0.32
Any suggestions/RCA would be appreciated . Thanks ! On Apr 3, 2:39 pm, selva <[email protected]> wrote: > My server application slow down some times due the following log > message on tomcat application > > com.danga.MemCached.SockIOPool Thu Mar 29 17:49:42 IST 2012 - +++ > removing potentially hung connection from busy pool ... socket in pool > for 56476ms > Got Datasource at 29/03/2012 17:50:36 > com.danga.MemCached.SockIOPool Thu Mar 29 17:50:36 IST 2012 - +++ > removing potentially hung connection from busy pool ... socket in pool > for 101792ms > com.danga.MemCached.SockIOPool Thu Mar 29 17:50:36 IST 2012 - +++ > removing potentially hung connection from busy pool ... socket in pool > for 67705ms > com.danga.MemCached.SockIOPool Thu Mar 29 17:50:36 IST 2012 - +++ > removing potentially hung connection from busy pool ... socket in pool > for 61006ms > com.danga.MemCached.SockIOPool Thu Mar 29 17:50:36 IST 2012 - +++ > removing potentially hung connection from busy pool ... socket in pool > for 61006ms > > Got Context at 29/03/2012 17:50:36 > Got Datasource at 29/03/2012 17:50:28 > com.danga.MemCached.MemCachedClient Thu Mar 29 17:49:55 IST 2012 - +++ > + deserializing class java.util.HashSet > com.danga.MemCached.SockIOPool$SockIO Thu Mar 29 17:50:57 IST 2012 - ++ > ++ attempting to read from closed socket > Got Initial Context at 29/03/2012 17:50:09 > com.danga.MemCached.SockIOPool Thu Mar 29 17:50:49 IST 2012 - ++++ > failed to close SockIO obj from deadPool > Got connection at 29/03/2012 17:50:36 > Got Context at 29/03/2012 17:51:03 > com.danga.MemCached.SockIOPool Thu Mar 29 17:50:57 IST 2012 - ++++ > socket or its streams already null in trueClose call > java.io.IOException: ++++ socket or its streams already null in > trueClose call > com.danga.MemCached.MemCachedClient Thu Mar 29 17:50:57 IST 2012 - +++ > + exception thrown while trying to get object from cache for key: > MEMCACHE_MANAGER_KEY > at com.danga.MemCached.SockIOPool > $SockIO.trueClose(SockIOPool.java:1704) > Got connection at 29/03/2012 17:51:03 > Got connection at 29/03/2012 17:51:16 > at com.danga.MemCached.SockIOPool.selfMaint(SockIOPool.java: > 1432) > at com.danga.MemCached.SockIOPool > $MaintThread.run(SockIOPool.java:1497) > com.danga.MemCached.SockIOPool Thu Mar 29 17:51:16 IST 2012 - ++++ > failed to close SockIO obj from deadPool > com.danga.MemCached.SockIOPool Thu Mar 29 17:51:16 IST 2012 - ++++ > socket or its streams already null in trueClose call > java.io.IOException: ++++ socket or its streams already null in > trueClose call > at com.danga.MemCached.SockIOPool > $SockIO.trueClose(SockIOPool.java:1704) > at com.danga.MemCached.SockIOPool.selfMaint(SockIOPool.java: > 1432) > at com.danga.MemCached.SockIOPool > $MaintThread.run(SockIOPool.java:1497) > com.danga.MemCached.SockIOPool Thu Mar 29 17:51:16 IST 2012 - ++++ > failed to close SockIO obj from deadPool > com.danga.MemCached.SockIOPool Thu Mar 29 17:51:16 IST 2012 - ++++ > socket or its streams already null in trueClose call > java.io.IOException: ++++ socket or its streams already null in > trueClose call > at com.danga.MemCached.SockIOPool > $SockIO.trueClose(SockIOPool.java:1704) > Got Initial Context at 29/03/2012 17:51:16 > at com.danga.MemCached.SockIOPool.selfMaint(SockIOPool.java: > 1432) > com.danga.MemCached.MemCachedClient Thu Mar 29 17:51:16 IST 2012 - +++ > + attempting to read from closed socket > at com.danga.MemCached.SockIOPool > $MaintThread.run(SockIOPool.java:1497) > com.danga.MemCached.SockIOPool Thu Mar 29 17:51:16 IST 2012 - ++++ > failed to close SockIO obj from deadPool > com.danga.MemCached.SockIOPool Thu Mar 29 17:51:16 IST 2012 - ++++ > socket or its streams already null in trueClose call > java.io.IOException: ++++ socket or its streams already null in > trueClose call > at com.danga.MemCached.SockIOPool > $SockIO.trueClose(SockIOPool.java:1704) > at com.danga.MemCached.SockIOPool.selfMaint(SockIOPool.java: > 1432) > at com.danga.MemCached.SockIOPool > $MaintThread.run(SockIOPool.java:1497) > java.io.IOException: ++++ attempting to read from closed socket > Got Datasource at 29/03/2012 17:51:03 > Got connection at 29/03/2012 17:51:16 > at com.danga.MemCached.SockIOPool > $SockIO.readLine(SockIOPool.java:1760) > at > com.danga.MemCached.MemCachedClient.get(MemCachedClient.java:1285) > at > com.danga.MemCached.MemCachedClient.get(MemCachedClient.java:1209) > at > com.vtech.tdpms.blackbox.cacheengine.MemoryCacheUtil.retrieveFromMemCache(M > emoryCacheUtil.java: > 98) > at > com.vtech.tdpms.blackbox.cacheengine.MemoryCacheUtil.addKeyToMemCacheMangr( > MemoryCacheUtil.java: > 141) > at > com.vtech.tdpms.blackbox.cacheengine.MemoryCacheUtil.addToMemCache(MemoryCa > cheUtil.java: > 34) > at > com.vtech.tdpms.blackbox.productimpl.helper.hotel.HotelSearchHelper.memCach > eResult(HotelSearchHelper.java: > 892) > at > com.vtech.appxtension.tdpms.blackbox.productimpl.helper.hotel.WrapHotelSear > chHelper.postSearchHTDBProcessing(WrapHotelSearchHelper.java: > 633) > at > com.vtech.appxtension.tdpms.blackbox.productimpl.helper.hotel.WrapHotelSear > chHelper.searchHotel(WrapHotelSearchHelper.java: > 131) > at > com.vtech.tdpms.blackbox.productimpl.helper.hotel.HotelSearchHelper.run(Hot > elSearchHelper.java: > 799) > at java.lang.Thread.run(Thread.java:619) > com.danga.MemCached.MemCachedClient Thu Mar 29 17:51:16 IST 2012 - +++ > + failed to close socket : > > OS:Centos 6 64bit > Tomcat:Apache Tomcat Version 6.0.18 > Java:java version "1.6.0_14" 64bit > memcached:memcached 1.4.13 > Libevent:libevent-2.0.17-stable > > Please suggest what can be done.
