To review what was running on the JVM when you perform the kill -3 you can use IBM's Thread and Monitor Dump Analyzer ( http://www.alphaworks.ibm.com/tech/jca). HTH
Luciano On Tue, Jul 19, 2011 at 11:09 AM, Kevan Miller <[email protected]>wrote: > > On Jul 19, 2011, at 8:04 AM, ranbaab wrote: > > > Hi Kevan, > > > > First I would like to thank you for your valuable advice and support. > > > > Below are the steps followed to get the dump, please let me know if I > miss > > any steps > > > > 1. Command for undeploy > > > > [root@fc70 bin]# ./deploy.sh --user system --password manager undeploy > > ibm/bhm/application/war > > Using GERONIMO_HOME: /opt/ibm/BLADEHarmonyManager/webserver > > Using GERONIMO_TMPDIR: var/temp > > Using JRE_HOME: /usr/java/ibm-java-i386-60/jre > > > > It stuck here, no further message .... > > > > > > 2. Check for the PID (another console) > > > > [root@fc70 ~]# ps -ef | grep java > > root 4716 1 1 16:01 ? 00:00:59 xxxxdataBase > > root 5701 1 6 16:52 pts/1 00:00:33 xxxxApplication > > root 5788 5784 3 16:56 pts/1 00:00:09 xxxxxApplication > > bin/deployer.jar --user system --password manager undeploy > /application/war > > root 5844 5546 0 17:00 pts/2 00:00:00 grep java > > > > *This means that the server PID is 5701 and undeploy command PID is > 5788.* > > > > 3. Command to generate java stack traces > > [root@fc70 ~]# kill -3 5701 > > > > The above command generate a dump in the folder bin. > > > > *Some last line from the file.* > > > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/model/LocalEjbType(0x0BB75D60) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/model/ResourceType(0x0BB75E80) > > 3CLTEXTCLASS > > org/apache/geronimo/tomcat/model/ResourceEnvRefType(0x0BB761C0) > > 3CLTEXTCLASS > > org/apache/geronimo/tomcat/model/ServiceRefType(0x0BB762B0) > > 3CLTEXTCLASS > > org/apache/geronimo/tomcat/model/TransactionType(0x0BB763A0) > > 3CLTEXTCLASS > > > org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_emptySessionPath(0x0BB764C0) > > 3CLTEXTCLASS > > > org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_enableLookups(0x0BB76640) > > 3CLTEXTCLASS > > > org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_maxPostSize(0x0BB767C0) > > 3CLTEXTCLASS > > > org/apache/geronimo/tomcat/model/ConnectorType$JaxbAccessorF_maxSavePostSize(0x0BB76940) > > 3CLTEXTCLASS > org/apache/catalina/connector/Connector(0x0BB69410) > > 3CLTEXTCLASS > org/apache/catalina/Container(0x0BB6A3F0) > > 3CLTEXTCLASS > org/apache/catalina/Context(0x0BB6A720) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/TomcatContext(0x0BB6B090) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/TomcatWebContainer(0x0BA0E7F0) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/TomcatContainer(0x0BA0E900) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/ObjectRetriever(0x0BA0F0E0) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/BaseGBean(0x0BA0F1B0) > > 3CLTEXTCLASS > > org/apache/geronimo/tomcat/LifecycleListenerGBean(0x0BA0F330) > > 3CLTEXTCLASS > org/apache/catalina/Lifecycle(0x0BA0F670) > > 3CLTEXTCLASS > > org/apache/geronimo/tomcat/TomcatServerConfigManager(0x0BB2B340) > > 3CLTEXTCLASS > org/apache/catalina/Server(0x0BB2B720) > > 3CLTEXTCLASS > org/apache/catalina/Service(0x0BB2B8B0) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/TomcatServerGBean(0x0BB2ACE0) > > 3CLTEXTCLASS > org/apache/geronimo/tomcat/TomcatManagerImpl(0x0BA94030) > > 2CLTEXTCLLOAD Loader > > > org/apache/geronimo/kernel/config/ChildrenConfigurationClassLoader(0xA87926B0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA9924328) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor139(0x0C809E90) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA9929C30) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor140(0x0C80A240) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA9935C78) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor141(0x0C80B3A0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA993B688) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor142(0x0C80B6F0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA993FD30) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor143(0x0C80C440) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA99486D8) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor144(0x0C80C790) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA994DFC8) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor69(0x0C80CAE0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA99581A0) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor145(0x0C80F1F0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA92C7850) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA92D4580) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA0E65D8) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor146(0x0C7D8530) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA0ECB10) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor147(0x0C7D88E0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA0F3620) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor148(0x0C7D9160) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA100AB0) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor149(0x0C7D99E0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA105C60) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor70(0x0C7DA900) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA92E12B8) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA114AA8) > > 3CLTEXTCLASS > > sun/reflect/GeneratedSerializationConstructorAccessor150(0x0C7DAD90) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA92EE170) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA131020) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor71(0x0C7DB610) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA92FAF28) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9307D90) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9314B10) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93218B0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA932E7D0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA933B4F0) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA17F920) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor72(0x0C7DE160) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA18D218) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor73(0x0C7DD8D0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9348300) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA193790) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor74(0x0C7DF790) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9355428) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93635E0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9375180) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9382040) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA938F6A8) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA1E0BA0) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor75(0x0C7E0190) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA939C460) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xAA1EEA50) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor76(0x0C7E0730) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93A9180) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93B60B8) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93C57D0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93D25B8) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93DF4D0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93EC2F8) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA93F9138) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9406108) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9412EB8) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA941FD68) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA942CB38) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9439948) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9446810) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94536C0) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9462508) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA946F290) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA947EA98) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94875C8) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA9490E10) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA949A3A8) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94AED70) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94B8550) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94CE570) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94DE100) > > 2CLTEXTCLLOAD Loader > > com/sun/jmx/remote/util/OrderClassLoaders(0xA94EDAD8) > > 2CLTEXTCLLOAD Loader > sun/reflect/DelegatingClassLoader(0xA979B258) > > 3CLTEXTCLASS > sun/reflect/GeneratedMethodAccessor77(0x0AA6E170) > > NULL > > ------------------------------------------------------------------------ > > 0SECTION Javadump End section > > NULL ---------------------- END OF DUMP > > ------------------------------------- > > > > > > I am not able to understand anything from the dump. > > > > Note: - Our application has its own jre. > > The UI cannot be launch. > > No clue in the geronimo.log > > That's obviously an IBM JRE. There's a section int the dump with the Thread > stack traces. Agreed that it's not easy to read... But the data should be in > there. If you can post the dump where we can download it, I expect someone > can take a look at it. Two choices -- a site of your own choosing or create > a Geronimo Jira and attach the dump file to the Jira issue. Here's a pointer > to the Geronimo Jira -- https://issues.apache.org/jira/browse/GERONIMO > > --kevan
