Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-10 Thread Bradley Wagner
I've tried each of the aforementioned GC options individually with the following other parameters: JAVA_OPTS=GC Param -Xms368m -Xmx512m -XX:MaxPermSize=128m -XX:+PrintGC -XX:+PrintGCDetails -Djava.awt.headless=true -Dfile.encoding=UTF-8 The *only option* that did not cause the startup process to

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-10 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 The *only option* that did not cause the startup process to halt indefinitely on startup was the Serial GC option. This is really

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-10 Thread Bradley Wagner
A couple of other findings: - Tomcat 5.5.28 out-of-the-box with its default webapps has no problem starting with the default (parallel) gc - As soon as I remove the default webapps, add ours, and modify the context.xml file to provide it a DataSource, Tomcat hangs. We're definitely loading a lot

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-07 Thread lmk
Hi, I have the same problem using tomcat 6 and jdk 6, do you find a workaround ? Regards! Mark Thomas wrote: Bradley Wagner wrote: Ok, I'll try that next. Two things: - Did some searching, but couldn't find how to determine the default GC method for my Java version

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Hmm, I'm going to try again with more explicit PermGen space as it seems to be out of it. - Bradley On Thu, Sep 3, 2009 at 3:51 PM, Bradley Wagner bradley.wag...@hannonhill.com wrote: And again in a new place on subsequent attempt. I've attached the logging this time because the amount of

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 Hmm, I'm going to try again with more explicit PermGen space as it seems to be out of it. Try it, but I'd be surprised if it had any

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
This is odd. After setting permgen to 128m with -XX:MaxPermSize=128m I'm seeing it hang again. What's odd is that the PermGen space appears to be totally used up at 26MB and not expanding, unless I'm reading it wrong. Heap after GC invocations=10 (full 0): PSYoungGen total 47296K, used 2831K

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 What's odd is that the PermGen space appears to be totally used up at 26MB and not expanding, unless I'm reading it wrong. You're

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 And again in a new place on subsequent attempt. There's nothing unusual that I can see in the traces, so it looks like you will have

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Ok, I'll try that next. Two things: - Did some searching, but couldn't find how to determine the default GC method for my Java version - Would you recommend I move this problem elsewhere, given that this is likely not related to Tomcat at all. I don't want to spam this list. Thanks, Bradley On

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 - Did some searching, but couldn't find how to determine the default GC method for my Java version You appear to be running the

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Mark Thomas
Bradley Wagner wrote: Ok, I'll try that next. Two things: - Did some searching, but couldn't find how to determine the default GC method for my Java version http://blogs.sun.com/watt/resource/jvm-options-list.html is a useful reference - Would you recommend I move this problem elsewhere,

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Ziggy
I noticed that you mention that you are using the community version of the Java runtime environment which i think is what you get when you do an apt-get. I have never honestly been able to use this version of the JVM successfully. I had a similar problem recently where i was running an

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Sorry, are you saying that the JRE I'm getting when doing apt-get install sun-java6-jdk is not actually a Sun certified version and that I should be downloading it directly from their website instead? On Thu, Sep 3, 2009 at 3:50 AM, Ziggy zigg...@gmail.com wrote: I noticed that you mention that

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 are you saying that the JRE I'm getting when doing apt-get install sun-java6-jdk is not actually a Sun certified version and that I

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Yea, I don't think it's the Open JDK, though that was an option. java -version gives: java version 1.6.0_14 Java(TM) SE Runtime Environment (build 1.6.0_14-b08) Java HotSpot(TM) Server VM (build 14.0-b16, mixed mode) - Bradley On Thu, Sep 3, 2009 at 10:19 AM, Ziggy zigg...@gmail.com wrote:

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread ramzi khlil
It provides you the version of installed java. On Thu, Sep 3, 2009 at 10:19 AM, Ziggy zigg...@gmail.com wrote: What do you get when you run java -version? I think the linux distributions include the open jdk version see http://openjdk.java.net/ On Thu, Sep 3, 2009 at 3:13 PM, Caldarale,

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Ziggy
Ok my mistake. Thats the official SUN version. The linux distribution i use downloads the openjdk version and i had to manually download the official one to stop the memory errors. On Thu, Sep 3, 2009 at 3:29 PM, ramzi khlil ramzi.atv...@gmail.com wrote: It provides you the version of

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 java version 1.6.0_14 Java(TM) SE Runtime Environment (build 1.6.0_14-b08) Java HotSpot(TM) Server VM (build 14.0-b16, mixed mode)

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Ziggy
What do you get when you run java -version? I think the linux distributions include the open jdk version see http://openjdk.java.net/ On Thu, Sep 3, 2009 at 3:13 PM, Caldarale, Charles R chuck.caldar...@unisys.com wrote: From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com]

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Is JConsole something that comes bundled with the JRE or JDK or a separate application. I have limited ability to install other things on this machine because it belongs to a client. Thanks, Bradley On Thu, Sep 3, 2009 at 10:32 AM, Caldarale, Charles R chuck.caldar...@unisys.com wrote: From:

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Probably unrelated, but... when setting JAVA_HOME for Tomcat in Ubuntu what's the difference between: - /usr/lib/jvm/java-6-sun, and - /usr/lib/jvm/java-6-sun/jre It doesn't seem to have any effect on my problem, but does it make a difference? I believe I have the full JDK installed so maybe the

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Mark Thomas
Bradley Wagner wrote: Probably unrelated, but... when setting JAVA_HOME for Tomcat in Ubuntu what's the difference between: - /usr/lib/jvm/java-6-sun, and - /usr/lib/jvm/java-6-sun/jre It doesn't seem to have any effect on my problem, but does it make a difference? I believe I have the

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 Is JConsole something that comes bundled with the JRE or JDK or a separate application. It's part of the JDK, but not the JRE. -

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 Probably unrelated, but... when setting JAVA_HOME for Tomcat in Ubuntu what's the difference between: - /usr/lib/jvm/java-6-sun, and

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Hmm, so JConsole: http://java.sun.com/developer/technicalArticles/J2SE/jconsole.html appears to need a GUI which I don't have in this case. Should I just start switching through the different GC types and see if it makes a difference? On Thu, Sep 3, 2009 at 11:02 AM, Caldarale, Charles R

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 Hmm, so JConsole appears to need a GUI which I don't have in this case. You can run it remotely by setting the appropriate

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Ok, I've tried to get JConsole working but have been unsuccessful. I've set it up to connect remotely using JMX over port 8081. The program is starting and I've configured the JMX passwords. However, when I try to connect to the hung program using username: controlRole and my password: password

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 Maybe it can't connect when it's hung. Quite possible; GC stops all threads, so the JMX agent may well be suspended. You might want

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
Ok, hung in a different place, but hung nonetheless with all of that logging enabled: Here is the result: 2009-09-03 15:47:11,328 INFO [SettingsFactory] : Default entity-mode: pojo 2009-09-03 15:47:11,328 INFO [SettingsFactory] : Named query checking : enabled 2009-09-03 15:47:11,355 INFO

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-03 Thread Bradley Wagner
And again in a new place on subsequent attempt. I've attached the logging this time because the amount of logging between the last Tomcat line and the GC line was significant! - Bradley On Thu, Sep 3, 2009 at 1:49 PM, Caldarale, Charles R chuck.caldar...@unisys.com wrote: From: Bradley Wagner

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-02 Thread Bradley Wagner
Thanks for the clarification on the initial heap size. I've set both Xms and Xmx to 512m for the following test. I was able to reproduce the problem immediately with: - Xms and Xmx both set to 512m - Java 1.6 with no JPDA running - XX:+PrintGCDetails enabled I've attached the thread dump which I

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-02 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 I've also attached the catalina.out log which shows the GC basically freezing. Unfortunately, that log was stripped; can you post it

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-02 Thread Bradley Wagner
Here's the last 100 lines of it. That line with only 3 letters is actually what is in the file. It's hanging mid-GC call. 2009-09-02 13:58:05,306 INFO [TableMetadata] : table found: hhtest.cxml_recyclerecord 2009-09-02 13:58:05,306 INFO [TableMetadata] : columns: [id, parentfolderid,

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-02 Thread Mark Thomas
Bradley Wagner wrote: Any thoughts on which GC parameters I should change. See what the default collector is for your platform and switch to s different one. Mark - To unsubscribe, e-mail:

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-01 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Bradley, On 8/31/2009 5:27 PM, Bradley Wagner wrote: The three thread dumps were from three different occurrences of the same problem and three consecutive startup attempts. With each occurrence, the startup process hangs in the middle of

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-01 Thread Peter Crowther
2009/9/1 Christopher Schultz ch...@christopherschultz.net Hmm. Do you trust your hardware? [...] How much physical memory does your machine have? How much swap space? Try running badblocks on your swap partition. Try running memtest86+ on your hardware (if it's x86... you didn't say). The

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-09-01 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Peter, On 9/1/2009 11:18 AM, Peter Crowther wrote: 2009/9/1 Christopher Schultz ch...@christopherschultz.net Hmm. Do you trust your hardware? [...] How much physical memory does your machine have? How much swap space? Try running badblocks

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Bradley Wagner
Ok, I have some information to add here. I was able to get thread dumps with jstack pid (very handy!) because kill -3 wouldn't work on a hung process. I've listed 3 consecutive tests that I run and the thread is blocked at the time the process is hung. Test 1 Thread 21348: (state = BLOCKED) -

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Mark Thomas
Bradley Wagner wrote: Ok, I have some information to add here. I was able to get thread dumps with jstack pid (very handy!) because kill -3 wouldn't work on a hung process. I've listed 3 consecutive tests that I run and the thread is blocked at the time the process is hung. That isn't the

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Bradley Wagner
Mark, Sorry, I should have mentioned this before, but in all cases I tried the thread dumps 2-3 times at least 30s apart and none of the threads have progressed at all. - Bradley On Mon, Aug 31, 2009 at 3:52 PM, Mark Thomas ma...@apache.org wrote: Bradley Wagner wrote: Ok, I have some

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Mark Thomas
Bradley Wagner wrote: Mark, Sorry, I should have mentioned this before, but in all cases I tried the thread dumps 2-3 times at least 30s apart and none of the threads have progressed at all. Hmm. That smells like a JVM issue to me, particularly if it goes away when you use JPDA. Things to

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Christopher Schultz
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Bradley, On 8/31/2009 4:02 PM, Bradley Wagner wrote: Sorry, I should have mentioned this before, but in all cases I tried the thread dumps 2-3 times at least 30s apart and none of the threads have progressed at all. I agree with Mark: the three

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Peter Crowther
2009/8/31 Christopher Schultz ch...@christopherschultz.net -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Bradley, On 8/31/2009 4:02 PM, Bradley Wagner wrote: Sorry, I should have mentioned this before, but in all cases I tried the thread dumps 2-3 times at least 30s apart and none of

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Bradley Wagner
- use a 1.6 JVM Tried with Sun 1.6 JVM. Same problems. Not the same exact stack traces but for example: Thread 24427: (state = BLOCKED) - java.lang.String.toCharArray() @bci=4, line=2725 (Compiled frame) - java.beans.Introspector.decapitalize(java.lang.String) @bci=46, line=252 (Compiled

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Bradley Wagner
I agree with Mark: the three threads you showed were different (different ids), and showing different call stacks. Are you saying that each thread dump you took represents multiple thread dumps where that particular thread didn't progress /at all/ over your multi-dump sample? The three

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Bradley Wagner
The other interesting point is that all of those are hung in places where they would naturally be allocating an object or have very recently allocated an object, and the JVM *might* in theory be growing the heap. Bradley, are your initial and maximum heap sizes identical (I suspect not from

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Leon Rosenberg
Hello, This indeed sounds like you have problems with one of the spaces, please add following option to the JAVA_OPTS (or whatever you are using) to seubmit jvm parameters: -XX:+PrintGCDetails And, no tomcat's initial heap size don't default to 64Mb. The JVM allocateds a heap dependent on your

RE: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-31 Thread Caldarale, Charles R
From: Bradley Wagner [mailto:bradley.wag...@hannonhill.com] Subject: Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7 So, while it's not hanging in the same place every time, it's definitely hanging every time. Try running JConsole against the Tomcat

Re: 100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-30 Thread Peter Crowther
2009/8/28 Bradley Wagner bradley.wag...@hannonhill.com I have a Spring/Hibernate app running in Tomcat 5.5.20 that we've tested in many environments that is currently faltering when running in a Ubuntu 7 VM. Basically on startup, frequently, the startup process will halt when trying to read

100% usage and hanging on startup of Spring/Hibernate app in Tomcat 5.5 on Ubuntu 7

2009-08-28 Thread Bradley Wagner
I have a Spring/Hibernate app running in Tomcat 5.5.20 that we've tested in many environments that is currently faltering when running in a Ubuntu 7 VM. Basically on startup, frequently, the startup process will halt when trying to read Hibernate's HBM files and in various other places in startup