RE: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-16 Thread Dale, Matt
I have a copy of the old jvmstat if you'd like me to email it to you direct?

-Original Message-
From: Kevin A. Burton [mailto:[EMAIL PROTECTED]
Sent: 15 November 2004 19:51
To: Tomcat Users List
Subject: Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4


Dale, Matt wrote:

I've not been following this thread but my guess would be that you are running 
out of space in the permanent generation of the heap. Get a hold of jvmstat 
from sun and run visualgc on your JVM, it should become obvious then which 
pool is running out of space.
  

God!  How pathetic is this:

http://java.sun.com/performance/jvmstat/#Download

 This distribution of the jvmstat tools requires J2SE 5.0 with the 
 HotSpot JVM.

So now I have to upgrade all our VMs to JDK 5.0 even though earlier 
versions of jvmstat supported JDK 1.4. 

Brilliant... who's the marketing genius that though of this one!?

... and of course they don't link to archival versions.

The SUN  has set my friends ;-)

Kevin

-- 

Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html

If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!

Kevin A. Burton, Location - San Francisco, CA
   AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Any opinions expressed in this E-mail may be those of the individual and not 
necessarily the company. This E-mail and any files transmitted with it are 
confidential and solely for the use of the intended recipient. If you are not 
the intended recipient or the person responsible for delivering to the intended 
recipient, be advised that you have received this E-mail in error and that any 
use or copying is strictly prohibited. If you have received this E-mail in 
error please notify the beCogent postmaster at [EMAIL PROTECTED]
Unless expressly stated, opinions in this email are those of the individual 
sender and not beCogent Ltd. You must take full responsibility for virus 
checking this email and any attachments.
Please note that the content of this email or any of its attachments may 
contain data that falls within the scope of the Data Protection Acts and that 
you must ensure that any handling or processing of such data by you is fully 
compliant with the terms and provisions of the Data Protection Act 1984 and 
1998.


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-15 Thread Kevin A. Burton
Remy Maucherat wrote:
On Sat, 13 Nov 2004 17:30:38 -0800, Kevin A. Burton
[EMAIL PROTECTED] wrote:
 

Remy Maucherat wrote:
   

On Fri, 12 Nov 2004 17:17:28 -0800, Kevin A. Burton
[EMAIL PROTECTED] wrote:
 

- For all my JSPs I fetch them with the URL foo.jsp?jsp_precompile=true
to trigger precompilation
   

How many JSPs must be compiled to cause problems ?
 

About 50 or so... it changes every time.   Sometimes I have to trigger a
precompile twice.
   

I don't quite understand in which cases problems occur:
- if you ?jsp_precompile=true 50 times for the same JSP ?
- if you ?jsp_precompile=true for 50 different JSPs ?
- if you access normally 50 different JSPs (triggering compilation for
each one) ?
I would understand from your description only the second one is an
issue. Can you confirm this ?
 

Yes... I use #2
I trigger a ?jsp_precompile=true for each one of my JSPs and we have 
around 300-400 ...

Around 100 or so it will run out of memory.
Kevin
--
Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!
   
Kevin A. Burton, Location - San Francisco, CA
  AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412



Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-15 Thread Kevin A. Burton
Dale, Matt wrote:
I've not been following this thread but my guess would be that you are running out of space in the permanent generation of the heap. Get a hold of jvmstat from sun and run visualgc on your JVM, it should become obvious then which pool is running out of space.
 

God!  How pathetic is this:
http://java.sun.com/performance/jvmstat/#Download
This distribution of the jvmstat tools requires J2SE 5.0 with the 
HotSpot JVM.
So now I have to upgrade all our VMs to JDK 5.0 even though earlier 
versions of jvmstat supported JDK 1.4. 

Brilliant... who's the marketing genius that though of this one!?
... and of course they don't link to archival versions.
The SUN  has set my friends ;-)
Kevin
--
Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!
   
Kevin A. Burton, Location - San Francisco, CA
  AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]


RE: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-14 Thread Dale, Matt

I've not been following this thread but my guess would be that you are running 
out of space in the permanent generation of the heap. Get a hold of jvmstat 
from sun and run visualgc on your JVM, it should become obvious then which pool 
is running out of space.

Ta
Matt

-Original Message-
From: Kevin A. Burton [mailto:[EMAIL PROTECTED]
Sent: 14 November 2004 01:31
To: Tomcat Users List
Subject: Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4


Remy Maucherat wrote:

On Fri, 12 Nov 2004 17:17:28 -0800, Kevin A. Burton
[EMAIL PROTECTED] wrote:
  

- For all my JSPs I fetch them with the URL foo.jsp?jsp_precompile=true
to trigger precompilation



How many JSPs must be compiled to cause problems ?
  

About 50 or so... it changes every time.   Sometimes I have to trigger a 
precompile twice.

Note that the VM still shows plenty of memory so I'm not sure what the
heck is going on here.  I also looked at our file handles and they seem
fine too.



In that kind of situation, a profiler will have to be used. All I can
tell right now is that it has nothing to do with the Java compilation,
which is not very surprising.
  

Why is it then that doing a ?jsp_precompile=true for all my JSPs and NO 
other action causes this?

For really large web applications, I think you should precompile as
many JSPs as possible anyway, as a JSP compiled dynamically will
always use more resources (even if there is no bug in Jasper).
  

Well thats probably an approach we will take but its unfortunate.

If i had a profiler I would connect it to figure out whats going on but 
I'm really not happy with any of them.

Kevin

-- 

Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html

If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!

Kevin A. Burton, Location - San Francisco, CA
   AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412

Any opinions expressed in this E-mail may be those of the individual and not 
necessarily the company. This E-mail and any files transmitted with it are 
confidential and solely for the use of the intended recipient. If you are not 
the intended recipient or the person responsible for delivering to the intended 
recipient, be advised that you have received this E-mail in error and that any 
use or copying is strictly prohibited. If you have received this E-mail in 
error please notify the beCogent postmaster at [EMAIL PROTECTED]
Unless expressly stated, opinions in this email are those of the individual 
sender and not beCogent Ltd. You must take full responsibility for virus 
checking this email and any attachments.
Please note that the content of this email or any of its attachments may 
contain data that falls within the scope of the Data Protection Acts and that 
you must ensure that any handling or processing of such data by you is fully 
compliant with the terms and provisions of the Data Protection Act 1984 and 
1998.


-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]

Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-14 Thread Remy Maucherat
On Sat, 13 Nov 2004 17:30:38 -0800, Kevin A. Burton
[EMAIL PROTECTED] wrote:
 Remy Maucherat wrote:
 
 On Fri, 12 Nov 2004 17:17:28 -0800, Kevin A. Burton
 [EMAIL PROTECTED] wrote:
 
 - For all my JSPs I fetch them with the URL foo.jsp?jsp_precompile=true
 to trigger precompilation
 
 
 How many JSPs must be compiled to cause problems ?
 
 About 50 or so... it changes every time.   Sometimes I have to trigger a
 precompile twice.

I don't quite understand in which cases problems occur:
- if you ?jsp_precompile=true 50 times for the same JSP ?
- if you ?jsp_precompile=true for 50 different JSPs ?
- if you access normally 50 different JSPs (triggering compilation for
each one) ?
I would understand from your description only the second one is an
issue. Can you confirm this ?

-- 
x
Rémy Maucherat
Developer  Consultant
JBoss Group (Europe) SàRL
x

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-13 Thread Remy Maucherat
On Fri, 12 Nov 2004 17:17:28 -0800, Kevin A. Burton
[EMAIL PROTECTED] wrote:
 - For all my JSPs I fetch them with the URL foo.jsp?jsp_precompile=true
 to trigger precompilation

How many JSPs must be compiled to cause problems ?

 Note that the VM still shows plenty of memory so I'm not sure what the
 heck is going on here.  I also looked at our file handles and they seem
 fine too.

In that kind of situation, a profiler will have to be used. All I can
tell right now is that it has nothing to do with the Java compilation,
which is not very surprising.

For really large web applications, I think you should precompile as
many JSPs as possible anyway, as a JSP compiled dynamically will
always use more resources (even if there is no bug in Jasper).

-- 
x
Rémy Maucherat
Developer  Consultant
JBoss Group (Europe) SàRL
x

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]



Re: OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-13 Thread Kevin A. Burton
Remy Maucherat wrote:
On Fri, 12 Nov 2004 17:17:28 -0800, Kevin A. Burton
[EMAIL PROTECTED] wrote:
 

- For all my JSPs I fetch them with the URL foo.jsp?jsp_precompile=true
to trigger precompilation
   

How many JSPs must be compiled to cause problems ?
 

About 50 or so... it changes every time.   Sometimes I have to trigger a 
precompile twice.

Note that the VM still shows plenty of memory so I'm not sure what the
heck is going on here.  I also looked at our file handles and they seem
fine too.
   

In that kind of situation, a profiler will have to be used. All I can
tell right now is that it has nothing to do with the Java compilation,
which is not very surprising.
 

Why is it then that doing a ?jsp_precompile=true for all my JSPs and NO 
other action causes this?

For really large web applications, I think you should precompile as
many JSPs as possible anyway, as a JSP compiled dynamically will
always use more resources (even if there is no bug in Jasper).
 

Well thats probably an approach we will take but its unfortunate.
If i had a profiler I would connect it to figure out whats going on but 
I'm really not happy with any of them.

Kevin
--
Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!
   
Kevin A. Burton, Location - San Francisco, CA
  AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412



OutOfMemory errors compiling JSPs on 5.0.16 and 5.5.4

2004-11-12 Thread Kevin A. Burton
I'm having a terrible time trying to get my JSPs compiled on Tomcat.
We started having OutOfMemory problems a while back and I've tracked it 
down to JSP compilation.

Here's what I can do to replicate the problem:
- shutdown tomcat
- remove the work directory
- startup tomcat
- For all my JSPs I fetch them with the URL foo.jsp?jsp_precompile=true 
to trigger precompilation

After about 10 minutes (and 50-100 JSP files) Tomcat will fail with:
SEVERE: Servlet.service() for servlet jsp threw exception
java.lang.OutOfMemoryError
Note that the VM still shows plenty of memory so I'm not sure what the 
heck is going on here.  I also looked at our file handles and they seem 
fine too.

I've followed all suggestions I've found via Google including:
- setting fork to true
- using jikes
- Migrating to Tomcat 5.5.4 to use jdtool.
The machine has PLENTY of memory available:
export JAVA_OPTS=-server -Xmx1280M -Xms512M -Djava.awt.headless=true
Any suggestions would be appreciated.
We're probably going to migrate to using the command line JspC compiler 
to build all our JSPs before hand so the webapp doesn't need to compile 
them at runtime but this seems like a cheap workaround.  I'd rather 
Tomcat weren't broken in this regard.

Kevin
--
Use Rojo (RSS/Atom aggregator).  Visit http://rojo.com. Ask me for an 
invite!  Also see irc.freenode.net #rojo if you want to chat.

Rojo is Hiring! - http://www.rojonetworks.com/JobsAtRojo.html
If you're interested in RSS, Weblogs, Social Networking, etc... then you 
should work for Rojo!  If you recommend someone and we hire them you'll 
get a free iPod!
   
Kevin A. Burton, Location - San Francisco, CA
  AIM/YIM - sfburtonator,  Web - http://peerfear.org/
GPG fingerprint: 5FB2 F3E2 760E 70A8 6174 D393 E84D 8D04 99F1 4412

-
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]