Re: Tomcat 9.0.71 Anomalies

2023-03-04 Thread Mark Thomas

On 03/03/2023 20:19, jonmcalexan...@wellsfargo.com.INVALID wrote:

Hi Mark,

On the slowness, this is when they are retrieving random .js files from the 
exploded war file after deployment.


To clarify, these are .js files loaded directly from the file system? 
They are not packaged in a JAR file?



It's taking an a long
  amount of time. Some of these are quite large, like 2MB or more. When the 
issue shows, doing a curl we get to here and then it pauses for some time 
before it feeds back the data.

*   Trying **.**.**.**:8443...
* TCP_NODELAY set
* Connected to server port 8443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / 
* ALPN, server accepted to use http/1.1
* Server certificate:
*  subject:
*  start date:
*  expire date:
*  issuer:
*  SSL certificate verify result: unable to get local issuer certificate (20), 
continuing anyway.

GET  HTTP/1.1
Host:
User-Agent: curl/7.65.3
Accept: */*



And it just hangs out here before finally getting the requested file.


How repeatable is this?

How long does it hang before delivering content? Is it always the same 
or does it vary.


Which connector are you using?

What Tomcat version did you upgrade from?

How does the problem before the upgrade compare to the problem after the 
upgrade?


What component is serving the content? Is it Tomcat's default servlet or 
is it something else?


When it happens, take 3 thread dumps a few seconds apart. The aim is to 
figure out why it is hanging.



In looking at the catalina.out log file, I am not seeing any 
errors/stack-traces.

Any ideas as to what may be causing this?


Not at the moment. The information requested above should at least 
narrow down which parts we need to think about.


Mark



Thank you,

Dream * Excel * Explore * Inspire
Jon McAlexander
Senior Infrastructure Engineer
Asst. Vice President
He/His

Middleware Product Engineering
Enterprise CIO | EAS | Middleware | Infrastructure Solutions

8080 Cobblestone Rd | Urbandale, IA 50322
MAC: F4469-010
Tel 515-988-2508 | Cell 515-988-2508

jonmcalexan...@wellsfargo.com
This message may contain confidential and/or privileged information. If you are 
not the addressee or authorized to receive this for the addressee, you must not 
use, copy, disclose, or take any action based on this message or any 
information herein. If you have received this message in error, please advise 
the sender immediately by reply e-mail and delete this message. Thank you for 
your cooperation.


-Original Message-
From: Mark Thomas 
Sent: Friday, March 3, 2023 1:32 AM
To: users@tomcat.apache.org
Subject: Re: Tomcat 9.0.71 Anomalies

On 02/03/2023 21:54, jonmcalexan...@wellsfargo.com.INVALID wrote:

Hello gentle beings,

I have a couple of application teams having issues since getting upgraded to

Tomcat 9.0.71.

Upgrading from which Tomcat version?


The main one has to do with an application that has run fine in the past is

now exceeding max cursors with their Oracle Database datasource. They are
using spring framework to control the Database operations. Here is what
their resource looks like:



type="javax.sql.DataSource"

 maxTotal="100" maxIdle="30" maxWaitMillis="15000"
 username="${datasource.fm.username}"

password="${datasource.fm.password}"
driverClassName="oracle.jdbc.OracleDriver"



url="jdbc:oracle:thin:@(Description=(CONNECT_TIMEOUT=10)(RETRY_COUN
T=3)(ADDRESS_LIST=(LOAD_BALANCE=on)(FAILOVER=ON)(ADDRESS=(PROT
OCOL=tcp)(HOST=***)(PORT=3203))(ADDRESS=(PROTOCOL=
tcp)(HOST=*)(PORT=3203)))(CONNECT_DATA=(SERVICE
_NAME=ceofm_u)))"/>


Here is an error from the log file:

[‎3/‎2/‎2023 1:50 PM]  Burgos, Maria D.:
here is the error in catalina.out
02-Mar-2023 13:05:30.944 SEVERE [https-jsse-nio-28443-exec-8]

org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for
servlet [f***servlet] in context with path [/f***] threw exception [Request
processing failed; nested exception is
com.wellsfargo.fms.common.exception.FMSException] with root cause

  com.wellsfargo.f**.common.exception.F**Exception
  at

org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTempl
ate.java:1542)

  at

org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:66
7)

Any chance we can see a root cause for that? Something from the JDBC
driver?


The other team is havi

RE: Tomcat 9.0.71 Anomalies

2023-03-03 Thread jonmcalexander
Hi Mark,

On the slowness, this is when they are retrieving random .js files from the 
exploded war file after deployment. It's taking an a long
 amount of time. Some of these are quite large, like 2MB or more. When the 
issue shows, doing a curl we get to here and then it pauses for some time 
before it feeds back the data.

*   Trying **.**.**.**:8443...
* TCP_NODELAY set
* Connected to server port 8443 (#0)
* ALPN, offering h2
* ALPN, offering http/1.1
* TLSv1.3 (OUT), TLS handshake, Client hello (1):
* TLSv1.3 (IN), TLS handshake, Server hello (2):
* TLSv1.2 (IN), TLS handshake, Certificate (11):
* TLSv1.2 (IN), TLS handshake, Server key exchange (12):
* TLSv1.2 (IN), TLS handshake, Server finished (14):
* TLSv1.2 (OUT), TLS handshake, Client key exchange (16):
* TLSv1.2 (OUT), TLS change cipher, Change cipher spec (1):
* TLSv1.2 (OUT), TLS handshake, Finished (20):
* TLSv1.2 (IN), TLS handshake, Finished (20):
* SSL connection using TLSv1.2 / 
* ALPN, server accepted to use http/1.1
* Server certificate:
*  subject: 
*  start date: 
*  expire date: 
*  issuer: 
*  SSL certificate verify result: unable to get local issuer certificate (20), 
continuing anyway.
> GET  HTTP/1.1
> Host: 
> User-Agent: curl/7.65.3
> Accept: */*
>

And it just hangs out here before finally getting the requested file.

In looking at the catalina.out log file, I am not seeing any 
errors/stack-traces.

Any ideas as to what may be causing this?

Thank you,

Dream * Excel * Explore * Inspire
Jon McAlexander
Senior Infrastructure Engineer
Asst. Vice President
He/His

Middleware Product Engineering
Enterprise CIO | EAS | Middleware | Infrastructure Solutions

8080 Cobblestone Rd | Urbandale, IA 50322
MAC: F4469-010
Tel 515-988-2508 | Cell 515-988-2508

jonmcalexan...@wellsfargo.com
This message may contain confidential and/or privileged information. If you are 
not the addressee or authorized to receive this for the addressee, you must not 
use, copy, disclose, or take any action based on this message or any 
information herein. If you have received this message in error, please advise 
the sender immediately by reply e-mail and delete this message. Thank you for 
your cooperation.

> -Original Message-
> From: Mark Thomas 
> Sent: Friday, March 3, 2023 1:32 AM
> To: users@tomcat.apache.org
> Subject: Re: Tomcat 9.0.71 Anomalies
> 
> On 02/03/2023 21:54, jonmcalexan...@wellsfargo.com.INVALID wrote:
> > Hello gentle beings,
> >
> > I have a couple of application teams having issues since getting upgraded to
> Tomcat 9.0.71.
> 
> Upgrading from which Tomcat version?
> 
> > The main one has to do with an application that has run fine in the past is
> now exceeding max cursors with their Oracle Database datasource. They are
> using spring framework to control the Database operations. Here is what
> their resource looks like:
> >
> >  type="javax.sql.DataSource"
> > maxTotal="100" maxIdle="30" maxWaitMillis="15000"
> > username="${datasource.fm.username}"
> password="${datasource.fm.password}"
> driverClassName="oracle.jdbc.OracleDriver"
> >
> url="jdbc:oracle:thin:@(Description=(CONNECT_TIMEOUT=10)(RETRY_COUN
> T=3)(ADDRESS_LIST=(LOAD_BALANCE=on)(FAILOVER=ON)(ADDRESS=(PROT
> OCOL=tcp)(HOST=***)(PORT=3203))(ADDRESS=(PROTOCOL=
> tcp)(HOST=*)(PORT=3203)))(CONNECT_DATA=(SERVICE
> _NAME=ceofm_u)))"/>
> >
> > Here is an error from the log file:
> >
> > [‎3/‎2/‎2023 1:50 PM]  Burgos, Maria D.:
> > here is the error in catalina.out
> > 02-Mar-2023 13:05:30.944 SEVERE [https-jsse-nio-28443-exec-8]
> org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for
> servlet [f***servlet] in context with path [/f***] threw exception [Request
> processing failed; nested exception is
> com.wellsfargo.fms.common.exception.FMSException] with root cause
> >  com.wellsfargo.f**.common.exception.F**Exception
> >  at
> org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTempl
> ate.java:1542)
> >  at
> org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:66
> 7)
> 
> Any chance we can see a root cause for that? Something from the JDBC
> driver?
> 
> > The other team is having performance issues when using static .jar
> resources in their war file. One part of the app, on the browser side
> measurements, is taking 2.2 minutes to load. This started getting worse after
> moving to 9.0.71. Are there any known issues that could be causing this?
> Currently waiting for 9.0.73 to get release. :)
> 
> Do you mean static resources stored in a JAR's META-INF/resources
> directory?
> 
> Is the WAR deployed in packed or unpacked form?
> 
> Mark
> 
> -
> To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
> For additional commands, e-mail: users-h...@tomcat.apache.org



Re: Tomcat 9.0.71 Anomalies

2023-03-02 Thread Mark Thomas

On 02/03/2023 21:54, jonmcalexan...@wellsfargo.com.INVALID wrote:

Hello gentle beings,

I have a couple of application teams having issues since getting upgraded to 
Tomcat 9.0.71.


Upgrading from which Tomcat version?


The main one has to do with an application that has run fine in the past is now 
exceeding max cursors with their Oracle Database datasource. They are using 
spring framework to control the Database operations. Here is what their 
resource looks like:



Here is an error from the log file:

[‎3/‎2/‎2023 1:50 PM]  Burgos, Maria D.:
here is the error in catalina.out
02-Mar-2023 13:05:30.944 SEVERE [https-jsse-nio-28443-exec-8] 
org.apache.catalina.core.StandardWrapperValve.invoke Servlet.service() for 
servlet [f***servlet] in context with path [/f***] threw exception [Request 
processing failed; nested exception is 
com.wellsfargo.fms.common.exception.FMSException] with root cause
 com.wellsfargo.f**.common.exception.F**Exception
 at 
org.springframework.jdbc.core.JdbcTemplate.translateException(JdbcTemplate.java:1542)
 at 
org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:667)


Any chance we can see a root cause for that? Something from the JDBC driver?


The other team is having performance issues when using static .jar resources in 
their war file. One part of the app, on the browser side measurements, is 
taking 2.2 minutes to load. This started getting worse after moving to 9.0.71. 
Are there any known issues that could be causing this?  Currently waiting for 
9.0.73 to get release. :)


Do you mean static resources stored in a JAR's META-INF/resources directory?

Is the WAR deployed in packed or unpacked form?

Mark

-
To unsubscribe, e-mail: users-unsubscr...@tomcat.apache.org
For additional commands, e-mail: users-h...@tomcat.apache.org