Hello Everyone! A couple of days ago we started experiencing severe downtime on our Geoserver instance that was working fine for a long time before this. For context we have Geo 2.22.0 running on Tomcat 9 on a Windows Server 2019.
All our requests go to GWC gmaps service with an URL in this format: /geoserver/gwc/service/gmaps?FORMAT=image/png8&LAYERS=skycop:Referencias+Vectorial+2&ZOOM=17&X=44602&Y=75080&VIEWPARAMS=Perfil:USERNAME;ShowLabels:1&_swc=1678964828059 In the latest version of our application, we have added a new parameter in the VIEWPARAMS for the requests (ShowLabels) and that of course in turn provoked a complete reseed of the Cache. Since then, when the server is under normal load, threads take a very long time to resolve (500/600 sec), or never resolve at all. So after a little while all Tomcat threads become busy and unresponsive. We have no errors recorded on the logs, no matter what log level we set. Our DB (SQL Server) is configured with a 64 connections pool. Is working normally and responding plenty fast to Geoserver, so we have mostly discarded that as the bottleneck. Investigating further, we see many of the threads are mostly idle waiting for something, so after some thread dumps, we found that most of the treads are stuck on this line of code where it seems to be waiting on a lock to be released for the metadata.properties.gz file: https://github.com/geoserver/geoserver/blob/main/src/gwc/src/main/java/org/geoserver/gwc/layer/GeoServerTileLayer.java#L594 I should add that during the night, with light load, the server is responding fine to requests in no more than 2/3 seconds. (And much faster obviously if the cache is hit). If anyone can give us a clue on where to look further or any other information or possible solution... we will be very very grateful! Thank you very much! Sebastian Oszlak
_______________________________________________ Geoserver-users mailing list Please make sure you read the following two resources before posting to this list: - Earning your support instead of buying it, but Ian Turton: http://www.ianturton.com/talks/foss4g.html#/ - The GeoServer user list posting guidelines: http://geoserver.org/comm/userlist-guidelines.html If you want to request a feature or an improvement, also see this: https://github.com/geoserver/geoserver/wiki/Successfully-requesting-and-integrating-new-features-and-improvements-in-GeoServer Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
