I want to add an extra note. I noticed that if I don't use integration with GeoServer WMS and directly use GWC WMS (/geoserver/gwc/service/wms), the performance is significantly better. Most of my request response times are < 1s, whereas before using the integrated mode, I was getting some 10s+ response times along with some < 1s response times.
Is there a known performance difference between integrated WMS mode versus GWC WMS? Thanks, Danny -----Original Message----- From: Danny Cheng Sent: Friday, November 28, 2014 1:02 PM To: 'Simone Giannecchini' Cc: geoserver-users@lists.sourceforge.net Subject: RE: [Geoserver-users] 2.6.1 JPEG2000 Performance Hi Simone, I have an image mosaic layer that serves up a global basemap in JPEG2000 format. I am accessing via OWS service with the following sample request, http://localhost:8686/geoserver/myworkspace/ows?LAYERS=myworkspace%3AJPEG2000_Test&FORMAT=image%2Fpng&MINRESOLUTION=auto&MAXRESOLUTION=auto&TRANSPARENT=TRUE&TILED=true&SERVICE=WMS&VERSION=1.1.1&REQUEST=GetMap&STYLES=&SRS=EPSG%3A4326&BBOX=120.76171875,24.43359375,120.9375,24.609375&WIDTH=256&HEIGHT=256 I am also trying to cache the basemap to speed up future requests via GWC. See attached for the image mosaic configuration. I did confirm that ECW is being used. Looking through the log, I found something interesting. 28 Nov 10:29:38 WARN [layer.MetaTile] - ********* Native JAI is not installed, meta tile cropping may be slow ******** Doesn't JAI come with GeoServer? Thanks, Danny -----Original Message----- From: simbo...@gmail.com [mailto:simbo...@gmail.com] On Behalf Of Simone Giannecchini Sent: Friday, November 28, 2014 10:09 AM To: Danny Cheng Cc: Simone Giannecchini; geoserver-users@lists.sourceforge.net Subject: Re: [Geoserver-users] 2.6.1 JPEG2000 Performance Dear Danny, please find my answers inline below.... Regards, Simone Giannecchini == GeoServer Professional Services from the experts! Visit http://goo.gl/NWWaa2 for more information. == Ing. Simone Giannecchini @simogeo Founder/Director GeoSolutions S.A.S. Via Poggio alle Viti 1187 55054 Massarosa (LU) Italy phone: +39 0584 962313 fax: +39 0584 1660272 mob: +39 333 8128928 http://www.geo-solutions.it http://twitter.com/geosolutions_it ------------------------------------------------------- AVVERTENZE AI SENSI DEL D.Lgs. 196/2003 Le informazioni contenute in questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da considerarsi strettamente riservate. Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, per le finalità indicate nel messaggio stesso. Qualora riceviate questo messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene notizia via e-mail e di procedere alla distruzione del messaggio stesso, cancellandolo dal Vostro sistema. Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce comportamento contrario ai principi dettati dal D.Lgs. 196/2003. The information in this message and/or attachments, is intended solely for the attention and use of the named addressee(s) and may be confidential or proprietary in nature or covered by the provisions of privacy act (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection Code).Any use not in accord with its purpose, any disclosure, reproduction, copying, distribution, or either dissemination, either whole or partial, is strictly forbidden except previous formal approval of the named addressee(s). If you are not the intended recipient, please contact immediately the sender by telephone, fax or e-mail and delete the information in this message that has been received in error. The sender does not give any warranty or accept liability as the content, accuracy or completeness of sent messages and accepts no responsibility for changes made after they were sent or for other risks which arise as a result of e-mail transmission, viruses, etc. On Fri, Nov 28, 2014 at 6:18 PM, Danny Cheng <dch...@mdacorporation.com> wrote: > Hi Simone, > > I played around with the configuration further and I found that the cause of > the poor performance is actually due to caching with GWC. I was running GWC > with direct integration with GeoServer WMS. When I turned off caching the > performance was much better at roughly 10s response time. Is this expected > with direct integration with GeoServer WMS? I haven't tried GWC WMS yet. Generally speaking GWC does metatiling when it creates a tile hence your requests requests a lager area underneath and you also need to take into account the time to write the tiles to the disk. Then requests are accelerated on successive access. You would need to be more specific about what you are doing and how you are accessing the WMS service in order for me to be helpful. > > For information purposes here is the gdalinfo of my input file. > > Driver: JP2ECW/ERDAS JPEG2000 (SDK 5.0) > Files: N55-W012.jp2 > Size is 21621, 36021 > Coordinate System is: > GEOGCS["WGS 84", > DATUM["WGS_1984", > SPHEROID["WGS 84",6378137,298.257223563, > AUTHORITY["EPSG","7030"]], > AUTHORITY["EPSG","6326"]], > PRIMEM["Greenwich",0], > UNIT["degree",0.0174532925199433], > AUTHORITY["EPSG","4326"]] > Origin = (-9.001458333333334,60.001458333333332) > Pixel Size = (0.000138888888889,-0.000138888888889) > Metadata: > AREA_OR_POINT=Point > COLORSPACE=RGB > COMPRESSION_RATE_TARGET=23 > VERSION=1 > Corner Coordinates: > Upper Left ( -9.0014583, 60.0014583) ( 9d 0' 5.25"W, 60d 0' > 5.25"N) Lower Left ( -9.0014583, 54.9985417) ( 9d 0' 5.25"W, > 54d59'54.75"N) Upper Right ( -5.9985417, 60.0014583) ( 5d59'54.75"W, > 60d 0' 5.25"N) Lower Right ( -5.9985417, 54.9985417) ( 5d59'54.75"W, > 54d59'54.75"N) > Center ( -7.5000000, 57.5000000) ( 7d30' 0.00"W, 57d30' 0.00"N) > Band 1 Block=256x256 Type=Byte, ColorInterp=Red > Description = Red > Overviews: 10810x18010, 5405x9005, 2702x4502, 1351x2251, 675x1125, > 337x562, 168x281 Band 2 Block=256x256 Type=Byte, ColorInterp=Green > Description = Green > Overviews: 10810x18010, 5405x9005, 2702x4502, 1351x2251, 675x1125, > 337x562, 168x281 Band 3 Block=256x256 Type=Byte, ColorInterp=Blue > Description = Blue > Overviews: 10810x18010, 5405x9005, 2702x4502, 1351x2251, 675x1125, > 337x562, 168x281 > > I am using the GDAL plug-in and image mosaic plug-in to serve this layer. See > the attachment for layer configuration. Can you elaborate on what keywords > I'm looking for in the verbose log? It's quite extensive. Well, I kind of assume you are using the ECW plugin hence there is no need to check the logs. Just to be on the safe side in my log I see something like this at the beginning: 2014-11-28 19:02:30,899 DEBUG [org.geotools.coverageio.gdal.dted] - DTEDFormatFactory is availaible. 2014-11-28 19:02:30,900 DEBUG [org.geotools.coverageio.gdal.jp2k] - JP2KFormatFactory is not availaible. 2014-11-28 19:02:30,900 DEBUG [org.geotools.coverageio.gdal.erdasimg] - ErdasImgFormatFactory is availaible. 2014-11-28 19:02:30,900 DEBUG [org.geotools.coverageio.gdal.ehdr] - EsriHdrFormatFactory is availaible. 2014-11-28 19:02:30,901 DEBUG [org.geotools.coverageio.gdal.nitf] - NITFFormatFactory is availaible. 2014-11-28 19:02:30,901 DEBUG [org.geotools.coverageio.gdal.ecw] - ECWFormatFactory is availaible. 2014-11-28 19:02:30,902 DEBUG [org.geotools.coverageio.jp2k] - JP2KFormatFactory is availaible. 2014-11-28 19:02:30,902 DEBUG [org.geotools.coverageio.gdal.mrsid] - MrSIDFormatFactory is availaible. 2014-11-28 19:02:30,904 DEBUG [org.geotools.gce.arcgrid] - ArcGridFormatFactory is availaible. 2014-11-28 19:02:30,905 DEBUG [org.geotools.coverageio.gdal.envihdr] - EnviHdrFormatFactory is availaible. 2014-11-28 19:02:30,915 DEBUG [org.geotools.coverageio.gdal.rpftoc] - RPFTOCFormatFactory is availaible. 2014-11-28 19:02:30,916 DEBUG [org.geotools.coverageio.gdal.jp2mrisd] - JP2MrSIDFormatFactory is not availaible. <<---- 2014-11-28 19:02:30,916 DEBUG [org.geotools.coverageio.gdal.jp2ecw] - JP2ECWFormatFactory is availaible. <<---- 2014-11-28 19:02:30,926 DEBUG [org.geotools.coverageio.gdal.dted] - Creating a new DTEDFormat. 2014-11-28 19:02:30,927 DEBUG [org.geotools.coverageio.gdal.erdasimg] - Creating a new ErdasImgFormat. 2014-11-28 19:02:30,929 DEBUG [org.geotools.coverageio.gdal.ehdr] - Creating a new EsriHdrFormat. 2014-11-28 19:02:30,930 DEBUG [org.geotools.coverageio.gdal.nitf] - Creating a new NITFFormat. 2014-11-28 19:02:30,931 DEBUG [org.geotools.coverageio.gdal.ecw] - Creating a new ECWFormat. 2014-11-28 19:02:30,943 DEBUG [org.geotools.coverageio.jp2k] - Creating a new JP2KFormat. 2014-11-28 19:02:30,944 DEBUG [org.geotools.coverageio.gdal.mrsid] - Creating a new MrSIDFormat. 2014-11-28 19:02:30,948 DEBUG [org.geotools.gce.arcgrid] - Creating a new ArcGriFormat. 2014-11-28 19:02:30,950 DEBUG [org.geotools.coverageio.gdal.envihdr] - Creating a new EnviHdrFormat. 2014-11-28 19:02:30,962 DEBUG [org.geotools.coverageio.gdal.rfptoc] - Creating a new RPFTOCFormat. 2014-11-28 19:02:30,965 DEBUG [org.geotools.coverageio.gdal.jp2ecw] - Creating a new JP2KFormat. An easier way is to check the GUI of GeoServer. When you try to create a store you need to make sure the right plugin is activated and available as per the image attached. One last thing, send over the properties file for the ImageMosaic I want to see which SPI is suggested (this speed things up as avoids lookups). > > Thanks, > Danny > > -----Original Message----- > From: simbo...@gmail.com [mailto:simbo...@gmail.com] On Behalf Of > Simone Giannecchini > Sent: Friday, November 28, 2014 8:11 AM > To: Danny Cheng > Cc: geoserver-users@lists.sourceforge.net > Subject: Re: [Geoserver-users] 2.6.1 JPEG2000 Performance > > Dear Danny, > can you give us a bit more info as per the following questions? > > - provide us a gdalinfo of the input file > - which plugin are you using for serving this file? > - provide us with the config in geoserver for this layer > - which plugin where you using to serve this layer > > It looks to me the siutation where GeoServer is not loading a specific > JP2 plugin (ECW or Kakadu) and is actually using the internal JJ2000 one > which is _extremely_ slow. > To spot such a problem you need to restart the geoserver with the log > to verbose and look at the plugin that have been disabled. This might > be next step once we get some basic information > > > Regards, > Simone Giannecchini > == > GeoServer Professional Services from the experts! Visit > http://goo.gl/NWWaa2 for more information. > == > > Ing. Simone Giannecchini > @simogeo > Founder/Director > > GeoSolutions S.A.S. > Via Poggio alle Viti 1187 > 55054 Massarosa (LU) > Italy > phone: +39 0584 962313 > fax: +39 0584 1660272 > mob: +39 333 8128928 > > http://www.geo-solutions.it > http://twitter.com/geosolutions_it > > ------------------------------------------------------- > AVVERTENZE AI SENSI DEL D.Lgs. 196/2003 Le informazioni contenute in > questo messaggio di posta elettronica e/o nel/i file/s allegato/i sono da > considerarsi strettamente riservate. > Il loro utilizzo è consentito esclusivamente al destinatario del messaggio, > per le finalità indicate nel messaggio stesso. Qualora riceviate questo > messaggio senza esserne il destinatario, Vi preghiamo cortesemente di darcene > notizia via e-mail e di procedere alla distruzione del messaggio stesso, > cancellandolo dal Vostro sistema. > Conservare il messaggio stesso, divulgarlo anche in parte, distribuirlo ad > altri soggetti, copiarlo, od utilizzarlo per finalità diverse, costituisce > comportamento contrario ai principi dettati dal D.Lgs. 196/2003. > > The information in this message and/or attachments, is intended solely for > the attention and use of the named addressee(s) and may be confidential or > proprietary in nature or covered by the provisions of privacy act > (Legislative Decree June, 30 2003, no.196 - Italy's New Data Protection > Code).Any use not in accord with its purpose, any disclosure, reproduction, > copying, distribution, or either dissemination, either whole or partial, is > strictly forbidden except previous formal approval of the named addressee(s). > If you are not the intended recipient, please contact immediately the sender > by telephone, fax or e-mail and delete the information in this message that > has been received in error. The sender does not give any warranty or accept > liability as the content, accuracy or completeness of sent messages and > accepts no responsibility for changes made after they were sent or for other > risks which arise as a result of e-mail transmission, viruses, etc. > > > On Thu, Nov 27, 2014 at 9:45 PM, Danny Cheng <dch...@mdacorporation.com> > wrote: >> Hi, >> >> >> >> Did anyone notice a significant drop in JPEG2000 performance when >> making WMS GetMap request? My request format is PNG and tile size is >> 256x256. I find that it is taking very long to encode to PNG and it >> took about 4 minutes to get back my image. I didn’t have this problem with >> 2.5.2. >> >> >> >> Thanks, >> Danny >> >> >> >> >> --------------------------------------------------------------------- >> - >> -------- Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT >> Server from Actuate! Instantly Supercharge Your Business Reports and >> Dashboards with Interactivity, Sharing, Native Excel Exports, App >> Integration & more Get technology previously reserved for >> billion-dollar corporations, FREE >> http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg. >> clktrk _______________________________________________ >> Geoserver-users mailing list >> Geoserver-users@lists.sourceforge.net >> https://lists.sourceforge.net/lists/listinfo/geoserver-users >> ------------------------------------------------------------------------------ Download BIRT iHub F-Type - The Free Enterprise-Grade BIRT Server from Actuate! Instantly Supercharge Your Business Reports and Dashboards with Interactivity, Sharing, Native Excel Exports, App Integration & more Get technology previously reserved for billion-dollar corporations, FREE http://pubads.g.doubleclick.net/gampad/clk?id=157005751&iu=/4140/ostg.clktrk _______________________________________________ Geoserver-users mailing list Geoserver-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/geoserver-users
