Hi Miloslav, please cc the mailing list when replying.
On Aug 25, 2010, at 6:17 AM, Miloslav Kmeť wrote: > Hi Gabriel. > > Thank you for a quick response and explantation. I'll create a ticket about > the issue. Of course, we could be a testers. > > Our GIS architecture is ESRI oriented, but we are also interested in > geoserver, because we like open source and geoserver looks fine. > > Reprojection is a key feature, that is necessary for us. We are serving large > amount of layers for various organizations. In Slovakia ESRI JTSK 102067 is > widely used, but we also need to distribute the data at least in WGS84 (epsg > 4326) and some others. > > How it is possible, that ArcGIS fetches and reprojects the data very fast? The reason is somewhat explained in the previous reply. I can't say for sure (as I can't look at ArcGIS source code :) ), but I bet they just build the in memory image doing sequential tile fetching, which is fast. What I'm not sure if you can get the whole coverage contents from ArcGIS. Does it has a WCS or similar service? is it possible to ask it for 100k x 100x pixels raster? In any case, I knew there could be some issues with the way we're doing things right now, and it's 99% probable that we're doing something wrong or at least un-optimally. I don't know if SDE can do server side reprojection though, I didn't find anything about it. It'd be cool if it can, but I don't think so. If you can use a GeoServer-2.1-SNAPSHOT (like in latest nightlies) I could send you a replacement jar to try out and see how it performs with JAI tile cache enabled (the code is there, is just a matter of swapping a flag). That'd be the easiest fix. More complicated tunning can be done too, like in a (configurable?) max requested image size to decide whether to do streaming or not. Cheers, Gabriel > If I understand it correctly, Geoserver needs to fetch the data in native > SRS, and then the data are reprojected to requested SRS in > Geoserver/geotools. I think, that ArcGIS fetches data from SDE reprojected > (through some SDE function). Am I right? I am not an SDE expert, or Java > developer. > > We have also the same issue with performance on vector layers. If the vector > is simple it fetches and reprojects data very fast, but as long as we add > more complicated layers to the WMS, the performance goes down. While ArcGIS > is as fast as without any reprojection. > > Thank You > > Miloslav Kmeť > > > On streda 25 August 2010 01:34:23 you wrote: >> I suspected that... sigh. >> >> Could you please create a jira issue about this? >> <http://jira.codehaus.org/browse/GEOT> component: data-arcsde, asignee: me. >> >> There's a difficult compromise to take wrt ArcSDE raster performance. Right >> now it's optimized for no reprojection and streaming. Meaning it takes >> advantage of the rasters pyramid of tiles to conserve server resources while >> at the same time being able of serving large images. >> The other two options are: >> - building the image in-memory, of the requested size. This can easily lead >> to out of memory exceptions and very poor performance >> - Using the JAI tile cache: hard to optimize, in the long run/under >> concurrency can bloat memory or incur in high synchronization costs, >> affecting performance. >> >> Second option seems like a better compromise though, as long as its tunable. >> >> The underlying reason is that having to fetch the raster tiles from the >> database is not as a cheap operation as it would be by reading directly from >> disk (like for a tiled geotiff with overview). The ArcSDE plugin needs to >> execute a database query that'll fetch all the tiles needed and traverse >> them (like if it were a JDBC resultset). Problem is when reprojection is >> applied, the JAI operation chain tends to request for tiles in non >> consecutive order, forcing the execution of more database queries, as the >> "resultset" can't be rewinded. Using the JAI tile cache more aggressively >> alleviates the need for extra database queries, that are expensive. >> >> Building the requested image fully in memory instead of streaming is fast as >> long as the image size is small. But one can easily request for the whole >> raster with WCS, and that just won't work. >> >> That's the explanation, now we should get to a better compromise. >> >> Thanks for reporting the problem. Would you like to be a tester? >> >> Cheers, >> Gabriel >> On Aug 24, 2010, at 4:47 AM, Miloslav Kmeť wrote: >> >>> We have tested on several servers GEOSERVER 2.x with ArcSDE 9.3.1 rasters >>> reprojection of >>> WMS service. >>> >>> It's extremly slow. >>> >>> Can you help? >>> >>> Testing url: >>> >>> http://geo.enviroportal.sk/geoserver/sazp/zakladna_mapa_10000/wms - slow >>> >>> http://geo.enviroportal.sk/geoserver/sazp/dmr3/wms - timeout >>> >>> http://geo.enviroportal.sk/geoserver/sazp/IMA_2000/wms - mostly timeout >>> >>> Same data in WMS - ArcGis server works for reprojection fast. >>> >>> Thank you >>> >> >> Gabriel Roldan >> [email protected] >> Expert service straight from the developers >> >> Gabriel Roldan [email protected] Expert service straight from the developers ------------------------------------------------------------------------------ Sell apps to millions through the Intel(R) Atom(Tm) Developer Program Be part of this innovative community and reach millions of netbook users worldwide. Take advantage of special opportunities to increase revenue and speed time-to-market. Join now, and jumpstart your future. http://p.sf.net/sfu/intel-atom-d2d _______________________________________________ Geoserver-users mailing list [email protected] https://lists.sourceforge.net/lists/listinfo/geoserver-users
