Re: [mapserver-users] Storing GeoTIFFs in Amazon S3 for use with Mapserver?

2014-11-05 Thread Frank Warmerdam
Robert,

I was actually using the vsicurl support from a prep-script similar to
gdaltindex, not from in mapserver directly, so I don't have a handy
example.  I'd also be concerned that accessing the data via /vsicurl/ would
have performance problems that would make it unwise for direct access from
MapServer.  One benefit of the S3 file system handlers is that they cache
the files locally so multiple tile renders in mapserver from the file would
be fast after the first fetch.  If you use /vsicurl/ then I don't think
that local caching would occur between mapserver render requests.

Best regards,
Frank

On Wed, Nov 5, 2014 at 12:07 PM, Robert Sanson 
robert.san...@asurequality.com wrote:

 Thanks Frank.

 Do you have an example of a mapfile layer section using GDAL with vsicurl
 to retrieve GeoTIFFs?

 In my case I use a tileindex to access a directory of GeoTIFFs but we want
 to move them into S3. Here is a layer from my mapfile:

 LAYER
   NAME sthl-075m-rural-2005-11
   GROUP 'highres'
   TYPE RASTER
   STATUS ON
   TILEINDEX ../../data/nz/sthl-075m-rural-2005-11_ind
   TILEITEM Location
   MAXSCALE 10
   METADATA
'ows_title' 'sthl-075m-rural-2005-11'
'wms_opaque' '1'
'wms_group_title' 'highres'
'wms_resx' '0.75'
'wms_resy' '0.75'
'ows_extent' '1088800.0 4743600.0 1314400.0 5089200.0'
   END
  END

 Thanks,

 Robert

  Frank Warmerdam warmer...@pobox.com 5/11/2014 1:45 p.m. 
 Robert,

 I've done some variations on this.

 I'd encourage you to watch a video by Mark Korver on this topic from
 FOSS4G: http://vimeo.com/106833852

 I used his NAIP bucket in requestor-pays mode successfully.  One thing
 that I ended up doing when reading the metadata was to use the vsicurl
 driver to access the tiffs, so only the required portions were fetched.
 His example actually mounts the whole bucket as a file system in which case
 things are much easier.

 I will note that when using vsicurl to access GeoTIFFs in S3 I found I had
 to set the following configuration variables to get it working.

 # Various /vsicurl hackery to get it working with signed aws urls well
 gdal.SetConfigOption('CPL_VSIL_CURL_ALLOWED_EXTENSIONS', 'ter')
 gdal.SetConfigOption('GDAL_DISABLE_READDIR_ON_OPEN', 'YES')
 gdal.SetConfigOption('CPL_VSIL_CURL_USE_HEAD', 'NO')

 I do quite a bit of stuff here with MapServer from S3, but I usually fetch
 from S3 and store in /tmp for serving so by the time MapServer sees the
 file it is completely normal.

 Best regards,
 Frank


 On Tue, Nov 4, 2014 at 2:56 PM, Robert Sanson 
 robert.san...@asurequality.com wrote:

  Does anyone have experience with using Amazon S3 to store GeoTIffs for
 use
  as a back-end datastore accessible by Mapserver in order to create a WMS
  service?
 
  Thanks,
 
  Robert Sanson
 
 
  Robert Sanson Veterinary Epidemiologist
  Batchelar Centre | Tennent Drive | Palmerston North
  PO Box 585 | Palmerston North 4440 | New Zealand
  p. +64 6 351 7990 | m. +64 21 448 472 | f. +64 6 351 7919
  e. robert.san...@asurequality.com
 
  Global experts in food safety and quality | www.asurequality.com
 
 
 
 
  This email and any attachments are confidential and intended solely for
  the addressee(s). If you are not the intended recipient, please notify us
  immediately and then delete this email from your system.
 
  This message has been scanned for Malware and Viruses by Websense Hosted
  Security.
  www.websense.com
  ___
  mapserver-users mailing list
  mapserver-users@lists.osgeo.org
  http://lists.osgeo.org/mailman/listinfo/mapserver-users
 



 --

 ---+--
 I set the clouds in motion - turn up   | Frank Warmerdam,
 warmer...@pobox.com
 light and sound - activate the windows | http://pobox.com/~warmerdam
 and watch the world go round - Rush| Geospatial Software Developer




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [mapserver-users] Storing GeoTIFFs in Amazon S3 for use with Mapserver?

2014-11-04 Thread Frank Warmerdam
Robert,

I've done some variations on this.

I'd encourage you to watch a video by Mark Korver on this topic from
FOSS4G: http://vimeo.com/106833852

I used his NAIP bucket in requestor-pays mode successfully.  One thing
that I ended up doing when reading the metadata was to use the vsicurl
driver to access the tiffs, so only the required portions were fetched.
His example actually mounts the whole bucket as a file system in which case
things are much easier.

I will note that when using vsicurl to access GeoTIFFs in S3 I found I had
to set the following configuration variables to get it working.

# Various /vsicurl hackery to get it working with signed aws urls well
gdal.SetConfigOption('CPL_VSIL_CURL_ALLOWED_EXTENSIONS', 'ter')
gdal.SetConfigOption('GDAL_DISABLE_READDIR_ON_OPEN', 'YES')
gdal.SetConfigOption('CPL_VSIL_CURL_USE_HEAD', 'NO')

I do quite a bit of stuff here with MapServer from S3, but I usually fetch
from S3 and store in /tmp for serving so by the time MapServer sees the
file it is completely normal.

Best regards,
Frank


On Tue, Nov 4, 2014 at 2:56 PM, Robert Sanson 
robert.san...@asurequality.com wrote:

 Does anyone have experience with using Amazon S3 to store GeoTIffs for use
 as a back-end datastore accessible by Mapserver in order to create a WMS
 service?

 Thanks,

 Robert Sanson


 Robert Sanson Veterinary Epidemiologist
 Batchelar Centre | Tennent Drive | Palmerston North
 PO Box 585 | Palmerston North 4440 | New Zealand
 p. +64 6 351 7990 | m. +64 21 448 472 | f. +64 6 351 7919
 e. robert.san...@asurequality.com

 Global experts in food safety and quality | www.asurequality.com




 This email and any attachments are confidential and intended solely for
 the addressee(s). If you are not the intended recipient, please notify us
 immediately and then delete this email from your system.

 This message has been scanned for Malware and Viruses by Websense Hosted
 Security.
 www.websense.com
 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [mapserver-users] preparing orthos for Mapserver?

2013-10-06 Thread Frank Warmerdam
On Sun, Oct 6, 2013 at 12:41 AM, Andrea Aime
andrea.a...@geo-solutions.it wrote:
 On Sat, Oct 5, 2013 at 4:21 PM, Frank Warmerdam warmer...@pobox.com wrote:

 Great advice from Jukka, and I'd just note that GDAL
 *will* efficiently pull out reduced resolution images on
 the fly without overviews if you have a file organized
 with a one scanline block even in the year 2013.  For
 map serving you are still much better off for several
 reasons with the tiles+overviews approach, but I do
 love the properly that a one-block-scanline file can be
 quickly subsamled by viewer applications like OpenEV
 and QGIS.


 Hi Frank,
 this is quite interesting. Can you elaborate a bit of what one block
 scanline means?

Andrea,

It means using a strip organized file with the strip one row long.
This can be accomplished with the BLOCKYSIZE creation option as
mentioned by Jukka.

 E.g., what is the actual tiling structure of this file?
 Does presence of compression affect the ability to do the subsampling?

Note that the sampling advantage is still only in the vertical.  A
high resolution horizontal scanline is still read and subsampled
conventionally.  It is not clear that compression will make any more
difference than normal.

 How about quality of the output? (e.g., is GDAL reading one pixel every N to
 generate
 the reduced resolution version?)

Well, the normal GDAL subsampling rules apply which is nearest
neighbour for simple windowed subsamples.  So building overviews gives
the advantage that you can apply a better rule, like averaging.

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] WMS GeoTIFF query with multiple bands

2013-08-28 Thread Frank Warmerdam
Chheang Be,

You will want IMAGEMODE INT16 which takes a quite distinct code path which
supports multiple bands.

You may also need to use FORMAT GDAL/GTiff in your OUTPUTFORMAT
declaration for this to work properly, I don't exactly recall.   The BANDS
declaration may also be of use if you want to control the band selection.

See:
  http://mapserver.org/mapfile/outputformat.html

https://github.com/mapserver/msautotest/blob/master/gdal/rawmode_multiband.map

Best regards,
Frank



On Wed, Aug 28, 2013 at 2:39 PM, geoguru chhean...@gmail.com wrote:

 How would you go about serving a 16bit GeoTIFF with n number of bands and
 be
 able to have the WMS query return all the bands in the GeoTIFF.  I've
 attempted to use the GDAL/GTiff driver to return tiffs, but could only
 return a max of 4 bands using the RGBA ImageMode.



 --
 View this message in context:
 http://osgeo-org.1560.x6.nabble.com/WMS-GeoTIFF-query-with-multiple-bands-tp5074859.html
 Sent from the Mapserver - User mailing list archive at Nabble.com.
 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users

Re: [mapserver-users] FCGI and SVG output goes to STDERR?

2013-07-01 Thread Frank Warmerdam
Nick,

As I vaguely recall from when I worked on fastcgi support in MapServer,
only output formats that can be redirected through the low level mapserver
io layer (ms_io*.c) will work properly in fastcgi mode.  I'm guessing the
svg encoder just writes directly to stdout.  If my theory is correct,
non-trivial code changes would be necessary to make this work.

Best regards,
Frank



On Mon, Jul 1, 2013 at 5:16 PM, Nick Webb ni...@redwireservices.com wrote:

 List,

 I've really tried hard to nail this down, but it makes no sense to me.
  I'm not a map guy, but am a system administrator for one.

 We have a mapserver setup that works fine for both PNG and SVG when we use
 the standard apache cgi module.  When we switch to mod_fcgid, however, SVG
 displays no output in the browser and instead seems to output proper
 SVG/XML to the apache error log!  PNG continues to work fine.

 I'm flabbergasted and nothing I try seems to work.  I even set it up on
 another server and I get the same result, given I'm following the same
 build steps.

 Any ideas on where I can go next?

 Perhaps the SVG is not really valid, but I've copied and pasted the
 XML/SVG from the error_log to a static file, and that also displays fine
 via a browser.

 Here is the error_log output:

 ?xml version=1.0 encoding=UTF-8?
 svg xmlns=http://www.w3.org/2000/svg; xmlns:xlink=
 http://www.w3.org/1999/xlink; width=200pt height=154pt viewBox=0 0
 200 154 version=1.1
 g id=surface0
 . . .
 /g
 /svg
 [Tue Jul 02 00:12:11.947149 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: CGI Request 1 on process 2405
 [Tue Jul 02 00:12:11.947213 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: msDrawMap(): rendering using
 outputformat named svg (CAIRO/SVG).
 [Tue Jul 02 00:12:11.947223 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: msDrawMap(): WMS/WFS set-up and
 query, 0.000s
 [Tue Jul 02 00:12:11.947230 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: msDrawMap(): Layer 0 (thematic),
 0.040s
 [Tue Jul 02 00:12:11.947238 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: msDrawMap(): Drawing Label Cache,
 0.000s
 [Tue Jul 02 00:12:11.947245 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: msDrawMap() total time: 0.040s
 [Tue Jul 02 00:12:11.947253 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.69:2118] mod_fcgid: stderr: msSaveImage(stdout) total time:
 0.005s
 [Tue Jul 02 00:12:11.947261 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: mapserv request processing time
 (msLoadMap not incl.): 0.045s
 [Tue Jul 02 00:12:11.947268 2013] [fcgid:warn] [pid 2398] [client
 50.197.85.9:2118] mod_fcgid: stderr: msFreeMap(): freeing map at 0x8881a0.


 DEBUG 5 is set logging to the same file (stderr).


 ./mapserv -v
 MapServer version 6.2.1 OUTPUT=GIF OUTPUT=PNG OUTPUT=JPEG SUPPORTS=PROJ
 SUPPORTS=GD SUPPORTS=AGG SUPPORTS=FREETYPE SUPPORTS=CAIRO SUPPORTS=ICONV
 SUPPORTS=WMS_SERVER SUPPORTS=WMS_CLIENT SUPPORTS=WFS_CLIENT
 SUPPORTS=WCS_SERVER SUPPORTS=FASTCGI SUPPORTS=THREADS SUPPORTS=GEOS
 INPUT=JPEG INPUT=POSTGIS INPUT=OGR INPUT=GDAL INPUT=SHAPEFILE


 Thanks,
 Nick

 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Best way to import 4.5TB of imagery?

2013-06-10 Thread Frank Warmerdam
On Mon, Jun 10, 2013 at 3:48 PM, Evans, James R Civ USAF ACC 84 RADES/SCZE 
james.ev...@hill.af.mil wrote:

 So, I'm guessing there's no easy way to automate this?  Even looking at the
 states, some of the states are in two zones, and Texas is across 3 zones.
 At least the naming convention of the files indicate the UTM zone.


James,

Note it is pretty easy to write a script (ie. in Python) that would walk
the directory tree and sort the images into distinct (per utm zone)
collections. So, yes, the processing of this data is very automatable.


 For
 instance:  m_2408002_ne_17_1_20100422_201001123.jp2, is in zone 17.  As far
 as I can tell, all the files in a particular directory are all in the same
 UTM zone.  I could create a layer for each UTM zone across CONUS, but
 that's
 not going to be particularly useful to my users.  I'm thinking of making a
 layer for each state.  For the stats that cross zones, there will probably
 be two layers.  For Texas, there would be Texas_east, Texas_middle, and
 Texas_west.  I will probably limit visibility until zoomed in sufficiently


Is it important to you to distinguish things by state?  If not, why not one
layer per utm zone, and then join them in a layer group 'UTM NAIP' that the
users would either turn on or off?


 to see the whole state on the screen anyway, since the continental view of
 this data is pretty crappy anyway.


Limiting visibility to reasonable resolutions should be fine and would help
you avoiding needing additional preprocessing to create an overview of the
whole collection.


  So now it seems like it will be a lot of
 grunt work just copying these directories up to the server, and going
 through and creating a shape file index for each state.  For states in more
 than one UTM, there would be more than one shape.  Then I'll have to add a
 layer for to my mapfile for each shapefile, using the correct projection.
 Is there an easier way?  I'm starting with Oklahoma, which is also in three
 UTM zones.  I'll get that working before moving on.  Any suggestions on
 making this pretty would be welcomed.  :-)


Well, I still think you should take states out of the equation unless that
is important to your users.

Good luck,

Best regards,

-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Is there still a 2GB size limit on shapefiles?

2013-05-09 Thread Frank Warmerdam
Folks,

The changes I made were mostly focused on supporting large DBF files which
don't have the 32bit offsets issue.

The offsets for shapefiles are actually to 16bit words, so in theory if the
offsets were treated as unsigned 32bit values they could address up to 8GB
.shp files.  I don't recall however, if I ever got that working.  Even if
it was done it is not clear to me these files would work smoothly with
other applications.

I'd been hoping someone else might have authoritative comment in this
thread. :-)

Best regards,
Frank


On Wed, May 8, 2013 at 9:49 PM, Stephen Woodbridge
wood...@swoodbridge.comwrote:

 In general the shapefile spec is owned by ERSI and unless they change the
 spec you will have a problem. Last I knew, there are pointers/offsets
 inside the shapefile that are only 32bits wide per the spec. it is because
 of these that you are limited to 2GB.

 At some point I thought Frank W or someone was working on a version of
 shapelib that could support greater than 2GB, but only programs that used
 that version would be able to read/write these larger files. I have not
 heard anything on that front in a while so I don't know if that was just
 talk, or code ever materialized.

 -Steve W


 On 5/9/2013 12:32 AM, Rahkonen Jukka wrote:

 Hi,

 I am not sure either if reading 2GB shapefiles works with the native
 shp reader on all platforms, but as the ticket says, you should be
 able to use OGR connection in the mapfile even with your current
 version. If you use OGR you can also split the shapefile into pieces
 and read them through the ogr tileindex system which may be faster
 sometimes.

 -Jukka Rahkonen-

 __**__ Andrea Peri wrote:

  If it don't work you should evalute the option to use spatialite.
 It work well with dataset greater than 2GB . I use it with
 mapserver 6.3dev and gdal 1.10.




 2013/5/9 Roger André 
 ran...@gmail.commailto:randr**e...@gmail.comran...@gmail.com
 
 Pretty sure I just hit
 thishttp://trac.osgeo.org/**mapserver/ticket/3514http://trac.osgeo.org/mapserver/ticket/3514
 problem in my 6.0.3
 local stack.  I haven't tested it in the current release, but does
 anyone know for sure that a shapefile with any component larger than
 2GB works in 6.2?

 Roger

 __**_ mapserver-users
 mailing list
 mapserver-users@lists.osgeo.**org mapserver-users@lists.osgeo.org
 mailto:mapserver-users@**lists.osgeo.orgmapserver-users@lists.osgeo.org
 


  
 http://lists.osgeo.org/**mailman/listinfo/mapserver-**usershttp://lists.osgeo.org/mailman/listinfo/mapserver-users





 -- - Andrea Peri . . . . . . . . . qwerty àèìòù
 - __**_
 mapserver-users mailing list 
 mapserver-users@lists.osgeo.**orgmapserver-users@lists.osgeo.org
 http://lists.osgeo.org/**mailman/listinfo/mapserver-**usershttp://lists.osgeo.org/mailman/listinfo/mapserver-users


 __**_
 mapserver-users mailing list
 mapserver-users@lists.osgeo.**org mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/**mailman/listinfo/mapserver-**usershttp://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] SLD with colour ramp in WMS GetMap

2013-02-15 Thread Frank Warmerdam
Luis,

I suspect the problem is how raster values are scaled.  I think the raster
SLD is applied essentially as a set of classes on the layer but it is not
clear how scaling gets set.  What does the layer definition look like?  Can
you try doing what you want with mapserver classes in the map file?

While your SLD looks fine, how these are used by mapserver is fiddly.

Best regards,
Frank
 On Feb 15, 2013 2:55 AM, Luís de Sousa luis.a.de.so...@gmail.com wrote:

 Hello everyone,

 I have a raster layer with the following range of values:

 $ gdalinfo -hist my_data.tiff
 [...]
 STATISTICS_MAXIMUM=128.30499267578
 STATISTICS_MEAN=6.3870258293789
 STATISTICS_MINIMUM=-9.5671482086182
 STATISTICS_STDDEV=11.960967394892

 This is layer is being published through Mapserver and I get perfectly
 correct maps through WMS.

 Now I'd like to style the maps retrieved by mapserver using the SLD
 parameter of the GetMap request. I'm starting with the basic example in the
 SLD Cookbook [1]:

 ?xml version=1.0 encoding=UTF-8?
 StyledLayerDescriptor version=1.0.0
   xmlns=http://www.opengis.net/sld;
   xmlns:ogc=http://www.opengis.net/ogc;
   xmlns:xlink=http://www.w3.org/1999/xlink;
   xmlns:xsi=http://www.w3.org/2001/XMLSchema-instance;
   xsi:schemaLocation=http://www.opengis.net/sld
   http://schemas.opengis.net/sld/1.0.0/StyledLayerDescriptor.xsd;
   NamedLayer
 Namemy_data/Name
  UserStyle
   TitleSLD Cook Book: Two color gradient/Title
   FeatureTypeStyle
 Rule
   RasterSymbolizer
 ColorMap
   ColorMapEntry color=#008000 quantity=-10 /
   ColorMapEntry color=#66 quantity=130 /
 /ColorMap
   /RasterSymbolizer
 /Rule
   /FeatureTypeStyle
 /UserStyle
   /NamedLayer
 /StyledLayerDescriptor

 When I issue a request with this SLD file:


 http://my.server/cgi-bin/mapserv?map=/var/www/file.mapVERSION=1.1.1REQUEST=GetMapLAYERS=my_dataSRS=EPSG:3857BBOX=497600,6784100,498900,6786500WIDTH=300HEIGHT=600FORMAT=image/gifSLD=http://my.server/SLD/my_data.sld

 I'm getting back simply a green patch (see the file my_data_SLD.gif).
 Whereas without the SLD argument the features in the file are quite visible
 (my_data.gif).

 http://osgeo-org.1560.n6.nabble.com/file/n5034507/my_data_SLD.gif

 http://osgeo-org.1560.n6.nabble.com/file/n5034507/my_data.gif

 So what's wrong in here? The SLD file is exactly the same found in the SLD
 cookbock, I doubt it has an error. Do I have to configure the layer somehow
 in the map file in order for Mapserver to style it with the SLD?

 Thank you.

 [1]

 http://docs.geoserver.org/latest/en/user/styling/sld-cookbook/rasters.html#example-raster



 --
 View this message in context:
 http://osgeo-org.1560.n6.nabble.com/SLD-with-colour-ramp-in-WMS-GetMap-tp5034507.html
 Sent from the Mapserver - User mailing list archive at Nabble.com.
 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] OGR Virtual Format and character encoding

2012-08-31 Thread Frank Warmerdam
Chris,

I'm a bit unclear if the problem is happening in the MS SQL driver, or in the
VRT driver.  If you use OGR directly against the MS SQL data are things
messed up?  Are you using ODBC or the actual MSSQLSpatial driver?

Best regards,
Frank

On Fri, Aug 31, 2012 at 1:07 PM, Chris Jackson webturt...@gmail.com wrote:
 All

 One thought I did have, if the characters where html encoded in the SQL
 table (e.g. ü as #252;) is there anyway to get MapServer to render them
 correctly again in a label?  I guess OGR can only deal with UTF-8 encoded
 characters (I am using nvarchar fields, but in an ISO collation in SQL 2005
 - not v.UTF-8 friendly I think!)

 Thanks
 Chris


 On 30 August 2012 15:46, Chris Jackson webturt...@gmail.com wrote:

 Hi all

 I have OGR Virtual Format layer in my map file and the underlying .OVF is
 calling a flat MS SQL table of point data.  The layer displays fine, but I
 am having issues with umlauts etc for one of the attribute fields.  When I
 run the ogrinfo command on the layer, it has already messed up the encoding.
 In SQL it looks and queries fine.  Any pointers on how you can maintain the
 encoding?

 Many thanks
 Chris



 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] OGR Virtual Format and character encoding

2012-08-31 Thread Frank Warmerdam
On Fri, Aug 31, 2012 at 1:37 PM, Chris Jackson webturt...@gmail.com wrote:
 Frank

 I am using SrcDataSourceODBC:. in the OVF file.  I am parsing the file
 using OGRinfo via commandline and the characters are looking odd straight
 away.

Chris,

I'm not convinced that command windows support UTF-8 output properly
so funny looking output from ogrinfo in a command window may not
be a conclusive indicator of whether the driver is returning UTF-8 or not.

Since you are going through ODBC I imagine the key to the translation
is in gdal/port/cpl_odbc.cpp.  In particular I see that SQL_WCHAR and
friends are translated as wide characters while SQL_CHAR is not.  I
am not clear on whether NVARCHAR fields in MS SQL are represented
as SQL_VARCHAR or SQL_WVARCHAR at the ODBC level of the code.

You might want to try changing:

case SQL_CHAR:
case SQL_VARCHAR:
case SQL_LONGVARCHAR:
return SQL_C_CHAR;

in the cpl_odbc.cpp GetTypeMapping() code to return
SQL_C_WCHAR instead and see if that helps.  You might
also want to put in a printf() in the SQL_WCHAR case to see
if it being used or not.

 Hadn't thought about using the spatial add-on for 2005, can that be
 called directly from the mapfile instead?  I usually just use shapefiles
 (performance surprising good), but have need of a SQL table of point data
 (all over Europe - hence the character issues) updated via a web-form to be
 called via MapServer and another application.  Any pointers appreciated!

I am not clear on the details of the MSSQLSpatial driver, but if you
aren't using the mssql spatial types then you might be just as well
to stick with ODBC.

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Projection issue with vrt file

2012-04-21 Thread Frank Warmerdam

On 12-04-20 06:39 PM, Morin, Marc-André wrote:

Hi All,

I'm trying to add a VRT raster file (BSB chart) to my mapfile, but it doesn't
work totally.
In fact, all of my tiles are generated, but they have no data... No error is
logged...

It sounds like the projection or the transformation matrix is not well
supported, or not well configured.

If I put in comments the GeoTransform element, some blank tiles are shown where
the lower left corner is located at the origin (0.000, 0.000).

Moreover, I successfully opened that same VRT file with QGIS, and the
projection is ok...


Marc-Andre,

It is not clear to me why it is not working properly with mapserver, though
I would encourage you to define the projection of the layer's data in the
mapfile.  MapServer does not pull this from the underlying file by default.

I will also note that MapServer does not use the GCPs so you can ommit the
GCPList chunk from the VRT file.

If setting the PROJECTION block on the layer does not help, you can enable
debugging to get a better idea of what chunks are being selected from the
VRT file.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://home.gdal.org/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] gdaldatasetrasterIO() failed: ireadblock failed

2012-03-20 Thread Frank Warmerdam

On 12-03-19 09:21 AM, Pedro Costa wrote:

Hello list,


My server can´t open a tif that i have in my mapfile.
It gives this error:

gdaldatasetrasterIO() failed: ireadblock failed

Someone know what is this problem?


Pedro,

It means the GDAL raster library used by MapServer was unable to read a
chunk of the underlying file imagery.  It could potentially mean a corrupt
TIFF file.  You might want to try gdal_translate your.tif new.tif from
the commandline.  If the file is corrupt that is likely to fail and then
you could file a ticket referencing the file if you think it is valid.

BTW, it can be helpful to capture a more exact representation of the error
along with preceding information.  Usually IReadBlock failures are accompanied
by some additional error information that would have resulted in a better
answer here.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://home.gdal.org/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] mapserver / gdal draw failure

2012-02-23 Thread Frank Warmerdam
On Thu, Feb 23, 2012 at 7:05 AM, Aaron Sims aps...@ncsu.edu wrote:
 gdalinfo on the tiff files yields:

Aaron,

You might want to try:

  gdalinfo -mm /home/cache/2012021913-2012022013.tif

This will force actual reading of the imagery blocks to compute
a min/max for each band and will help determine if there is any
problem with the imagery.  I don't really understand your overall
process well, but I am suspicious there might be an issue where
whatever is writing the .tif file is not quite finished flushing it out
before you are trying to read it with mapserver.  The error is what
I might expect from reading an unflushed TIFF file.

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] speed up WCS access to large GeoTIFF

2012-02-08 Thread Frank Warmerdam

On 12-02-08 09:05 PM, John Cartwright wrote:

Hello All,

I have a WCS service on a large GeoTIFF image.  Are there any strategies for 
speeding up the GetCoverage request?



John,

The usual raster strategies should apply.  Build overviews, and tile the
image.  Beyond that more memory for caching and faster computers may help
a bit.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://home.gdal.org/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


[mapserver-users] Web site downtime

2012-02-01 Thread Frank Warmerdam
Folks,

The OSGeo ProjectsVM is down while we upgrade the OS (an upgrade
that has encountered some issues).  While this is being resolved the
hosted sites including gdal.org, mapserver.org, grass.org will be down.

  http://wiki.osgeo.org/wiki/ProjectsVM

Downtime could potentially be in the hours or even a day or two.  I won't
announce when things are back but you can always try.  Note that Trac
for bug reporting, and subversion are not down.

Sorry for the inconvenience.  And damn Debian major OS version
in-place upgrades. :-)

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] WMS non-square extent query using openlayers

2012-01-25 Thread Frank Warmerdam
David,

MapServer is definately able to return results that are non-square,
and further that do not have 1:1 aspect ratio with the geo request
(thus resulting in requesting so called non square pixels).  In WMS
mode I believe non-square pixel support is enabled by default - I think
this is not the case in traditional MapServer mode.

But if I were you, I'd start by examining that WMS request is actually
being generated and sent to MapServer by OpenLayers and determine
if it is doing what it ought to.

BTW, I'm surprised you are seeing three sides of the request and
one not being.  When MapServer fixes extents that imply non-square
pixels it would end up changing two sides (actual sides or bottom and
top) equally.

Best regards,

On Wed, Jan 25, 2012 at 2:43 PM, David Quinn daithiqu...@gmail.com wrote:
 Hi List,

 Is it possible to receive a non-square tile, or collection of tiles, from a
 WMS query? I'm using openlayers to send a WMS query based on a user-chosen
 extent of a rectangular polygon. My javascript is as follows:

     WMSLayer = new OpenLayers.Layer.WMS(
            layerName,
            wms_server,
            {layers: 'roads', },
            {'maxExtent': polygonBounds}
    );

 The initial part of my .map file is:

 MAP
     NAME
  roads
     UNITS  meters
     EXTENT   -85 495000 -89 50
     SIZE             256 256
     STATUS   OFF
     DEBUG    ON

 and I am returning information from a raster.The query returns a WMS layer
 fine, but only three of the four sides of the polygon have the correct
 extents, and the WMS layer is a square. I've tried to illustrated this in
 the below diagram:

 X = requested
 _
 |    |
 |      |
 |      |
 |    |
 -

 Y = returned
 _
 |       |
 |       |
 |       |
 | |
 --

 I've tried adjusting the SIZE values but this does not seem to change the
 limit. The extents are definitely correct, as I've used them for querying
 non-WMS data that is displayed in-browser. When I subtracted a value from
 the bound.top value in Openlayers, the correct values were returned, but
 this did not seem like the right way to fix the problem. I'd appreciate any
 suggestions!

 Thanks,
 David



 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] WMS non-square extent query using openlayers

2012-01-25 Thread Frank Warmerdam
On Wed, Jan 25, 2012 at 3:34 PM, David Quinn daithiqu...@gmail.com wrote:
 Just to clarify - so non-square results should be returned without doing
 anything special on the mapserver side?

David,

That is my understanding in WMS mode.



 But if I were you, I'd start by examining that WMS request is actually
 being generated and sent to MapServer by OpenLayers and determine
 if it is doing what it ought to.


 This is an example of the html that is returned on screen:

 img id=OpenLayersDiv119 style=width: 256px; height: 256px; position:
 relative; opacity: 0.5; class=olTileImage
 src=http://mysite.com/mapserv.cgi?map=roads.mapamp;LAYERS=roadsamp;TRANSPARENT=TRUEamp;SERVICE=WMSamp;VERSION=1.1.1amp;REQUEST=GetMapamp;STYLES=amp;FORMAT=image%2Fpngamp;SRS=EPSG%3A900913amp;BBOX=-8234561,4996137,-8214993,5015705amp;WIDTH=256amp;HEIGHT=256;

 In this case, I set SIZE 64 64 in my mapfile, but it did not make a
 difference, as 256 seems to be used. The polygon bounds calculated in
 browser using openlayers are as follows: -8254128,4976569,-8215574,4996932

 I can now see that the problem is due to the entire tile being included, and
 not clipped to the upper extent. But this is strange, as the verticals are
 being clipped ok, as is the lower extent.

I see that the request getting sent to MapServer is 256x256 and
for a BBOX that is 19568m by 19568m so it seems the problem
is with client side request composition.

Note that the SIZE keyword in your map file has no effect
on anything when using WMS requests.  I believe it is the
default image size when using non-WMS map=mode requests
to MapServer without an explicit size in the request.

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


[mapserver-users] Re: Trouble with South pole projection issues

2012-01-20 Thread Frank Warmerdam
On Fri, Jan 20, 2012 at 11:51 AM, Fuchs Juan Carlos 
jf...@indec.mecon.gov.ar wrote:

 ** **

 Hi Mr Frank Warmerdam

 I sent out this post, but no one answer, so I´m here, bothering you again.
 

 Any adwise would gratefull received!

 Happy New Year!

 Juan Carlos Fuchs, from Argentina.



 ...



 This is the *.prj from the shp i have, and need to bring along with the
 other one.

 ** **


 PROJCS[lambert,GEOGCS[GCS_WGS_1984,DATUM[D_WGS_1984,SPHEROID[WGS_1984,6378137.0,298.257223563]],PRIMEM[Greenwich,0.0],UNIT[Degree,0.0174532925199433]],PROJECTION[Lambert_Azimuthal_Equal_Area],PARAMETER[False_Easting,1000.0],PARAMETER[False_Northing,6391246.5],PARAMETER[Central_Meridian,-60.0],PARAMETER[Latitude_Of_Origin,-40.0],UNIT[Meter,1.0]]
 

 ** **

 that is my first try so far,: from my *.map file layer (Projection)

 ** **

 PROJECTION

 proj=laea

 ellps=WGS84

 lat_1=40

 lon_0=-60

 south

 END


 ...


 As you can see it goes LL EPSG:4326 in geographics () is there some
 doc I can read about the towgs84 Parameters, my guess is that they have
 not to be 0,0,0,0,0,0,0



Juan,

I do not believe the problem is related to the +towgs84 datum shifting.  I
believe the problem is that your LAEA projection definition for MapServer
lacks the false easting and northing values.  Try something like:


PROJECTION

   +proj=laea +ellps=WGS84 +lat_1=40 +lon_0=-60 +south +x_0=1000.0
+y_0=6391246.5

END


The key change here being the addition of +x_0 and +y_0.  I am not familiar
with the

+south parameter for LAEA though it might be appropriate.

By the way, you can use the new gdalsrsinfo utility to translate coordinate
systems with GDAL.  eg.

warmerdam@gdal:~$ gdalsrsinfo
ESRI::'PROJCS[lambert,GEOGCS[GCS_WGS_1984,DATUM[D_WGS_1984,SPHEROID[WGS_1984,6378137.0,298.257223563]],PRIMEM[Greenwich,0.0],UNIT[Degree,0.0174532925199433]],PROJECTION[Lambert_Azimuthal_Equal_Area],PARAMETER[False_Easting,1000.0],PARAMETER[False_Northing,6391246.5],PARAMETER[Central_Meridian,-60.0],PARAMETER[Latitude_Of_Origin,-40.0],UNIT[Meter,1.0]]'

PROJ.4 : '+proj=laea +lat_0=-40 +lon_0=-60 +x_0=1000 +y_0=6391246.5
+datum=WGS84 +units=m +no_defs '

OGC WKT :
PROJCS[lambert,
GEOGCS[GCS_WGS_1984,
DATUM[WGS_1984,
SPHEROID[WGS_84,6378137.0,298.257223563]],
PRIMEM[Greenwich,0.0],
UNIT[Degree,0.0174532925199433]],
PROJECTION[Lambert_Azimuthal_Equal_Area],
PARAMETER[False_Easting,1000.0],
PARAMETER[False_Northing,6391246.5],
PARAMETER[longitude_of_center,-60.0],
PARAMETER[latitude_of_center,-40.0],
UNIT[Meter,1.0]]

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam,
warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mapserver + regex license

2012-01-18 Thread Frank Warmerdam

On 12-01-18 07:54 AM, Lime, Steve D (DNR) wrote:

I'm hoping someone with experience in this area can chime in. It's a convoluted
subject for sure. MapServer doesn't contain code from any regex library, it uses
an API that a few regex libs support so you can actually compile against others.

Steve


Steve / Josef,

First, as Steve suggests the issue only arises if you build with
the GPL'ed regex 0.12.  Second, requirements for redistribution of
source in the GPLv2 only apply if you distribute MapServer binaries
to clients or users (as opposed to putting up a service on your
own servers that outsiders use).  Third, the redistribution of
source requirements is normally considered to only apply to code
linked into the executable.  While this is a bit of a grey area,
it would not normally apply to the PHP/Python/Perl scripts using
the mapscript api.

So you are likely in the clear.

Best regards,



-Original Message-
From: mapserver-users-boun...@lists.osgeo.org 
[mailto:mapserver-users-boun...@lists.osgeo.org] On Behalf Of Josef Bicik
Sent: Monday, January 16, 2012 7:47 AM
To: mapserver-users@lists.osgeo.org
Subject: [mapserver-users] Mapserver + regex license

Hi All,

I have a question about Mapserver licensing. From the documentation
and source code I understand that Mapserver uses the regex 0.12
library, which is released under the GNU GPL v2 license. Can Mapserver
actually be released under an MIT-style license when it contains
portions of code released under GPL? I am not extending mapserver on
its own, however, am considering using mapscript in a commercial
application. I wonder if I would have to release my application using
mapscript under GPL v2 license. Can anybody please explain me this
licensing issue?



--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://home.gdal.org/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Raster rendering performance and zoom levels

2011-12-13 Thread Frank Warmerdam
Ian,

The normal approach to slow rendering at larger scales
is to build pyramids/overviews on large images.  This
can generally be accomplished something like:

  gdaladdo big.tif 2 4 8 16 32 64 128

The gdaladdo command should work on virtually all
GDAL supported raster formats.  There are also things you
could do to produce very specific overviews for the particular
rendering resolutions you want to produce.  But I'd suggest
first trying the above generic solution and see if it is
sufficient for your needs.  Some gdaladdo docs are available
at:

  http://www.gdal.org/gdaladdo.html

Best regards,


On Tue, Dec 13, 2011 at 3:21 PM, Ian Walberg ian.walb...@airborne.aero wrote:


 We have an application which is using php  mapscript to render maps at a
 number of different zoom levels, these zoom levels can be fixed and the maps
 are centered on a specific location.



 So we calculate the extent based on the zoom level and the current required
 center lat/long.



 The raster imagery we are using is approx. the same resolution as the max
 zoom (smallest extent) and in this case the map rendering is the fastest.



 As we zoom out and the extent increases the map rendering is slower, we are
 assuming this is because the imagery is being resized which is
 processor/memory intensive.



 Now the question,  how do we create imagery sets for each zoom level so that
 they are the required resolution and no re-sizing is required?



 We are using mapserver without a client to generate the images on a server.



 I hope this makes sense.



 Thanks



 Ian






 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] gdal bigtiff support

2011-11-17 Thread Frank Warmerdam
On Thu, Nov 17, 2011 at 12:15 PM, Travis Kirstine
traviskirst...@gmail.com wrote:
 I have created some tiled BigTiffs (6 GB) with gdal 1.8 with the
 internal tif lib.  I keep getting a  msDrawRaster(): Image handling
 error. Unrecognized or unsupported image format
 drawEPP(): Image handling error. EPPL7 support is not available when
 attempting render the the image with Mapserver 5.6.7 (w/ gdal 1.8).  I
 have also noticed that some of my non bigtiff tiled geotiffs are
 rendering with missing tiles and or in strange colours.  I can access
 the files with gdal without a issue.  Is there something I'm missing?

Travis,

Are you using full paths to the files in question.  I vaguely suspect
that the fopen()s used in path construction within MapServer do
not work properly with large files (4GB).  If that turns out to be
the issue please file a ticket on it.

The work around would be to use a full path instead of depending
on SHAPEPATH or map relative path construction.

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Raster image performance

2011-11-11 Thread Frank Warmerdam
Ian,

I am guessing you actually have many files, not just one big
one.  Is that right?  As you zoom out opening many files to
accumulate the full image is expensive.   Up to some scale
it is practical to merge things into one big mosaic tiff with overviews.
At some point that can be impractically large.

The usual practice to avoid opening too many files with tileindexed
layers is to have two LAYERs in your map file.  One for the fuller
resolution data, and then another at greatly reduced resolution
and then to generate a reduced resolution mosaic for the reduced
resolution layer.  Use the MIN/MAX SCALE control keyword in the
LAYER to control which is used.

Best regards,

On Fri, Nov 11, 2011 at 11:15 AM, Ian Walberg ian.walb...@airborne.aero wrote:
 Does anyone have any experience of how to get the best performance out
 of raster formats.

 We have an application which needs to be able to display a number of
 zoom levels and once we get out to whole earth or continent level the
 performance is poor. Our assumption is that it is the shrinking of the
 images which where is the time if being used up.

 The raster files are tifs with external world files, adding overviews
 helps a little.

 The zoom levels and output resolution can be fixed so if the overviews
 match exactly the required image size that look like it would work but
 we cannot see how to do this.

 So any advice on what are the most efficient file formats to open and
 the most efficient  output format.

 The application is written in  php mapscript which runs as a service and
 not via a browser.

 Thanks

 Ian
 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users




-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] tileindex shptree

2011-10-28 Thread Frank Warmerdam
Eric,

Do things fail consistently fora  given request?  I would be
willing to do some examination of this problem this evening
(pacific time) if you can provide a canned demonstration of
the issue (mapfile+tileindex+query).  I should be able to fake
the data referred to by the tileindex if necessary.

I don't feel that adding a spatial index (.qix) is the right
solution.   Something is either wrong with your tileindex
or with mapserver (IMHO).

Best regards,

On Fri, Oct 28, 2011 at 2:09 PM, Eric Weisbender weisb...@wapa.gov wrote:
 Hello,

 We are using a tileindex layer to draw multiple county parcel data layers.
 For some reason the query of these layers is either hit or miss.  Sometimes
 it returns a query.  Other times a query returns Invalid field index 0
 from the error file defined in the mapfile.  And the third query result I'm
 getting is Internal Server Error from I assume apache.  These results are
 all on the same data indexed by this one tileindex layer.  Would it help if
 I built a shptree qix file and do I just do that for the tileindex file or
 all file the tileindex file is pointing to.  I have wasted two day's on this
 and am completely open to any and all idea's.  Thanks in advance.

 EW
 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users





-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: New to mapserver. Cannot render TIFF

2011-09-07 Thread Frank Warmerdam

On 11-09-07 08:00 AM, aphunter wrote:

Thanks for the reply Frank. I adjusted the EXTENT, but still no go. The weird
thing though is that when I use a PNG of the same image, things work great.
I can't get any TIF, no matter how large or how small to work.

In fact I tested a 200MB GeoTiff and Mapserver immediately spit out a white
image with almost no disk activity. It's almost ignoring my DATA line when a
TIF is provided

Any other thoughts? This is really frustrating :(.


A.P. Hunter,

If you provide a mapfile + tiff + shp2img commandline you are using to me
I can investigate a bit for you.  Contact me off list. Nothing else
obvious came to mind.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: MapScript WMS request

2011-09-07 Thread Frank Warmerdam

On 11-09-07 08:18 PM, Mr. Puneet Kishor wrote:

I would really appreciate insight from someone well-versed in the ins and outs 
of WMS via MapScript. Looking at the discussion at 
[http://trac.osgeo.org/mapserver/ticket/670], the `img = wms_map.draw()` step 
seems to be a crucial part of drawing the image.

So, I added `my $img = $map-draw();` to my code below, and indeed, the image 
was drawn and sent back to the browser.

Is this something that should be added to the examples in the documentation? Is 
this the right way to do things? In any case, I am not write to STDOUT, and 
sending the buffer directly. Instead, my code is very much like a regular 
request (and it works) --

 my $new_extent = $map-{extent};

 my $req = new mapscript::OWSRequest();
 $req-setParameter( SERVICE, WMS );
 $req-setParameter( VERSION, 1.1.0 );
 $req-setParameter( REQUEST, GetMap );
 $req-setParameter( BBOX, -180,-90,180,90 );
 $req-setParameter( LAYERS, layer_name);
 $req-setParameter( SRS, -1);
 $req-setParameter( WIDTH, 1200);
 $req-setParameter( HEIGHT, 600);

 my $dispatch_out = $map-OWSDispatch( $req );
 my $img = $map-draw();
 my $map_img = 'test_' . sprintf(%0.10d, rand(10)) . '.png';
 $img-save(/path/to/$map_img);
 return send_file(/path/to/$map_img);


Comments? Corrections?


Puneet,

I rarely use PHP and it is possible something is broken now with PHP
OWS dispatching.  But it should work like:

  http://mapserver.org/ogc/mapscript.html#php-example

Alternatively if you don't install the stdout redirection the OWSDispatch
call should produce the image to stdout.

Note that if you want things handled properly as a WMS request you should
not be calling draw().  The ticket you reference long predates the WxS
MapScript services effort.

I suspect you are not really setting all the environment variables needed
to make the WMS handler kick in during OWSDispatch though I'd have to
play around with it to be sure.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] New to mapserver. Cannot render TIFF

2011-09-06 Thread Frank Warmerdam

On 11-09-06 10:14 AM, aphunter wrote:

Hello. I am new to MapServer and I am having some trouble. I've got a sample
MAP file that I created from some examples (and modified based on this
thread:
http://osgeo-org.1803224.n2.nabble.com/Cannot-display-raster-MS4W-shows-white-rectangle-instead-td4996020.html)
however, I am still getting blank images when using shp2img.

In my mapfile, if I change overview3.tif to overview3.png (which I manually
converted to a PNG), the images show up just fine. I made sure my extent was
setup properly as well based on the gdalinfo (below). Can anybody please
help me figure out why I get a blank image when using a TIF file, but not a
PNG as the input? MapServer was compiled using GDAL as opposed to the native
TIFF support as the readme said it was more efficient.

...

Upper Left  (  222400.000, 4210380.000) (120d 9'40.96W, 37d59'55.05N)
Lower Left  (  222400.000, 3595630.000) (119d57'12.04W, 32d27'47.78N)
Upper Right (  777900.000, 4210380.000) (113d50'6.76W, 37d59'54.72N)
Lower Right (  777900.000, 3595630.000) (114d 2'36.48W, 32d27'47.51N)
Center  (  500150.000, 3903005.000) (116d59'54.06W, 35d16'12.63N)


...


   EXTENT  222400 222400 421000 421000


A.P. Hunter,

The Y coordinate range in your EXTENT line does not intersect
the Y range of the image.  Try adjusting your EXTENT line
accordingly.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Raster parameter PROCESSING BANDS=... and ECW files

2011-09-04 Thread Frank Warmerdam

On 11-09-04 09:33 AM, Armin Burger wrote:

Hi all

I noticed a strange behaviour of MapServer (5.6.7 and 6.0.1) when defining for
a raster layer based on an ECW file a processing parameter for the bands order
like

PROCESSING BANDS=3,2,1

The order of the bands does not have any effect. The image is always displayed
in the original band order 1,2,3, whatever I define for the BANDS value. If I
just define a single band, like
BANDS=3 or BANDS=1
then it's displaying it correctly using the right band.

This problem seems just to appear for ECW files, not e.g. for Tiff files. If I
wrap a VRT image around the ECW and use this VRT in the DATA tag of the map
file then the BANDS order is taken into account, just not when defining the
DATA using the pure ECW file.

Any ideas what's going wrong?


Armin,

I suspect that the special interleaved read method in the GDAL ECW driver
is not properly honouring the list of bands passed in to it.  If this is
the problem then it might not have come up with earlier mapserver versions
that didn't do such reads in one interleaved request.

If this is the issue then please test with GDAL trunk and if the problem
persists file a ticket against GDAL.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/warmerda
and watch the world go round - Rush| Geospatial Software Developer

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Extra ? in WCS query

2011-08-22 Thread Frank Warmerdam

On 11-08-22 10:17 PM, teri wrote:

Hi,

I try to get data from mapserv WCS to Esri Arcmap. Esri only gives error
message.

I opened apache log and Esri makes query :
/cgi-bin/mapserv.exe?map=c:\blaah\testi.map?SERVICE=WCS 

In browser Esri query above gives error as well Service parameter missing.
By removing ? from above ... testi.map?SERVICE ... query seems to work
in browser.

Question. Is this ? problem of mapserv or Esri?


Tapio,

I presume you are specifying .../cgi-bin/mapserv.exe?map=c:\blaah\testi.map
as the service URL when setting things up with ArcMap?  I believe ArcMap
uses GDAL's WCS driver underneath for WCS server access and the GDAL WCS
driver service definition file should include the ? in the service
url.  However, it is possible that ArcMap is adding an extra question mark
to whatever you specify when it is defining the GDAL WCS ServiceURL.

If so, the problem is with ArcMap, and you should file a ticket with them.

In the meantime, you can wrap the WCS service so that the map does not
need to be defined in the URL.  On Linux I would normally accomplish
this by putting a shell script in the cgi-bin directory that defines the
MS_MAPFILE environment variable.  I'm not so sure how to accomplish this
on Windows, though you could likely add MS_MAPFILE's definition in your
Apache configuration if it is unlikely to cause conflicts on any other
service run from the same apache.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] building FastCGI on MapServer 6.0

2011-08-01 Thread Frank Warmerdam
Mukesh,

Reviewing maperror.c, it should issue SUPPORTS=FASTCGI if
-DUSE_FASTCGI was defined at compile time.  So I suppose you
either didn't do a clean build (and some stuff didn't get recompiled) or
you aren't running the executable you built.

Best regards,

On Mon, Aug 1, 2011 at 12:11 PM, Mukesh Subedee msube...@yahoo.com wrote:
 Hi all,
 I am again posting my problem as I am still stuck in the same place.
 I am trying to install/configure FastCGI on MapServer 6.0 in Ubuntu 10.04
 machines. I installed both fcgi-2.4.0 and mod_fastcgi-2.4.6 as mentioned in
 http://mapserver.org/optimization/fastcgi.html#obtaining-the-necessary-software.
 I configured MapServer --with-fastcgi=/usr option and could see FastCGI
 support: -DUSE_FASTCGI in Support Libraries. I did make and check ./mapserv
 -v but could not find SUPPORTS=FASTCGI there. I am wondering if I did
 anything wrong as I just followed the link and I did not get any errors
 while compiling any of those softwares/packages.

 Thanks!
 Mukesh
 ___
 mapserver-users mailing list
 mapserver-users@lists.osgeo.org
 http://lists.osgeo.org/mailman/listinfo/mapserver-users





-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Software Developer
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: EPSG:42304 - EPSG:3978? or 3979?

2011-06-29 Thread Frank Warmerdam

On 11-06-29 05:54 PM, myOpenLayersUName wrote:

Oh Jeff,

It seems I'm always saying no to that question from you and then finding
out later that I should have said yes but didn't realize it. So, first of
all, thank you for continuing to respond to my questions even when I'm
repeatedly too slow to follow something that's readily apparent to others.

Unfortunately, in answer to your question this time, I'm going to go with
sort of.  You have confirmed my understanding of what happened, but I'm
still not sure which of these two new EPSG codes I should be picking to
update my own application and get away from using 42304.

Can I just change the EPSG code to one or the other of the new ones (or
either, since they seem to be the same as far as I can tell)? Or, do I have
to reproject the data from the old 42304 to one of them before I can do
this? When I compare the PROJ4 definitions of the new and old, they aren't
the same and that suggests I need to reproject but someone told me that I
should not have to do that... that I should be able to just change the code
in my Mapfiles and OpenLayers WMS definitions.


Joanne,

The difference between 3978 and 3979 is that 3978 is NAD83 while
3979 is NAD83 (Canadian Spatial Reference System).  I don't know much
about CSRS but I assume it is a refined NAD83 - roughly similar to
HPGN in the USA.  Most software in the free software world won't do
anything special with NAD83 (CSRS) and will not likely even know enough
to treat it as NAD83.  So my suggestion is to stick with 3978 unless
you really really know you want to label the data as NAD83 (CSRS) and
are willing to suffer incompatibilities due to it.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] NITF and World Files

2011-06-27 Thread Frank Warmerdam

On 11-06-27 01:14 PM, SixDegrees wrote:

We have a collection of NITF files that are missing coordinate system
information; they are essentially pixel-based. Elsewhere we have information
on the projections used. We are reluctant to modify the original NITF files,
but would like to display them through MapServer with the correct projection
information. If we provide a world file containing this information for each
NITF file, can we associate the two in the mapfile and have MapServer use
the world file information instead of fruitlessly pawing through the NITF
for it?


Six Degrees,

Yes, you should be able to drop a .wld or .nfw file next to the nitf file
to provide georeferencing.  If that doesn't work for some reason you
could provide a similar effect with a VRT file (email me directly for details
if needed).

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Rasters

2011-06-16 Thread Frank Warmerdam

On 11-06-16 06:37 AM, afarrell wrote:

Hi,

I've converted some 8 bit rasters to GeoTIFF format and spherical mercator
projection using FME.
I'm getting large blue edges where the tiles meet:

http://dl.dropbox.com/u/23077047/Misc1use/rasters.jpg
http://dl.dropbox.com/u/23077047/Misc1use/rasters.jpg

In ArcGIS the tiles appear seamless.

Is this because MapServer do not support the nodata tiff tag, as it is not
officially part of the geotiff standard
(http://www.awaresystems.be/imaging/tiff/tifftags/gdal_nodata.html). I
do not believe there is a problem with the files we are writing, as other
applications (e.g. ArcCatalog) pick up on the nodata value just fine.


Annette,

I would be interested in seeing a gdalinfo report on one of the
GeoTIFF files produced with FME.  The problem isn't that the
tag is non-standard (after all it is a GDAL produced tag and
MapServer uses GDAL as does FME and ArcGIS).  The problem is
just in the MapServer raster layer implementation and whether it
honours the metadata.

An immediate work around is to figure out what that blue pixel
value is and set the OFFSITE keyword in your raster layer to
match it.

For instance if the blue were red=0, green=149, blue=189 you
would add the following in the LAYER:

  OFFSITE 0 149 189

Ideally though, MapServer would pick it up automatically.


Another potential solution is to add an alpha band to the raster instead of
a nodata value. Do you think MapServer will support this?


yes


Would using ecw images resolve the issue?


no, and it is often very difficult to keep track of nodata
areas in lossily compressed formats like ecw, mrsid, jpeg2000
and jpeg.



--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Rasters

2011-06-16 Thread Frank Warmerdam

On 11-06-16 10:27 AM, Brent Fraser wrote:

Frank,

Does MapServer now use GDAL by default to read tiffs (instead of its own tiff
handling), or do you need to specify a CONNECTIONTYPE? Or perhaps create a VRT
file referencing the tiff to force the use of GDAL to read the tiff?


Brent,

MapServer now reads all raster layer input using GDAL.  All the legacy
mechanisms were removed in the last few years.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Unable to render a raster with 4 bands

2011-06-15 Thread Frank Warmerdam

On 11-06-10 09:24 PM, jt2000 wrote:

I have a GRD raster that I'm trying to show on the map using mapserver.
Currently I'm getting all transparent output.

I've converted it to TIF using gdal_translate and it converted fine.  I also
used shp2img to convert to png without any issues.



Band 1 Block=1293x1 Type=Byte, ColorInterp=Red
   NoData Value=0



What do I need to change in the map file to make this work?
I have tried PROCESSING SCALE=0,0.00305185094759972 to see if that would
help.


jt2000,

You don't provide your LAYER definition so there isn't much to go on.
What I can say is that based on the debug output the layer is being
rendered and it would seem there was at least some overlap of the data
file with your map area.

I do not know why you are using a SCALE processing option.  The imagery
is already 8bit, not floating point, so there should be no need to
dramatically rescale.

Don't worry too much about the debug output about NODATA value 0 being
ignored.  At worst this should mean that nodata areas will actually
be drawn.  It should not mean that things show up transparent when they
are not.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Rendering artefacts when serving raster via WMS

2011-06-15 Thread Frank Warmerdam

On 11-06-10 12:25 PM, John Westwood wrote:

Does anybody have any ideas what the problem could be? I know it is something
to do with the fact that I boosted the images and MapServer doesn't like them,
but I would like to fix it. Suggestions greatly appreciated.


John,

I'm afraid I don't have much to offer.  I just wanted you to know that
someone had looked at your post and had no bright ideas about why it is
happening.  If this is quite important to you, you could file a ticket
on the issue, reducing it to a simple map file with one input GeoTIFF
and a request (ideally with shp2img) that produces the artifacted output.
Then I could dig into this from my end.

If you do that, you can directly assign the MapServer ticket to warmerdam.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Problem using mapserver with WCS

2011-06-10 Thread Frank Warmerdam

On 11-06-09 11:58 PM, Virginia Maffei wrote:

Thanks Frank, i dropped the map= from the url but now it throws an error that i
dont understand:
msWCSGetCoverageMetadata(): WCS server error. Unable to determine the SRS for
this layer, no projection defined and no metadata available.

Do you have any idea whats the problem i'm having? the mapfile is the same one.


Virginia,

I notice you do not have any PROJECTION blocks or SRS service metadata at
the layer or map level.  I would suggest you re-review the WCS documentation.

You might want to use the following as an example of a fairly
minimalist WCS service mapfile (ignore all the request comments at
the start - these are part of the autotest).

  http://svn.osgeo.org/mapserver/trunk/msautotest/wxs/wcs_simple.map

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapServer Fails

2011-06-10 Thread Frank Warmerdam

On 11-06-10 04:26 AM, SixDegrees wrote:

We have several NITF images that can be successfully translated to, say, PNG
or GTiff format using a gdal_translate command similar to the following:

gdal_translate -ot Byte -of GTiff -scale -b 3 -b 2 -b 1myNitf.ntf
~/myGTif.tif

However, we are having trouble getting MapServer to serve these images. We
get what looks like a single pixel, greatly enlarged to fill the entire
returned image file, showing one or two colors from the input image. We have
adjusted the BBox to encompass larger areas with no success. MapServer is
configured at DEBUG level 5, both CPL_DEBUG and PROJ_DEBUG are enabled, but
no error messages occur during processing; the same is true when running
mapserv on the command line, feeding it the query string from the browser
request - no errors, and an image consisting of a block of one or two solid
colors is returned.

Any thoughts on A) how to configure the mapfile, B) how to further
investigate what is going on? It might be useful to be able to see the
underlying GDAL calls being made, for instance, or the various parameters -
in particular, the bounding box being passed - or C) any other guidance on
how to proceed in debugging this problem?


Paul,

If you capture all the MapServer debug output you should be alle to see
the window accessed and the scaling used.

eg.

[Fri Jun 10 09:14:27 2011].271521 msDrawRasterLayerLow(grid1): entering.
GDAL: GDALOpen(/home/warmerda/mapserver/msautotest/gdal/./data/float.tif, 
this=0x1146570) succeeds as GTiff.

[Fri Jun 10 09:14:27 2011].287958 msDrawRasterLayerGDAL(): Entering transform.
[Fri Jun 10 09:14:27 2011].288045 msDrawRasterLayerGDAL(): src=0,0,40,30, 
dst=0,0,400,300
[Fri Jun 10 09:14:27 2011].288071 msDrawRasterLayerGDAL(): source raster PL 
(0.000,-0.000) for dst PL (0,0).
[Fri Jun 10 09:14:27 2011].288114 msDrawRasterLayerGDAL(): red,green,blue,alpha 
bands = 1,0,0,0

[Fri Jun 10 09:14:27 2011].309383 msDrawRasterGDAL_16BitClassification(grid1):
  scaling to 4 buckets from range=-10.5,10.5.

You didn't provide any information on how you configured the layer in
mapserver.  I am wondering if you used PROCESSING SCALE=AUTO or not?  That
would be the rough analog of the -scale option used for gdal_translate.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: MapServer Fails

2011-06-10 Thread Frank Warmerdam

On 11-06-10 01:00 PM, SixDegrees wrote:

I'm using PROCESSING SCALE=AUTO. I don't have my mapfile available at this
location, but I can access it on Monday.

I'm not seeing as much output as you've indicated. Where is this being
output? On the command line when mapserv is called with a query string? Or
in the log file?


Paul,

I generated that adding the -all_debug 5 commandline switch to shp2img.
But with mapserver it would be accomplished by setting the DEBUG level
(on at least the LAYER) to 5.  The debug output can go several places.

You can set the the following in your MAP object to ensure that debug
output goes to stderr.

CONFIG  MS_ERRORFILE stderr

More details on debug output at:

  http://mapserver.org/development/rfc/ms-rfc-28.html

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Problem using mapserver with WCS

2011-06-08 Thread Frank Warmerdam

On 11-06-08 07:54 PM, Virginia Maffei wrote:

  Hi, I installed ms4w and i'm trying to configure wcs in my mapfile, but it's
not working. The url that i'm using is:
http://localhost/cgi-bin/mapserv.exe?map=/ms4w/apps/tutorial/htdocs/example1-1.maplayer=localidadesmode=mapSERVICE=WCSVERSION=1.0.0REQUEST=GetCapabilities
http://localhost/cgi-bin/mapserv.exe?map=/ms4w/apps/tutorial/htdocs/example1-1.maplayer=localidadesmode=mapSERVICE=WCSVERSION=1.0.0REQUEST=GetCapabilities

but i cant see the xml it just stil shows the tiff image.

I attached the mapfile so it can help to check which is the problem.



Virginia,

I suspect the mode=map is interfering - try dropping it out of the
request.  It is not a proper WCS keyword.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapServer 5.2.1 - Trying to show a band as transparent

2011-05-31 Thread Frank Warmerdam

On 11-05-31 03:31 PM, Eduardo Kanegae wrote:

Hi,

I have a Windows 2008 R2 Server running MapServer 5.2.1 from MS4W pack.

My trouble: I´m trying to display a gdaltindex file ( set of rasters ) but the
image border is not being displayed as expected.

The raster files are all 4-band based, with 3 bands for RGB and the 4th band
for ALPHA channel.
The band 4 has only two possible values: 0 ( for transparent desired area) and
255 for area where RGB bands has content

...

...
OPACITY ALPHA


Eduardo,

I am not clear on what OPACITY ALPHA is supposed to do.  I don't think
you need it.


...
PROCESSING BANDS=1,2,3,4
PROCESSING SCALE_1=AUTO
PROCESSING SCALE_2=AUTO
PROCESSING SCALE_3=AUTO
PROCESSING SCALE_4=1,2
PROCESSING RESAMPLE=BILINEAR


SCALE_4=1,2 will transform 1 to 0, and 2 to 255 but the input values are
apparently 0 and 255 already (as I deduce from the qgis snapshot) so I think
you should just omit the SCALE_4 processing option.

There may be bad interactions between RESAMPLE=BILINEAR and the alpha
support.  You might want to try with and without this option.   If this is
an issue try upgrading to MapServer 6 and see if the problem persists.  I
have made significant improvement in raster alpha handling in recent years.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Controling the amount of concurrent GetMap requests

2011-05-26 Thread Frank Warmerdam

On 11-05-26 05:01 PM, Mark Korver wrote:

I would think that the thinking here is that a server only scales well
to some number of concurrent requests.  That beyond that number, all
requests suffer.  In this case it's better to queue the requests
rather than try to process them, meaning queuing improves performance
overall.


Folks,

I will just note that Apache + FastCGI makes it pretty easy to
limit the number of concurrent requests being processed and when
saturated the new requests are queued.  I presume they would timeout
after a while if there is just too much traffic.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] populating EPSG file

2011-05-24 Thread Frank Warmerdam

On 11-05-24 5:35 AM, mpapec wrote:

I would like to add values for EPSG:3765 projection. Is there some tutorial
or web calculator to do this?

ps. I've only found this entry with comments regarding 3765
--
# Unknown
# Unable to translate coordinate system EPSG:3765 into PROJ.4 format.



Hi,

This is the current entry for EPSG:3765 in the proj epsg init file.

# HTRS96 / Croatia TM
3765 +proj=tmerc +lat_0=0 +lon_0=16.5 +k=0. +x_0=50 +y_0=0 
+ellps=GRS80 +towgs84=0,0,0,0,0,0,0 +units=m +no_defs  



Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Issues with Bilinear Rendering of Raster Images in MapServer 6.0.0-2

2011-05-22 Thread Frank Warmerdam

On 11-05-19 12:42 PM, vanwars wrote:

Hello,

I just upgraded MapServer today on (Ubuntu Lucid Lynx) to 6.0.0-2 from
MapServer 5.6.6, and am experiencing a weird error with the bilinear
rendering from GeoTiff (the underlying data store) to PNG (the display
format).  Whereas before there were nice tapered edges and smoothing, there
is now a strange black / blue /green border around all of our pngs.  I read
through the upgrade documentation, and it seems like there have been a
number of changes to the way in which rasters are rendered, but I can't
figure out the element(s) that I might be able to adjust to get the rasters
to look fabulous again.  Has anyone run into this particular issue?  I've
attached before / after pngs.

Thank you!

Sarah

Relevant parts of my map config file
http://osgeo-org.1803224.n2.nabble.com/file/n6382806/MapServer5.6BilinearInterpolation.png
MapServer5.6BilinearInterpolation.png
http://osgeo-org.1803224.n2.nabble.com/file/n6382806/MapServer6.0BilinearInterpolation.png
MapServer6.0BilinearInterpolation.png :


Sarah,

My take would be that previously the nodata value of the raster was
being recognised, and was not getting blended with real values but now
that is not the case.  There have been some advances in this area though
now it is looking like a regression in your case.  I would appreciate it
if you could prepare a ticket with sufficient detail for me to reproduce
the problem.  Ideally a pointer to the dataset, your mapfile and a
shp2img command demonstrating the problem.

Make sure to have it assigned to warmerdam or to email me after the ticket
is created.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Rasters and WFS

2011-05-19 Thread Frank Warmerdam

On 11-05-19 03:36 PM, SixDegrees wrote:

Will WFS allow raster images to be embedded? Documentation seems to indicate
not, but isn't quite clear.


Paul,

MapServer WFS does not serve raster data.


We can insist that the user open both a WMS and WFS layer, but this gets
messy; we would really prefer a single data stream solution.


I think you will need to insist though there may be ways of simplifying
things with a qgis plugin or something.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] 3d WFS Service

2011-04-26 Thread Frank Warmerdam

On 11-04-26 05:39 AM, Smith, Michael ERDC-CRREL-NH wrote:

All,

Is there a way to get a 3d (from 3d source data) return from a mapserver wfs
service?



Mike,

I notice that the mapgml.c code is 2D output only.  Also, the new
mapogroutput.c that can be used for WFS is 2D only as it stands.  It seems
both sets of code *could* be improved to produce 2.5D output if
USE_POINT_Z_M is defined in the mapserver build though it is a bit late
for 6.0 now.  If you would like me to do so for the OGR based output
let me know.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mapserver6 calls exit() in FastCGI-mode

2011-04-20 Thread Frank Warmerdam

On 11-04-20 03:59 AM, Erik Gustafson wrote:

The problem is that the error from Mapserver 6, apart from its user
unfriendlyness for ows-requests, is reported by writeError() in
mapserv.c which calls exit() even if we are running under FastCGI. As
this error is non fatal I consider this a bug.


Erik,

For reference, I do *not* consider this a bug.  In my opinion it is
perfectly acceptable for MapServer processes to terminated sometimes on
an error even when running in FastCGI mode.  Reasonable FastCGI
implementations will just start a new process for the next request so
the only harm is a slight delay as libraries are reinitialized and
DB connections are re-established.

The error you are encountering is not something that will happen often
in practice.

In fact, I believe it is a good practice to have MapServer FastCGI
instances recycled occasionally as it is hard to ensure there are
no memory leaks in the more esoteric parts of the code.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] box substitution for ogr layers

2011-04-11 Thread Frank Warmerdam

On 11-04-11 06:01 AM, Frederic Junod wrote:

Hello,

Is it possible to have a !BOX! substitution for an OGR layer
(CONNECTION value) ? The box substitution seems only available to
postgis layers.

What I'm trying to have is something like:

MAP
   ...
   LAYER
 NAME world_borders
 TYPE POLYGON
 CONNECTIONTYPE OGR
 CONNECTION http://www.example.com/world_borders.json?bbox=!BOX!;
 ...
   END
END


fredj,

This seems like a plausible thing to add but I'm hesitant to do it at
this late point in the release cycle.  Could you file an enhancement
ticket with the request?

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] error in raster layer

2011-04-08 Thread Frank Warmerdam

On 11-04-08 12:16 AM, morteza shabihkhani wrote:

Hello all,

I want to create a very simple raster layer, but I faced to this error:

msDrawMap(): Image handling error. Failed to draw layer named 'elevation'.
msDrawRaster(): Unable to access file. stcon using full path stcon

this is my layer:

LAYER
   NAME elevation
   TYPE raster
   STATUS on
   DATA stcon


Morteza,

I don't think you mentioned what binaries you are using.  Could you confirm
that the mapserv -v output includes INPUT=GDAL?  The error - particularly
the EPPL one, could mean you don't even have GDAL raster support built in.

In the above case, are you really really really sure the path is right?
You haven't provided any path so it ought to be evaluated relative to the
mapfile but to be very sure I'd suggest supplying a full path.  Also, does
your file really have no extension?  MapServer isn't going to guess an
extension!

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] 16 Bit PNG Output

2011-04-08 Thread Frank Warmerdam

On 11-04-07 08:19 AM, kaipi wrote:

I am not able to output elevation data as 16 Bit PNGs. Is Mapserver not able
to to this ?
I tried with a current version of Mapserver on Windows and on Linux. I tried
WMS and WCS requests - but I always get 8 Bit PNGs back although I have
configured 16INT. Other formats like GTiff or Esri Bil work fine with 16Int.

Any ideas ?

Thanks,

kaipi

Here is my mapfile:

   [...]

   OUTPUTFORMAT
NAME 'tif'
DRIVER GDAL/GTIFF
IMAGEMODE INT16
MIMETYPE image/tif
   END

   OUTPUTFORMAT
NAME 'pngint16'
DRIVER GDAL/PNG
IMAGEMODE INT16
MIMETYPE image/pngint16
   END


Harry,

I suspect the problem is that the PNG driver supposed unsigned 16bit
integer while IMAGEMODE INT16 is signed 16bit integers.  We really need
a FORMATOPTION that will let us force the pixel data type of the generated
file even if it is somewhat different from the IMAGEMODE type.  Perhaps you
could create an enhancement ticket for this and ensure it is assigned to me
(userid: warmerdam)?

It should be a pretty easy change.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] error in raster layer

2011-04-08 Thread Frank Warmerdam

On 11-04-08 01:41 PM, morteza shabihkhani wrote:

Frank

Thank you for your response. In fact, I'm not very familiar with binaries, but
as I remember, I had installed GDAL/OGR before I installed Mapserv. How can I
check that my installation process was correct?


Morteza,

I suggested using the command mapserv -v to get the version information
which includes things like INPUT=GDAL if GDAL input support for rasters
is supported.   I don't think GDAL is picked up automatically when building
from source though I'm not sure.


about the path, I have provided the path in my mapfile and the mapfile call
this layer (in separate file). To make sure I replaced another shapefile
(polygon layer) in the same path into this layer, and it worked.


Shapefiles and raster files use subtly different rules, and the shapefile
layer type is distinct in that an extension is not required.


Also, I'm
using linux, which I think doesn't need extension for files, but anyway my
layer file has the extension of .lay. In addition, for the polygon layer with
the same situation every thing is working very well. Thanks a lot.


GDAL does not support ArcGIS layer files (I'm guessing this is what
your .lay file is).  And if the file has an extension then you must
specify it (on linux or Windows).  And vectors aren't the same as
rasters.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapServer download (at download.osgeo.org) failure

2011-04-01 Thread Frank Warmerdam

On 11-04-01 10:23 AM, Lmhelp wrote:

Hi,

Thank you for reading my post.

When I try to download MapServer by clicking the following link:
http://download.osgeo.org/mapserver/mapserver-5.6.6.tar.gz
in the download page : http://mapserver.org/download.html
it says:
The connection has timed out.
The server at download.osgeo.org is taking to long to respond.

How/where can I download MapServer?

Thank you for your help and best regards.


Lmhelp,

We have observed routing problems from some European ISPs to
download.osgeo.org.  There is a mirror available at:

  http://download2.osgeo.org/

that should work for you.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] two mapserver speed-optimization questions

2011-03-16 Thread Frank Warmerdam
On Tue, Mar 15, 2011 at 5:03 PM, Vince Miller vincentpmil...@yahoo.com wrote:
 1. The following two lines of PHP from my application transform an php image 
 object into a raster map layer:

 imagepng($rmap, __MAPS_PATH__ . resource.png);
 $map-getLayerByName(resource)-set(data, __MAPS_PATH__ . resource.png);

 The imagepng call is a major bottleneck when the extent of the layer is large.
 Can the data in image $rmap be accessed for layer resource directly, 
 without the file write/read? If so, how? FYI, the following lines appear in 
 my mapfile:


Vince,

There are no mechanisms to utilize a PHP image object as the
data in a mapserver raster layer without first writing to disk.  I
gather PHP image resources are actually a handle to a gdImage
object, so if you needed it badly enough it should be possible to
write a PHP function that turn that gdImage into something that
was accessable to GDAL as a raster but that would be quite
involved and not something likely to go back into the core
distribution.

Best regards,



--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Programmer for Rent
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Nodata in raster queries

2011-03-16 Thread Frank Warmerdam

On 11-03-14 03:23 PM, Boss, Ken (DNR) wrote:

I have a DEM that I am using with mapserver 5.6 to service queries for an 
elevation value at a given point.  The DEM contains significant offsite/nodata 
areas.  From gdalinfo:

Band 1 Block=19063x1 Type=Int16, ColorInterp=Gray
NoData Value=-32768

If I open the image in QGIS and use the identify tool over a nodata area, it 
says:

   Band 1  null (no data)

But when I run a mapserver point query at the same point, the value returned is 
-32768.  Is there a way to configure mapserver to return something more like 
null for raster nodata areas?


Ken,

Mapserver has a few mechanisms for specifying nodata.  I skimmed the
raster query code and it does not seem to honour these.  If you file
a ticket on this issue, I can try and implement nodata support in the
raster query code this week at the code sprint.

In MapServer 6.0 (trunk) there are some improvements to detecting nodata
values, even for non-8bit data, in the raster drawing case.  This just
hasn't all made it into the raster query logic.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] ogr connection trouble

2011-02-23 Thread Frank Warmerdam

On 11-02-23 09:08 AM, Josh Jordan wrote:

I am trying to get mapserver to draw an OGR layer, was wondering what this
means in the OGRINFO readout, I get a series of fields with String (0.0), was
wondering what (0.0) means or if its the problem?

POPULATION: String (0.0)
MALE: String (0.0)
FEMALE: String (0.0)


Josh,

It indicates that the field width is variable.  If it used (8.0) that would
indicate a field width of at most 8 characters.  For floating point fields
the part following the decimal will be the number of decimal places in the
value.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: Projection library error - EPSG Issue

2011-02-17 Thread Frank Warmerdam

On 11-02-17 05:11 AM, phil7g wrote:


Hi there!

Everything I get back when adding debugging is this
http://gis-test.geomatik.rub.de/cgi-bin/mapserv?map=/srv/www/htdocs/GIS2/Studieren_in_Bochum.mapmode=map
, which isn't very helpful... Does the error-logfile contain more
information? Unfortunately, I'm not the admin of the server and I had some
problems with using the mode that produces an error-logfile. I've just addes
these lines:

   CONFIG MS_ERRORFILE stdout
   DEBUG 5
   CONFIG PROJ_DEBUG ON
   CONFIG CPL_DEBUG ON

best regards!

Phil


Phil,

I suspect the problem is not finding the epsg init file.  CPL_DEBUG output
will go to stderr which would go into the Apache error logfile.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Projection library error - EPSG Issue

2011-02-09 Thread Frank Warmerdam

On 11-02-09 08:56 AM, phil7g wrote:


Hi!

Im experiencing a problem when trying to set up a GIS with mapserver and
mepbender. First of all, this link leads to a working version of my data in
the map-mode of mapserver
http://gis-test.geomatik.rub.de/cgi-bin/mapserv?map=/srv/www/htdocs/GIS2/Studieren_in_Bochum.mapmode=map
. As soon as I want to move the data to mapbender by using a wms/wfs in
order to add a gui etc., I'm getting an error message
(msProcessProjection(): Projection library error. no system list, errno: 2).
I've no idea what's wrong here and would be very thankful for any
suggestion. Could it be a problem with the EPSG-file or the EPSG-path in the
mapfile? In mapbender, the only given choice when trying to change the
EPSG-Code for my WMS is 4326... but it should be 31466 (as you can see in
the mapfile below)... If you need more data to analyse the problem, just
tell me and I'll provide it.

Eagerly awaiting your answers,

best regards,

Phil

So long!

Here is the mapfile (as you can see, I've already tried to fix the problem.
init=epsg:31466 produced the error - msProcessProjection(): Projection
library error. no system list, errno: 2, as well):


Phil,

First, could you confirm that /usr/share/proj/epsg (or possibly
/usr/local/share/proj/epsg) has a definition for 31466?

Second, if you enable PROJ.4 level debugging you can get output on
where the epsg init file is being searched for.  I would normally try
this by setting the PROJ_DEBUG environment variable to any value (ie. on)
and then running the request at the commandline.  PROJ.4 will write some
debug output to stderr.  If you can't easily do things at the commandline
set the environment variable in your mapserv wrapper script or in the
apache config file, and then inspect the apache error log.

eg.

warmerda@gdal65[214]% setenv PROJ_DEBUG ON
warmerda@gdal65[215]% proj +init=epsg:31466
pj_open_lib(epsg): call fopen(/home/warmerda/bld/share/proj/epsg) - succeeded


If the epsg init file is not properly being found, consider setting
the global PROJ_LIB environment variable to point to the directory
where it is, or move it to the directory PROJ.4 is looking in.

If you lack the definition add this to your epsg init file:

# DHDN / 3-degree Gauss-Kruger zone 2
31466 +proj=tmerc +lat_0=0 +lon_0=6 +k=1 +x_0=250 +y_0=0 +ellps=bessel 
+towgs84=582,105,414,1.04,0.35,-3.08,8.3 +units=m +no_defs  


(note from 31466 to  is all one line)

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] capability to reproject to 2 different projections within the map object of the map file

2011-01-23 Thread Frank Warmerdam

On 11-01-21 04:13 PM, John Mitchell wrote:

If I want all the layers within a map file no matter the layers own projection
to have the capability to reproject to 2 different projections would I within
the map object of the map file replace:
  PROJECTION
init=epsg:4326
  END

With:
  PROJECTION
init=epsg:4326
init=epsg:102113
   END


John,

No, this will not have any useful effect.

For WMS service you can list all the coordinate systems you want to be
declared as supported in the metadata at the map level.  I believe the
WMS server howto addresses this.  For MapScript you can change the map
level projection object at request time to the desired projection.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Raster input file delete access prohibited by MapScript

2011-01-21 Thread Frank Warmerdam

On 11-01-20 10:13 AM, Anzel, Phil - Fort Collins, CO wrote:

All,

I have an application that uses the MapScript API under C# to create map
images. Without exiting the application, I need to delete the input raster
(JPEG) files that have been used in the image creation. Deletion of the
input files is not possible until the application terminates.

...

Can you help? I'm guessing that the input JPG file is opened for reading by
MapServer and is never explicitly closed, even when the layer is closed. Is
there a method defined in the API that will force the closure, if that is
even the situation?


Phil,

In recent versions MapServer aggressively keeps single raster files used for
raster layers open even after the map is destroyed in order accelerate the
next access to it.  This can be controlled/disabled by adding the following
line in your raster layer:

  PROCESSING CLOSE_CONNECTION=NORMAL

The default setting is DEFER for raster files.

Best regards,
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Projection problems

2011-01-07 Thread Frank Warmerdam

On 11-01-07 02:40 PM, Jeff McKenna wrote:

On 11-01-07 10:49 AM, Jan Hartmann wrote:


Yes, the transformation to WGS84 for the Dutch coordinate system
(Amersfoort, Rijksdriehoeksnet) is still *not* part of the latest
PROJ4 release (4.7.0, downloaded yesterday).


I have requested many changes to the EPSG 'geodetic dataset' throughout the
years, so maybe I can give you some advice:

- enter your change request through a form on the EPSG site:
http://www.epsg.org/Comms/Comment.asp
- it may take upto one year for the change to be accepted by the EPSG group and
included in the next EPSG geodetic dataset
- you will get an email from the EPSG group once that happens
- however it will take much longer for software that uses EPSG codes to update
their own releases with those new EPSG codes (this includes PROJ, QGIS, MS4W,
etc.)

Hope that sheds some light on the issue for you.


Jeff,

I think Jan's concern is that the transformation does exist in EPSG but
is not reflected in the last PROJ.4 release.  I believe this is fixed
in CVS and I really just need to push out a new PROJ.4 release reasonably
soon.

Jan - I'd appreciate it if you could confirm that:

  http://svn.osgeo.org/metacrs/proj/trunk/proj/nad/epsg

has the right value.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] GDAL input formats

2011-01-04 Thread Frank Warmerdam

On 11-01-04 03:14 PM, David Hildebrand wrote:

I'm wondering how to specify a particular GDAL format.  I have some
3-band floating point images in ENVI format and I would like to retain
that format because I have GDAL support.  Secondly, would it be better
to convert them to GeoTiff files?  Would it also be better to scale them
to, say 16-bit signed integer files?


David,

I searched back a bit in the archive, but I couldn't find any leadup
discussion to the above.  It seems to lack context.

So, you have 3band floating point images in ENVI format and you would
like to retain that format.  Is there something holding you back?

You said you don't know hjow to specify a particular GDAL format.  Do
you mean when you are generating output via GDAL such as with WCS?  Or
do you mean how you tell MapServer what format an input file is in?
You don't have to tell MapServer (or GDAL) what format a file is in.
It figures it out - assuming it is a supported format.

Does that help?

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Using OGR with a TILEINDEX layer

2010-12-03 Thread Frank Warmerdam

Brent Fraser wrote:
I used ogrtindex to create a tileindex shapefile with absolute paths but 
get an error in mapserver v5.6.1 when attempting to use it:


msDrawMap(): Image handling error. Failed to draw layer named 
#39;LINE#39;.
msOGRFileOpen(): OGR error. Open failed for OGR connection in layer 
`LINE#39;.  File not found or unsupported format


  LAYER
NAME index_west
TYPE TILEINDEX
DATA G:\GeoData\1_250k\Alberta\AltaLIS\250k_west.shp
  END


  LAYER # LINE
NAME 'LINE'
STATUS on
TYPE LINE
TILEINDEX index_west
CONNECTIONTYPE OGR
#CONNECTION 'G:\GeoData\1_250k\Alberta\AltaLIS\82opos.dgn' # entities'

INCLUDE AltaLIS_250k_render_inc.map
  END

Does OGR work when referencing a TILEINDEX?


Brent,

I don't have an authoritative answer, but a brief skim of mapogr.cpp seems
to suggest that it only supports tileindexes in OGR supported formats and
not in a separate layer.  So, the answer seems to be no, though you should
be able to just specify the 250k_west.shp file directly as your tileindex
in the main OGR layer.

It would be desirable to rework mapogr.cpp to support the current more
general concept of tileindexes but it might be a non-trivial amount of work
and significant care would be required to avoid backward compatibility
problems.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] configuring WCS

2010-11-24 Thread Frank Warmerdam

David Hildebrand wrote:

I am trying to configure a WCS service but when I do a GetCapabilities I
get the following error.

msOWSGetLayerExtent(): WMS server error. Wrong number of arguments for
EXTENT metadata.

I have wcs_extent defined for all the layers but nowhere in the
MapServer documentation can I find that the WEBMETADATA tag requires
extent to be defined.  I have WMS and WFS services running and there
seems to be no problem with the configuration.


David,

The *_extent metadata item needs four space separated values in the
value string - minx miny maxx maxy.  I presume you don't have it setup
properly.

It may well be that the WMS and WFS services don't actually use the extent
so the WCS service is the first thing to error out.  It is unfortunate about
it being reported as a WMS error, but at that level of the code it is hard
to know the context of the request.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] WFS element datatypes are all strings - how to set as integer?

2010-11-23 Thread Frank Warmerdam

pcr...@pcreso.com wrote:

Hi,

I'm looking to use mapserver to provide WFS data layers to QGIS clients. 
I need to display the layer using a data field to control symbology 
(symbol size), but QGIS can only use an integer field for this.


As below, mapserver identifies all the elements as strings, which is a 
problem. The data source is a Postgis table, the data statement 
generates an integer field to use to scale the layer, but mapserver 
seems to cast it as a string.


Is there any way to have mapserver specify a WFS integer element from a 
Postgis layer?


Brent,

I think you want to se the gml_fieldname_type metadata item in the layer
to integer.  You can read more detail on this in the WFS server document.
This should work in 5.6.

In MapServer trunk, as part of the OGR output overhaul, the ability was added
to put gml_types auto in the metadata in order to have the types derived
from the data source (for OGR, PostGIS, Oracle and shapefile input sources
for now).  The RFC on OGR output touches on this as well as the docs in
trunk.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] gdaltindex: It appears no georeferencing is available for

2010-11-19 Thread Frank Warmerdam

Sebastian E. Ovide wrote:

Hi All,

se...@seanspc:~/data/other$ gdaltindex  sean.shp 
/media/Data/sean/GIS/OSUK/licensed/colour_raster_25k/cd9/data/ny/ny25.tif

It appears no georeferencing is available for
`/media/Data/sean/GIS/OSUK/licensed/colour_raster_25k/cd9/data/ny/ny25.tif', 
skipping.



se...@seanspc:~/data/other$ gdalinfo 
/media/Data/sean/GIS/OSUK/licensed/colour_raster_25k/cd9/data/ny/ny25.tif

Driver: GTiff/GeoTIFF
Files: 
/media/Data/sean/GIS/OSUK/licensed/colour_raster_25k/cd9/data/ny/ny25.tif

Size is 4000, 4000
Coordinate System is `'
Metadata:
  TIFFTAG_IMAGEDESCRIPTION=1:25000 TILE NY25
  TIFFTAG_DATETIME=2010:11:05 03:15:25
  TIFFTAG_COPYRIGHT=ORDNANCE SURVEY CROWN COPYRIGHT 2010



any ideas?


Sebastian,

I have the idea that the image may be somewhere in the United Kingdom.

Seriously, it seems like there is no georeferencing associated with this
file in any form that gdal recognises.  You are going to need to figure out
where it is and attach a world file, or assign the bounds using the
-a_ullr switch of gdal_translate.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapServer output

2010-11-19 Thread Frank Warmerdam

P Kishor wrote:

I have been using MapServer for sometime now, but doing really simple
things with it... read in mostly Pg, Shapefile and raster data, and
output mostly images via regular CGI or WMS.

One thing that GeoServer seems to do very well is provide easy output
to a variety of formats -- GeoJSON, images, features, KML, a whole lot
more.

What are MapServer's capabilities in this regard? Ideally, my
application would return the requested format based on the URI. So,
given http://server/mapserv/wms/ would return WMS. If I replace wms
with kml I would get back KML, or replace it with geojson and get
back GeoJSON, etc.

Is there a tutorial or documentation on this that someone can point me to?


Puneet,

This fall, in trunk, I have extended MapServer's WFS GetFeature request
to support returning formats supported by OGR.  It requires some setup
in the mapfile to enable it.  To the extent that helps you might want
to review:

  http://mapserver.org/trunk/output/ogr_output.html

Note that this is only in trunk.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapServer output

2010-11-19 Thread Frank Warmerdam

P Kishor wrote:

 http://mapserver.org/trunk/output/ogr_output.html


Thanks! I didn't even think OGR. This is great news. Now, OGR is
mostly for reading data, and not usually, as I understand, for writing
data. I am assuming that when the above is implemented, MS will
support writing out to all the formats that OGR support writing out
to, no?


Puneet,

Well, there are likely some exceptions that aren't useful for this
purpose.  For instance, OGR can write to PostGIS but it is hard to
stream the resulting dataset back over http.


Is there a list of formats that OGR can write out to? The formats I
see at http://www.gdal.org/ogr/ogr_formats.html seem to be for reading
only, no?


If that list says Creation - Yes then you have a good chance of being
able to use it with WFS - GetFeature.


Note that this is only in trunk.



Is this scheduled for version 6 of MS?


Yes, it will be in MapServer 6.

Is is already completely implemented and available for use from trunk
nightly snapshots or svn.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapServer output

2010-11-19 Thread Frank Warmerdam

Lime, Steve D (DNR) wrote:

I believe Frank's work extends beyond WFS as well to standard MapServer
queries, or if that's not possible yet it can be.


Steve,

Yes, I an confirm that it is tied into the standard query mechansism.
It also can work for WMS GetFeatureInfo requests.  I have actually
tested WMS GetFeatureInfo and WFS GetFeature, but I have not tested it
in the context of other sorts of queries.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Server Downtime?

2010-11-04 Thread Frank Warmerdam
On Fri, Nov 5, 2010 at 12:00 AM, Tim Rood tro...@comcast.net wrote:
 Hello,

 I get the message below when I attempt to run this tutorial that hits the
 mapserver.org server.  It can’t be Temporarily Unavailable all the time.
 Does anyone see a problem here?

Tim,

I have restarted fgs apache on that server and now it
is ok.


-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mapserver and projcs in geotiff header

2010-10-28 Thread Frank Warmerdam

Jørn Vegard Røsnes wrote:

Hi all,

just a feature check of Mapserver.

Should Mapserver read the projection information in the geotiff header, if 
PROJECTION is not set in the LAYER def. of the map file?


I'm testing with Mapserv 5.1-dev, and it's not working without PROJECTION, 
only when PROJECTION is set. 
I will soon try with a recent version of Mapserver (compiling).


Jørn,

MapServer does not ask the underlying data source for coordinate system
information by default.  However, you can setup a projection block like:

  PROJECTION
auto
  END

to automatically read the projection through GDAL.  This is a little
used feature, so it is possible it is broken now.  The normal projection
block for your coordinate system would look something like:

  PROJECTION
+proj=merc +lon_0=0 +k=1 +x_0=0 +y_0=0 +datum=WGS84 +units=m +no_defs
  END

If it is intended to be google mercator then you should use:

  PROJECTION
+proj=merc +a=6378137 +b=6378137 +lat_ts=0.0 +lon_0=0.0 +x_0=0.0 +y_0=0 
+k=1.0 +units=m +nadgri...@null +no_defs

  END

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] ESRI binary grids RRD files ?

2010-10-19 Thread Frank Warmerdam

Sebastian E. Ovide wrote:

Hi Guys,

ESRI Binary grids contains a bunch of adf files and rrd files that I 
believe contains pyramids. 

Does MapServer needs those rrd files ? the question is because they are 
very big !


Sebastian,

Yes, MapServer will take advantage of .rrd overviews for ESRI binary grids.
You can delete them but in some cases performance will suffer.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] OFFSITE more values

2010-09-24 Thread Frank Warmerdam

Sven Schroeter wrote:

Hi,

I have a rasterlayer with more than 1000 .ecw airial photos and want to 
set more than one RGB-value transparent with OFFSITE.

This works fine:
OFFSITE 0 0 0

but I need something like this:
OFFSITE [0 0 0,1 1 1,1 2 1]

Is there a possibility to solve my problem?


Sven,

There is no support for multiple offsite values in MapServer.

If you have ecw file with lossy nodata areas the usual approach is to
convert the files to uncompressed format (ie. GeoTIFF), and then use the
GDAL nearblack utility to convert pixels that are nearly black to black
so there is a single nodata/offset value.

Some folks have also had success deriving a nodata/data mask from this,
and using it to develop an alpha (transparency) band which can then be used
with the original ecw file via use of a GDAL VRT file grouping the extra
band with the original data.  This technique is fairly complicated and can
have some performance impact on MapServer but it does allow using the
original ECW files with exactly masked areas.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] MapScript WMS Server - Custom exceptions

2010-09-17 Thread Frank Warmerdam

Frost89 wrote:

Hi all

I have created a C# MapScript wrapper for a WMS server. Now, I want to add
some vendor-specific parameters to the request (e.g.:
http://server/wms?request=getmap...login=usrpassword=pwd;)

This I have also made work, to a point. When the user enters invalid
information, I just return a 403 errorpage (Access denied). I was thinking
about throwing a WMS exception (XML/InImage/Blank) and wondering if
MapServer/MapScript is able to throw custom exceptions? Or do I have to
handle it myself?

/Kristian Frost


Kristian,

Skimming maperror.h it appears that msSetError() is not exposed via SWIG.
I think you would pretty much need access to this to push an error message
through the conventional error handling channels from C#.

One approach would be to try and expose msSetError() though I'm not sure
if that would be enough.

Alternatively you could fake your way around it just creating the error
image or xml yourself.  But this might be fragile in various ways.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mapserver serving up DEM

2010-09-16 Thread Frank Warmerdam

Matt Fair wrote:

  OUTPUTFORMAT
NAME GEOTIFFINT16
DRIVER GDAL/GTiff
MIMETYPE image/tiff
IMAGEMODE INT16
EXTENSION tif
  END

...
This produces a white image, meaning it is probably only reading 8 
bits.  If I add  PROCESSING SCALE=AUTO, then the values are not maxed 
out at 255, but vary based on the size of data I am requesting.  So this 
won't work either because in my mapping software, as I request smaller 
and smaller patches, the elevation data is scaled really weird and is 
not consistent.


Is there anything I am missing to get 16 bit USGS DEM data to be 
distributed via Mapserver?


Matt,

Your setup seems reasonable.  Can you provide me an example of an output
file produced by MapServer?  I'd like to examine it to ensure it is being
produced matching the output format declaration.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mapserver serving up DEM

2010-09-16 Thread Frank Warmerdam

Matt Fair wrote:
Here are two files it generated, one with auto scale and one without 
auto scale.

...


 OUTPUTFORMAT
   NAME GEOTIFFINT16
   DRIVER GDAL/GTiff
   MIMETYPE image/tiff
   IMAGEMODE INT16
   EXTENSION tif
 END


Matt,

They are in jpeg format, not GeoTIFF.  They are clearly not being
produced through the above OUTPUTFORMAT declaration.  How are you
requesting them?

Note that declaring an output format does not mean it will be used.  It
just makes it available as a format option.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: VRT memory usage (from C# Mapscript)

2010-09-03 Thread Frank Warmerdam

Lisa Gaudette wrote:


Frank Warmerdam wrote:

Lisa,

In recent versions of MapServer an effort is made to keep GDAL files open
between render requests for raster layers with a single file as opposed
to a tile index.  I wonder if you might be running into a problem with
this behavior in a long running mapscript script.  I don't understand
the whole context in which you are operating so I could be off base.  But
you might consider adding:

   PROCESSING CLOSE_CONNECTION=NORMAL

to your raster layer to force the files to be closed at the end of a
render.



That seems to fix it. Is there any way to set that option globally when
compiling?


You could change this code in mapraster.c:

if( close_connection == NULL  layer-tileindex == NULL )
close_connection = DEFER;

To assign a default of NORMAL instead.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] thread safety and php and fastcgi

2010-09-02 Thread Frank Warmerdam

William Kyngesburye wrote:

Bringing back this question from a different angle...

So, we know that PHP MapScript has some thread safety issues when used with
PHP as a DSO module.  In my limited understanding of how it works, a DSO
module is loaded into memory when Apache starts, ready to accept multiple
different requests, and this permanent state is where the thread safety
issues come from.

So, what about mapserv fastcgi?  Isn't this also loaded once, and processes
multiple requests?

What about PHP as a fastcgi?  If it's the mapserver-PHP code that has the
thread safety problem, would PHP as a fastcgi have similar problems as
PHP-DSO?


William,

In the case of FastCGI the fastcgi mapserver process is only given one
cgi request at a time to handle.  It won't be given another until the
previous one is complete.  Apache can start multiple separate FastCGI
MapServer instances in order to handle multiple requests at once but
they each have their own process.  So, FastCGI does not have
multi-threading issues.  It does occationally run into issues with
memory leaks or left over state from a previous cgi request.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] VRT memory usage (from C# Mapscript)

2010-09-02 Thread Frank Warmerdam

Lisa Gaudette wrote:

I have an application using C# Mapscript where I've got a large number of
.png tiles that wind up representing the same area but under different
conditions. In order to avoid having huge numbers of duplicate .wld files,
I'm using .vrt files to index the tiles.

However, I've realized that each time a request is made for a different map,
my memory usage increases. I can duplicate that with the following code,
where the mapfiles contain .vrt layers but it's fine with a .shp tileindex.
This happens even when the 2nd map represents a much smaller area with many
fewer tiles than the first.


Lisa,

In recent versions of MapServer an effort is made to keep GDAL files open
between render requests for raster layers with a single file as opposed
to a tile index.  I wonder if you might be running into a problem with
this behavior in a long running mapscript script.  I don't understand
the whole context in which you are operating so I could be off base.  But
you might consider adding:

  PROCESSING CLOSE_CONNECTION=NORMAL

to your raster layer to force the files to be closed at the end of a render.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] WCS 1.1 multipart mime (correct usage)

2010-08-30 Thread Frank Warmerdam

turtlewax wrote:

I'm looking at the WCS 1.1.x specification for implementing an asynchronous
WCS service.

My assumption is that the WCS 1.1 XML manifest can be used to return a URI
to the asynchronous result. Is this correct?


Frank,

I don't know if this is permitted by the specification, but it is not
supported by the MapServer WCS Server implementation, or the GDAL WCS
driver client implementation.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: Raster Strategies Examples

2010-08-19 Thread Frank Warmerdam

Edi.Karadumi wrote:

Sorry to bother again, when i use gdal_merge.py the part -ps 160 160, thats
the pixel dimension and i get an image 1kb. The pixel size of the original
file is 0.08 meters. So i think i should use 0.08x32 in the gdal_merge.py
command? 


Edi,

If the original resolution is 8cm then the 1/32nd overview should indeed
have a pixel size of 0.08x32 or 2.56m.

 And how many tiles should i merge together? Now i have 2T images
 and 2000Gb/32 = 62Gb the rezult image. Should i merge them all together and
 than recreate tiles? Even if i had 1200gb, 1200/32=37.5gb for an image not
 1gb. That is still an image size that cant be handled

Note that the 1/32nd overview is reduced by a factor of 32 in x and y
so overall it will be original_size/(32*32).  So 2TB would reduce to
about 1.95GB.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: Raster Strategies Examples

2010-08-19 Thread Frank Warmerdam

Edi.Karadumi wrote:
Thanx to you my questions are comming to an end  


Three more last things

Should i retile the new mosaiced overview? Meaning should i create smaller
size tiles of the new mosaic? or 2Gb is not a problem


Edi,

Generally speaking, as long as you enable internal tiling when building
the mosaic there is no need to break it down into separate files.
Add '-co TILED=YES' to the gdal_merge.py command to produce an output
GeoTIFF file that is internally tiled.


And how can i find in which scale should i switch layers? So what will be
the maxscale of the original layer?


That remains a complicated question.  I believe I suggested 1/32 as a
good overview level since beyond that point a normal map view will tend
to involve a significant number of files.


if ill still have performance problems, or ill get 1-2 terabytes of data
more should i make another mosaic with 0.08*16 or 0.08*8, or is there
another strategy?


I presume as you add data, your area is growing.  If that is so, the 1/32nd
overview level is still appropriate, and you just need to regenerate the
overview for the larger area.

If you are using MapServer and GDAL then there is no real problem with using
one large geotiff file for the overview as long as it has internal tiling,
even if it grows to many GB in size.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] raster query strategy

2010-08-17 Thread Frank Warmerdam

Jan Hartmann wrote:
 Is this a bug? Shouldn't MapServer use the gdaladdo overviews at the 
appropriate scales?



Rich / Jan,

No, generally I treat raster query as an exact operation done
against the full resolution data.  The overviews are only used
to satisfy downsampled RasterIO requests such as drawing a reduced
resolution map.

Best regards,


On 08/17/10 16:09, Richard Greenwood wrote:

I am working with a single band raster of 10mX10m cells. I have added
overlays with gdaladdo and it displays nicely.

When I query the layer I am using MODE=nquery, not MODE=query. The
reason that I am using nquery is unrelated to the raster layer, but
I'm pretty much restricted to using that mode. At large scales this
returns at least 2 cells, which I can average easily with JavaScript
in the browser. However at small scales I'm getting 10s of 1000s of
cells which are really slowing things down. It does not appear that
query or nquery mode is using the overlays. Anyone disagree with that
assumption?

So the only solution that I've come up with thus far is to resample
the raster to larger cell sizes and use the min/max scale denominator
to select a layer with cell size appropriate to the scale. Anybody
have other ideas?

Thanks,
Rich


___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users




--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Raster Strategies Examples

2010-08-03 Thread Frank Warmerdam


Folks,

I'm sorry for speaking up on this without having read the other replies.
Forgive me for repeating information.

Edi.Karadumi wrote:

as you may know, i have very slow performance when i zoom out and im stucked
here. As i have read i should make a copy of the tiles with reduced
resolution. Merge the tiles together and use min/max scale to show different
layers in different scales. the min/max scales i zoom in/out are
100/120. Now my questions are

- How can i calculate the scale where i should create another layer of the
tiles, or i shoud see it with some tests?


I find the MapServer scale values very confusing myself.  If I want
to compute the scale for particular request (for instance to establish
breakpoints for MINSCALE/MAXSCALE), I do a request at the target resolution
with shp2img and debug output on and examine the debug output for the scale
reported.

- how much should be the resolution of the new layer? 


You basically want to move to a new mosaiced overview layer at the point
where a map request is likely to request several tiles at once.  If
we, roughly, assume a map request is on the order of 500x500 then at
32 times reduction in resolution would give a request over an area of
16000 x 16000 which is certain to touch several of your 6000 x 6000
base files.  So, I'd aim to have this merged mosaic at approximately
1/32nd of the resolution of the original imagery.

1200GB of full res imagery reduced to 1/32nd resolution is only about 1GB
so it is a very managable size for an overview layer.


- is there any tools or program to merge the tiles? merging 6000 tiles with
the gdalwarp by writing the command by myself is frustrating


gdalwarp can take multiple input files in one run, but there are
some issues with how gdalwarp is implemented that make it not scale
well to many input files without great care.  Since the input files
are quite a modest size I would suggest using gdal_merge.py to
mosaic them at a reduced resolution.  If your original imagery were
5m pixels something like:

gdal_merge.py -o overview_mosaic.tif -ps 160 160 */*.tif

might do the trick.


- how many tiles should i merge together to create the new layer? (how many
tiles should have the new layer) i know that in each zoomscale its better to
appear only one tile but i dont know how to calculate it

- the tiles that i should merge are the originals or those with internal
tiling and overviews?


If you use gdal_merge.py, it is best to use input files that have overviews
already built.  This will ensure that the mosaic built uses the same
downsampling technique (ie. averaging) that you used to build the overviews.
It will also make the mosaicing much faster.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] shapefile error only when zoomed out

2010-07-26 Thread Frank Warmerdam

Wendell Turner wrote:

Why would a shapefile only display when the map display is
zoomed in?

When zoomed in, the image displays correctly.  When zoomed
out, it gets this:
  msDrawMap(): Image handling error. Failed to draw
  layer named 'tfr'.; msDrawShape() General error
  message.  Only polygon shapes can be drawn using
  a POLYGON layer definition.

shpdump shows this:
  Shapefile Type: Polygon   # of Shapes: 2
  ...
  Shape:1 (Polygon)  nVertices=0, nParts=0
Bounds:( nan, nan, 0, 0)
to ( nan, nan, 0, 0)
Is that a problem?  If so, is there a way of removing that
shape (possibly using gdal)?



Wendell,

Something like the following might discard a particular shape:

  ogr2ogr out.shp in.shp -where OGR_FID != 1

The OGR_FID should be the same as the shape id reported by shpdump.

The shape in question is likely getting translated as something
not polygon-like whenever the view includes 0,0.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] tiff image drawing error

2010-07-15 Thread Frank Warmerdam
YAMADA,Yasuharu wrote:
 When I display a tiff image on the MapServer, the following message appears 
 on the
 screen,
 'msDrawRaster(): Image handling error.
 Unrecognized or Unsupported image format:
 drawEPP(): Image handling error.
 /opt/geoweb/maps/snapout2.tif is not an EPP file.'
 
 The server environment is CentOS5, MapServer 5.6.1,
 OpenLayers 2.8.
 
 What's wrong? Does anyone advise me?

Yusuhara,

Two possibilities come to mind:

1) The file is corrupt.   Does it work outside MapServer?

2) MapServer was built without internal-tiff or GDAL support.
Does mapserv -v report INPUT=GDAL?

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] mapserver + grib files + explanation and questions

2010-07-01 Thread Frank Warmerdam
On Thu, Jul 1, 2010 at 3:50 PM, Muro muraro_dav...@hotmail.com wrote:

 I mean, when I click on a point I need to get all values associated to that
 point.
 There are 6136 bands in my grib file.
 I removed PROCESSING BANDS=6136, but mapserver crashes (500 internal
 error...mm no good)
 I added PROCESSING BANDS=10,20,30,40,50, but mapserver crashes (500
 internal error)

 Ideas? Is it possible?

Muro,

In theory you should be able to do a BANDS= directive listing all the
bands though that would be quite tedious with so many.   But I don't
know why things are crashing.  Please file a ticket including points
to the grib file to reproduce the crash and I'll try to look into it within
a few days.

Best regards,
-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] wcs_size for indexed layers

2010-07-01 Thread Frank Warmerdam
On Thu, Jul 1, 2010 at 10:33 PM, turtlewax frankhev...@yahoo.com wrote:

 I have a WCS raster layer,

 QUESTION: What does the wcs_size attribute refer to? Is it the size of the
 raster in pixels? If so, how would I define wcs_size for an indexed layer
 made of multiple rasters?  Thanks in advance.

Frank,

It is indeed the size of the raster in pixels and lines.  For
a layer based on a tileindex you would indicate the virtual
size of the composite raster.  This could be derived from the
extents of the files in data in question and the desired
resolution.

Best regards,

-- 
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent
___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] rasterquery

2010-06-09 Thread Frank Warmerdam

Sven Schroeter wrote:

Hi,
I try to make a raster query using phpmapscript
My layer in the mapfile:

...
this works fine with mapserver 5.02 but there is no result  with 
mapserver 5.6.1


Sven,

Looking at one of my raster query tests, the one noteworthy difference I
see is that I have DUMP TRUE in the layer.  If you you still get no
results with that in place, file a ticket and assign it to me warmerdam
with full details to reproduce and I'll take a look.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] HDF Data projection in MapServer

2010-05-18 Thread Frank Warmerdam

Reddem wrote:

Hi Everybody,

I am trying to display HDF files using MapServer, and upto some extent
i have done it. Still i am facing problem with the projection of map.

...

   Mapped - Composited mapped:Limit=4 62 27 95
   Mapped - Composited mapped:Projection ID=8
   Mapped - Composited mapped:Latitude Center=0
   Mapped - Composited mapped:Longitude Center=78.5



I am facing problem with projection of HDF data set which is 1 KM
gridded dataset. and as without defining Projection Derivative it is
showing somewhere else in the map.  can anyone help me in this regard
to define Projection section of HDF data layer.


Venkat,

Projection ID = 8 in the USGS GCTP system means equidistant conic, which
we can express in PROJ.4 terms as +proj=eqdc +lon_0=78.5 +datum=WGS84.

Hmm, on further review, equidistant conic needs two standard parallels
and there do not seem to be meaningful values expressed in the file.  Perhaps
we could use the latitude extents of the image, though that is guesswork.
That would be:

  +proj=eqdc +lat_1=4 +lat_2=27 +lon_0=78.5 +datum=WGS84

If we were to reproject the image center it would be:

proj +proj=eqdc +lon_0=78.5 +lat_1=4 +lat_2=27 +datum=WGS84
78.5 15.5
0.001714315.16

We know the pixel size is 1K and the image is 3630 x 2530 so this gives
us extents of:

 upper left x = 0 - (1000 * (3630*0.5))  = -1815000.0
 upper left y = 1714315.16 + (1000 * (2530*0.5)) = 2979315.16
 lower left x = 0 + (1000 * (3630*0.5))  =  1815000.0
 lower left y = 1714315.16 - (1000 * (2530*0.5)) =  449315.16

So you could use the gdal_translate arguments:

 -a_ullr -1815000.0 2979315.16  1815000.0 449315.16
 -a_srs '+proj=eqdc +lon_0=78.5 +lat_1=4 +lat_2=27 +datum=WGS84'

In the mapfile your layer would have this projection block:

 PROJECTION
   +proj=eqdc +lon_0=78.5 +lat_1=4 +lat_2=27 +datum=WGS84
 END

Hopefully this will give respectable results, but we are still guessing
with regard to the standard parallels.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Colorrange in map file

2010-05-14 Thread Frank Warmerdam

Jeff McKenna wrote:
  I have done some testing with MapServer 5.6.3, and indeed you are
correct: multiple color ranges for a single data file are not currently 
supported.  If I were you I would enter a comment with your findings 
into the existing ticket for this 
(http://trac.osgeo.org/mapserver/ticket/1305) and poke the developers 
that way.


I'll make sure the new doc contains this limitation.


Folks,

I'd note that the mentioned RFC was never finalized and adopted. In general
the COLORRANGE stuff is still in limbo and I don't even think we should
necessarily be documenting until some final conclusion is reached.

I'd like to see robust colorrange support but there hasn't really been
enough interest in the topic to carry things through RFC preparation,
implementation and documentation.   I don't want it enough to do the
heavy lifting.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mathematical Scaling of Floating Point Data in Mapserver Map File

2010-05-12 Thread Frank Warmerdam

Peter Willis wrote:


Hello,

Is it possible to apply nonlinear scaling to classify
floating point tiff rasters.

All examples that I have seen appear to assume a linear
dataset.

If I wish to scale the data by the base 10 log
of the data and then scale the Red, Green and Blue values
of the classification, can I do it in the map file?

What are the available functions that may be used
in the mapfile 'PROCESSING' and 'EXPRESSION' items?


Peter,

The short answer is that you cannot, in general, do non-linear
scaling.  Depending on the dynamic range of your data, you could
use classes to do something approximating non-linear scaling but you
need to be aware that in the background there is still a linear scaling
being done before the classification is applied to the scaled buckets.
But you can request as many as 64K buckets which would still give you
pretty good control over something like four orders of magnitude.

You might use something like:

  PROCESSING SCALE=0,10
  PROCESSING SCALE_BUCKETS=64000

  CLASS
EXPRESSION ([pixel]  2.5)
COLOR 255 0 0
  END
  CLASS
EXPRESSION ([pixel]  10)
COLOR 235 20 20
  END
  CLASS
EXPRESSION ([pixel]  25)
COLOR 215 40 40
  END
  CLASS
EXPRESSION ([pixel]  100)
COLOR 195 60 60
  END
  CLASS
EXPRESSION ([pixel]  250)
COLOR 175 80 80
  END
  CLASS
EXPRESSION ([pixel]  1000)
COLOR 165 100 100
  END
  CLASS
EXPRESSION ([pixel]  2500)
COLOR 145 120 120
  END
  CLASS
EXPRESSION ([pixel]  1)
COLOR 125 140 140
  END
  CLASS
EXPRESSION ([pixel]  25000)
COLOR 105 160 160
  END
  CLASS
EXPRESSION ([pixel] = 10)
COLOR 85 180 180
  END

Note that because the values between 0 and 10 are classified
into only 64000 buckets you don't really have very good precision
at the bottom end of the range.  So even though we specify
[pixel]  2.5, each bucket is about 1.5625 wide so the first two
buckets will get put into the first class, including values
between 2.5 and 3.125.  This imprecision will become insignificant
to a log scale as you move up to larger values.

Good luck,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Mathematical Scaling of Floating Point Data in Mapserver Map File

2010-05-12 Thread Frank Warmerdam

Peter Willis wrote:

Frank Warmerdam wrote:

There isn't anything magical about 256.



256 or better raster scales sure are pretty though :)

Seriously though, the raster data is floating point log data
with relatively random spatial distribution. Short of making
two images, one log float and one anti-log float, it would be
nice to be able to scale on the fly without duplicating the
original data.

Duplication of rasters is O.K. if you have one or two, but
once you near the 30k-40k files mark the disk space becomes
a tad expensive.

Would it be out of line to suggest some scaling functions
like the generic math functions:

log
log10
sin


...

Peter,

I understand your point, but I remain somewhat hesitant to build it
a lot more complexity into the floating point handling for display.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Disregard ECW header for TFW in TILEINDEX ?

2010-04-28 Thread Frank Warmerdam

Lars I. Nielsen (GisPro) wrote:

Hi Richard,

Ah, Mapserver and/or GDAL doesn't support the TFW extension anymore ? 
Didn't know that. When did this happen ?


Renaming the TFW to WLD did the trick, now the ECW displays nicely.



Lars,

As far as I know the .tfw extension was only ever for tiff files.  The
rule for worldfiles is that you take the first and last letter of the
regular extension and add a w to make the three letter world file
extension for the target file.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Disregard ECW header for TFW in TILEINDEX ?

2010-04-26 Thread Frank Warmerdam

Lars I. Nielsen (GisPro) wrote:

Hi,

I'm trying to set up Mapserver as a WMS server, serving multiple 
seamless coverages consisting of ECW raster tiles.


My problem is, that the ECW files have been delivered with faulty header 
information, and there's too many to fix manually, and the error cannot 
easily be remedied programmatically.


However, I have generated TFW files for each tile that are correct, but 
how do I force Mapserver to use the TFW files and disregard the faulty 
ECW header ?


Lars,

As it happens this is not a unique situation and MapServer itself has some
logic to address it.  If you add:

  PROCESSING EXTENT_PRIORITY=WORLD

to your layer definition, then world files will be searched for in preference
to using the georeferencing returned by GDAL.   I'm not sure exactly when this
was incorporated but I imagine it is in 5.4 and later.  Also the file extension
should likely be either .eww or .wld, not .tfw for ecw files.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] mapserver.org down?

2010-04-26 Thread Frank Warmerdam

Jan Hartmann wrote:

Hi all,

Am I the only one that doesn't get through to mapserver.org? Pages take 
ages to load and then break off with a timeout.


Jan,

Unfortunately mapserver.org (and geoserver.org, gdal.org and a few others) are
currently inaccessable due to a network issue with regard to the telascience
blades on which they are hosted.

We (OSGeo System Administration committee) are working to restore service
but it could be quite a few hours.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] OGR tileindex creates unnecessary lines into error log

2010-04-12 Thread Frank Warmerdam

Rahkonen Jukka wrote:

Hi,
 
I created an OGR tileindex layer as described in document
 
http://mapserver.org/input/vector/ogr.html
 
The document tells  The CONNECTION keyword is not needed (and will be 
ignored) for layers using the OGR connection type and having the 
TILEINDEX keyword.  This seems to be true and my layer works fine.  
However, the MS_ERROR file collects these error messages:
 
msConnPoolRegister(): Missing CONNECTION on layer 

msConnPoolRegister(): General error message. Missing CONNECTION
 
This Mapserver seems to be a bit old, it is of version 5.2.1.  I did not 
find a ticket about this from trac. Has anybody else noticed those 
unnecessary error messages?


Jukka,

I agree this output is not appropriate in this situation. I have applied
a fix in trunk to avoid this:

 http://trac.osgeo.org/mapserver/changeset/10101

If you are able to test this, I would be willing to migrate it back to 5.6
stable (after testing).

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: ODBC OGR MS SQL CONNECTION

2010-03-31 Thread Frank Warmerdam

ibrahimsaricicek wrote:
I've changed like this  


CONNECTION 
  OGRVRTDataSource
OGRVRTLayer name='Araclar'
SrcDataSourceODBC:webuser/webu...@mssql,AracView/SrcDataSource
SrcSQLSELECT * FROM AracView/SrcSQL
GeometryTypewkbPoint/GeometryType
GeometryField encoding='PointFromColumns' x='LONGITUDE'
y='LATITUDE'/GeometryField
/OGRVRTLayer
/OGRVRTDataSource

And result;

msDrawMap(): Image handling error. Failed to draw layer named 'Araclar'.
msOGRFileOpen(): OGR error. Open failed for OGR connection in layer
`Araclar'. Parse error at EOF, not all elements have been closed, starting
with SrcDataSource 


Is there a problem while using comma?


Ibrahim,

I vaguely recall that if you do not include a DATA statement declaring the
layer you want to operate from OGR, then the connection string is parsed
using a comma to identify the layer.  So try your existing connection
string, but add:

DATA Araclar

and see if that helps.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Re: ODBC OGR MS SQL CONNECTION

2010-03-31 Thread Frank Warmerdam

Robert Sanson wrote:

Hi Frank
 
I have an OpenLayers / Mapserver system, where some of the data comes 
from a SQL-Server database via OGR. Trying to understand where a FILTER 
condition is applied. Here is a snippet from my Mapfile:
 
LAYER

  # name of layer
  NAME apiariestm
  TYPE POINT
  UNITS METERS
  # actual data pointer
  CONNECTION ./apiariestm.ovf
  CONNECTIONTYPE OGR
  DATA apiariestm
  FILTER WHERE apiary_id = '%apiaryid%'
  STATUS ON
 
Here is the OGR .ovf file:
 
OGRVRTDataSource

OGRVRTLayer name=apiariestm
SrcDataSourceODBC:user/pas...@apiary/SrcDataSource
SrcLayervw_ogr_apiary_layer/SrcLayer
GeometryTypewkbPoint/GeometryType
LayerSRSEPSG:2193/LayerSRS
GeometryField encoding=PointFromColumns x=x_nztm y=y_nztm/
FIDapiary_id/FID
/OGRVRTLayer
/OGRVRTDataSource
 
The SrcLayer is a view.
 
Does the filter get applied at the Mapserver end, i.e. all the points in 
the map window get retrieved, and then the filter is applied, or does 
Mapserver send the filter through to OGR?


Robert,

A few (1-4) years ago we modified the OGR connection type to push the filter
into OGR if the filter starts with WHERE .  So in your case it should get
pushed all the way through to SQL Server which is where you would want it.

If you can run your map via shp2img you could do the following:

set CPL_DEBUG=ON
shp2img -m yourmap -o out.png

and you should see a bunch GDAL/OGR debug output in the terminal, including
(hopefully) the actual SQL statement issued against SQL Server.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] ODBC OGR MS SQL CONNECTION

2010-03-30 Thread Frank Warmerdam

ibrahimsaricicek wrote:

This doesn't and syas; msDrawMap(): Image handling error. Failed to draw
layer named 'Araclar'. msOGRFileOpen(): OGR error. Open failed for OGR
connection in layer `Araclar'. Parse error at EOF, not all elements have
been closed, starting with SrcSQL 


CONNECTIONTYPE OGR
  CONNECTION 
  OGRVRTDataSource
OGRVRTLayer name='Araclar'
SrcDataSourceODBC:webuser/webu...@mssql/SrcDataSource
SrcSQLSELECT MOBILEUNIT.MUID, MOBILEUNIT.PLATE,
MUGPSDATALOG.LONGITUDE, MUGPSDATALOG.LATITUDE FROM MOBILEUNIT INNER JOIN
MUGPSDATALOG ON MOBILEUNIT.MUID=MUGPSDATALOG.MUID WHERE
MUGPSDATALOG.EVENTLOGID IN(SELECT MAX(EVENTLOGID) FROM MUFLEET INNER JOIN
MUGROUP ON MUFLEET.FLEETID = MUGROUP.FLEETID INNER JOIN MOBILEUNIT ON
MUGROUP.GROUPID = MOBILEUNIT.GROUPID INNER JOIN MUGPSDATALOG ON
MOBILEUNIT.MUID=MUGPSDATALOG.MUID where MUFLEET.FLEETID=37144 group by
MOBILEUNIT.MUID) ORDER BY MOBILEUNIT.PLATE/SrcSQL
GeometryTypewkbPoint/GeometryType
GeometryField encoding='PointFromColumns' x='LONGITUDE'
y='LATITUDE'/GeometryField
/OGRVRTLayer
/OGRVRTDataSource

But why?


Ibrahim,

I was unable to reproduce the problem parsing this XML VRT.  I don't
know what is going wrong.  I had expected to find a  sign in the
sql that was not escaped properly as lt; but I see none.


And why ogr connection is too slow? Is there a way for speeding-up?


You will likely want to list the tables to be scanned on accessing
the database in the connection string or else all are scanned for
the schema - at great expense.  Also, be aware that SrcSQL results
are slow if used in random access mode - such as is done my MapServer's
query mechanisms.  That should not be a problem for simple drawing though.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] Status of ticket 2181 (Fix handling of NODATA values (for DTED files))

2010-03-25 Thread Frank Warmerdam

Jason Beverage wrote:

Hi all,

I was wondering what the status was of ticket 2181
(http://trac.osgeo.org/mapserver/ticket/2181), specifically the patch
that is supposed to fix the handling of NODATA values when using
average or bilinear resampling.  I'm using the mapserver 5.6.1 and am
running into that resampling issue.  Is this something that is planned
to be merged at some point?


Jason,

I have some funded time to work on MapServer raster bugs. I'll try and
take a crack at it in the next day or so.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


Re: [mapserver-users] help with AGG support

2010-03-24 Thread Frank Warmerdam

Julie Knoll wrote:
That worked perfectly and didn't cause the postgis error like in 5.6.1, 
Thank you!!!


On Wed, Mar 24, 2010 at 10:15 AM, Alan Boudreault 
aboudrea...@mapgears.com mailto:aboudrea...@mapgears.com wrote:


With mapserver 5.6.3, could you try to open the mapstring.c file and
add the
following include at the line 40:
#include errno.h

Fixed by FrankW in http://trac.osgeo.org/mapserver/changeset/9998


Folks,

I'll just note that I have filed a ticket on this:

 http://trac.osgeo.org/mapserver/ticket/3401

and fixed it in 5.6 branch as well. The problem seems not to affect
maximal builds which pull in lots of supporting libraries since one of them
is apparently pulling in errno.h for us so I don't think it is a particularly
critical bug in 5.6.3.  I believe it was introduced with 5.6.3 and does not
affect earlier versions.

Best regards,
--
---+--
I set the clouds in motion - turn up   | Frank Warmerdam, warmer...@pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush| Geospatial Programmer for Rent

___
mapserver-users mailing list
mapserver-users@lists.osgeo.org
http://lists.osgeo.org/mailman/listinfo/mapserver-users


  1   2   3   >