[mapserver-users] How to deal with (visible) CONNECTION information in .MAP file for WMS purposes
Hi there, I am wondering how to deal with the CONNECTION information in the .MAP which is used for WMS requests. As the .MAP file must be visible and is readable, the CONNECTION information for my database is readable too. # Layers definition - LAYER NAME wilderness_areas_po METADATA 'wcs_label' 'Wilderness Areas' 'wcs_rangeset_name' 'test' 'wcs_rangeset_label' 'test label' END TYPE RASTER STATUS OFF DATA wilderness_areas_po CONNECTIONTYPE postgis CONNECTION 'user=my_username password=my_password dbname=my_database' PROJECTION 'init=epsg:4326' END END Either I would then need to create a very simple user for that case which really only can read the data, or I should hide the file in a directory which is not readable by a webuser. But I guess that Mapserver wouldn't like that. What are your recommendations? Thanks for any hints. Stefan ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] How to deal with (visible) CONNECTION information in .MAP file for WMS purposes
Hi Stefan, you should hide your map file using a wrapper script on the server side. See http://mapserver.org/cgi/wrapper.html You can find some other methods at http://mapserver.org/ogc/wms_server.html look for Changing the Online Resource URL Regards, Zoltan On Mon, 6 Jan 2014, Stefan Schwarzer wrote: Hi there, I am wondering how to deal with the CONNECTION information in the .MAP which is used for WMS requests. As the .MAP file must be visible and is readable, the CONNECTION information for my database is readable too. # Layers definition - LAYER NAME wilderness_areas_po METADATA 'wcs_label' 'Wilderness Areas' 'wcs_rangeset_name' 'test' 'wcs_rangeset_label' 'test label' END TYPE RASTER STATUS OFF DATA wilderness_areas_po CONNECTIONTYPE postgis CONNECTION 'user=my_username password=my_password dbname=my_database' PROJECTION 'init=epsg:4326' END END Either I would then need to create a very simple user for that case which really only can read the data, or I should hide the file in a directory which is not readable by a webuser. But I guess that Mapserver wouldn't like that. What are your recommendations? Thanks for any hints. Stefan ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] How to deal with (visible) CONNECTION information in .MAP file for WMS purposes
Your MAP file does not have to be visible to / readable by the web server, but it must be visible to Mapserver (mapserv). Håvard On 1/6/2014 10:16 AM, Stefan Schwarzer wrote: Hi there, I am wondering how to deal with the CONNECTION information in the .MAP which is used for WMS requests. As the .MAP file must be visible and is readable, the CONNECTION information for my database is readable too. # Layers definition - LAYER NAME wilderness_areas_po METADATA 'wcs_label' 'Wilderness Areas' 'wcs_rangeset_name' 'test' 'wcs_rangeset_label' 'test label' END TYPE RASTER STATUS OFF DATA wilderness_areas_po CONNECTIONTYPE postgis CONNECTION 'user=my_username password=my_password dbname=my_database' PROJECTION 'init=epsg:4326' END END Either I would then need to create a very simple user for that case which really only can read the data, or I should hide the file in a directory which is not readable by a webuser. But I guess that Mapserver wouldn't like that. What are your recommendations? Thanks for any hints. Stefan -- Håvard Tveite Department of Mathematical Sciences and Technology, NMBU Drøbakveien 31, POBox 5003, N-1432 Ås, NORWAY Phone: +47 64965483 Fax: +47 64965401 http://www.nmbu.no/imt/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
[mapserver-users] custom programming with Mapserver's python or java or C# mapscrip
Hello, I am wondering how to write a program (function) for Map server, which dynamically handle arbitrary shapefile, and will change the style like color etc, on the basis of attribute from shapefile. I want to develop and rendered choropleth map for arbitrary shapefile. I know that we can use MapScript languge like python for custom programming, and I already read some tutorial about python mapscript. I need help/direction about which scripting language is easy to use and more flexible and from where to start ,other link without Map-server website and example. I already use the Map file in cgi mode, but it is static and here we manually change the file(metadata) for each shape file. i am interested in a function /program which can handle styling for arbitrary shapefile. Thanks in advance sajid student ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Displaying a line between objet and label
Dear Steve, Thank you for your answer. I'm just back from a week off, so sorry for late reply... I enclose a screenshot of the mapfile I use to display labels. I have disabled the lines 39 - 40 where I use the LEADERMAXDISTANCE and LEADERGRIDSTEP parameters. The use of these parameters crashes the layer display on my website... I think I'm not using them in the right way. Thanks for additionnal help, if possible ! Thomas http://osgeo-org.1560.x6.nabble.com/file/n5096560/mapfile.png -- View this message in context: http://osgeo-org.1560.x6.nabble.com/Displaying-a-line-between-objet-and-label-tp5095640p5096560.html Sent from the Mapserver - User mailing list archive at Nabble.com. ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] How to deal with (visible) CONNECTION information in .MAP file for WMS purposes
You can also encrypt the database password using MapServer utilities. I do the following: - store the mapfiles outside web htdocs directory - encrypt database passwords (if in a shared hosting environment) - use webserver environment variables to reference mapfiles... this obfuscates your file system setup and makes your setup more portable since you reference the environment variable and not the file directly Steve From: mapserver-users-boun...@lists.osgeo.org [mapserver-users-boun...@lists.osgeo.org] on behalf of Håvard Tveite [havard.tve...@nmbu.no] Sent: Monday, January 06, 2014 4:58 AM To: mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] How to deal with (visible) CONNECTION information in .MAP file for WMS purposes Your MAP file does not have to be visible to / readable by the web server, but it must be visible to Mapserver (mapserv). Håvard On 1/6/2014 10:16 AM, Stefan Schwarzer wrote: Hi there, I am wondering how to deal with the CONNECTION information in the .MAP which is used for WMS requests. As the .MAP file must be visible and is readable, the CONNECTION information for my database is readable too. # Layers definition - LAYER NAME wilderness_areas_po METADATA 'wcs_label' 'Wilderness Areas' 'wcs_rangeset_name' 'test' 'wcs_rangeset_label' 'test label' END TYPE RASTER STATUS OFF DATA wilderness_areas_po CONNECTIONTYPE postgis CONNECTION 'user=my_username password=my_password dbname=my_database' PROJECTION 'init=epsg:4326' END END Either I would then need to create a very simple user for that case which really only can read the data, or I should hide the file in a directory which is not readable by a webuser. But I guess that Mapserver wouldn't like that. What are your recommendations? Thanks for any hints. Stefan -- Håvard Tveite Department of Mathematical Sciences and Technology, NMBU Drøbakveien 31, POBox 5003, N-1432 Ås, NORWAY Phone: +47 64965483 Fax: +47 64965401 http://www.nmbu.no/imt/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] How to deal with (visible) CONNECTION information in .MAP file for WMS purposes
On 2014-01-06 10:39 AM, Lime, Steve D (MNIT) wrote: You can also encrypt the database password using MapServer utilities. I do the following: - store the mapfiles outside web htdocs directory - encrypt database passwords (if in a shared hosting environment) - use webserver environment variables to reference mapfiles... this obfuscates your file system setup and makes your setup more portable since you reference the environment variable and not the file directly Steve Good point Steve. Here are the docs for the msencrypt utility: http://www.mapserver.org/utilities/msencrypt.html -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] custom programming with Mapserver's python or java or C# mapscrip
On 2014-01-06 8:34 AM, Sajid Anwar wrote: Hello, I am wondering how to write a program (function) for Map server, which dynamically handle arbitrary shapefile, and will change the style like color etc, on the basis of attribute from shapefile. I want to develop and rendered choropleth map for arbitrary shapefile. I know that we can use MapScript languge like python for custom programming, and I already read some tutorial about python mapscript. I need help/direction about which scripting language is easy to use and more flexible and from where to start ,other link without Map-server website and example. I already use the Map file in cgi mode, but it is static and here we manually change the file(metadata) for each shape file. i am interested in a function /program which can handle styling for arbitrary shapefile. Sometimes nice examples can be found in the MapServer wiki (https://github.com/mapserver/mapserver/wiki). Maybe also check the old wiki, which is linked from there. And don't be afraid to create a new wiki page, to help others with what you learned. -jeff -- Jeff McKenna MapServer Consulting and Training Services http://www.gatewaygeomatics.com/ ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] Displaying a line between objet and label
What sort of an error message to you receive? --Steve From: mapserver-users-boun...@lists.osgeo.org [mapserver-users-boun...@lists.osgeo.org] on behalf of wiltomap [wilt...@gmail.com] Sent: Monday, January 06, 2014 7:50 AM To: mapserver-users@lists.osgeo.org Subject: Re: [mapserver-users] Displaying a line between objet and label Dear Steve, Thank you for your answer. I'm just back from a week off, so sorry for late reply... I enclose a screenshot of the mapfile I use to display labels. I have disabled the lines 39 - 40 where I use the LEADERMAXDISTANCE and LEADERGRIDSTEP parameters. The use of these parameters crashes the layer display on my website... I think I'm not using them in the right way. Thanks for additionnal help, if possible ! Thomas http://osgeo-org.1560.x6.nabble.com/file/n5096560/mapfile.png -- View this message in context: http://osgeo-org.1560.x6.nabble.com/Displaying-a-line-between-objet-and-label-tp5095640p5096560.html Sent from the Mapserver - User mailing list archive at Nabble.com. ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] custom programming with Mapserver's python or java or C# (OR perl) mapscript
On 1/6/2014 6:34 AM, Sajid Anwar wrote:
Hello,
I am wondering how to write a program (function) for Map server, which
dynamically handle arbitrary shapefile, and will change the style like
color etc, on the basis of attribute from shapefile. I want to develop
and rendered choropleth map for arbitrary shapefile.
I know that we can use MapScript languge like python for custom
programming, and I already read some tutorial about python mapscript. I
need help/direction about which scripting language is easy to use and
more flexible and from where to start ,other link without Map-server
website and example.
I already use the Map file in cgi mode, but it is static and here we
manually change the file(metadata) for each shape file. i am interested
in a function /program which can handle styling for arbitrary shapefile.
Thanks in advance
sajid
student
All languages are the same, and can do the same thing. The question is
not which language is more flexable, but which language do I know the
best, or what language would I enjoy learning for this project.
I choose Perl. Not because of all the rave reviews it gets, or its
massive popularity, but because I know perl, I love it, I think in it.
So pick a language that mapscript supports. I can offer you the ideas I
used to write my site, and you can implement them in any language.
I use mod_perl, FastCGI, and uwsgi... all of which are pretty similar.
I start out with a url like:
http://maps.camavision.com/map/iowacityia
I pull off the last word and stuff that into $xmap.
Then I check the url for ether WMS or info, and if not found, I return a
suitable index.html file:
my $filename = MAPPATH./$xmap.map;
my $map = new mapscript::mapObj($filename);
MAPPATH is outside the htdocs folder.
Then, I've had reports where people have huge monitors so I need to make
sure the maxsize if at least 4096. I didnt want to check all my .map
files, so I just check in mapscript:
if ($map-{maxsize} 4096)
{
$map-{maxsize} = 4096;
}
I load various values from the map file, like the bounding box:
my $bbox = $map-{extent};
$vars{'minx'} = $bbox-{minx};
$vars{'miny'} = $bbox-{miny};
$vars{'maxx'} = $bbox-{maxx};
$vars{'maxy'} = $bbox-{maxy};
I generate some javascript for the index.html page:
$zoom = var bb = new OpenLayers.Bounds.fromArray([$vars{'minx'},
$vars{'miny'}, $vars{'maxx'}, $vars{'maxy'}]);\n
. \t\t\tmap.zoomToExtent(bb, true);\n;
And then I send it to the browser:
my $index = $config{$xmap}-{'index'} // 'index.html';
showTemplate($index, \%vars);
This page will include the openlayers stuff and setup to render the map.
openlayers will turn around and request map images using the url param
WMS.
My code, when it sees a WMS requst does this:
$owreq = new mapscript::OWSRequest();
my @par = $web-paramNames();
for my $x (@par)
{
my $v = $web-param($x);
$owreq-setParameter($x, $v);
}
my $map = new mapscript::mapObj( MAPPATH./$xmap.map );
It creates a request object, and copies all the url params into the owreq.
And here is the part you will like. If you pass along a parcel number:
http://maps.camavision.com/map/iowacityia?pin=1004178001
It dynamically creates a layer called annotate_pin (which is the blue
highlight):
if ($layername =~ 'annotate_pin')
{
# did we get a click point?
my $cx = $web-param('LON');
my $cy = $web-param('LAT');
if ( defined($cx) defined($cy))
{
$xpin = getPin($cx, $cy);
}
$q = $db-prepare(select shapeid from $xmap.getpoint where pin =
\$1);
$q-execute($xpin);
my $layer = $map-getLayerByName('parcels');
$layer-open();
my $newlayer = $map-getLayerByName('annotate_pin');
$newlayer-{status} = $mapscript::MS_ON;
my $shp;
($sid) = $q-fetchrow_array;
if (defined($sid))
{
$shp = $layer-getShape(new mapscript::resultObj($sid));
}
$q = undef;
$layer-close();
my $shape = $shp-clone();
$newlayer-addFeature($shape);
}
In the .map file, the layer annotate_pin exists, but is mostly empty.
It only contains a STYLE for drawing, but no data. I find the shape
from the parcels layer, clone it (just that one parcel) and add it to
the annotate_pin layer.
This code is not the exact code I run. I striped out a bunch to try and
make it more readable. On click of another parcel it sends an info url,
which does almost the exact same thing to move the highlight.
Also, you can see I'm doing queries to PostGIS and not using mapserver's
query's.
Re: [mapserver-users] Intersect and Union with mapserver
Thanks a world for your very helpful answers. Also sorry for a bit latency. I wasn't around here for a while. I was thinking a solution like the one suggested by Brent. Thanks to him for his detailed solution. It sounds at the end i should choose a database-dependent solution, as described by Brent. About the definition of Union in ArcGIS, the best reference to understand that, is ArcGIS help. This is the entry for Union with pictures and ... : http://resources.arcgis.com/en/help/main/10.1/index.html#//0008000s00 http://resources.arcgis.com/en/help/main/10.1/index.html#//0008000s00 Finally, as Jukka talked about QGIS. This is a little confusing to me. In a web mapping application which is implemented by MapServer, Can we rely on QGIS capabilities and use the in our application? If so, how would be the connection between MapServer and QGIS. Best Regards -- View this message in context: http://osgeo-org.1560.x6.nabble.com/Intersect-and-Union-with-mapserver-tp5095717p5096577.html Sent from the Mapserver - User mailing list archive at Nabble.com. ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] custom programming with Mapserver's python or java or C# (OR perl) mapscript
+1 to Andy's reply, I could not have said it better.
All mapscript implementations (java, c#, python, ruby, perl and tcl) share
the same code base, with the language specific glue being automatically
generated by swig.
PHP mapscript is the only exception.
Umberto
On Mon, Jan 6, 2014 at 4:32 PM, Andy Colson a...@squeakycode.net wrote:
On 1/6/2014 6:34 AM, Sajid Anwar wrote:
Hello,
I am wondering how to write a program (function) for Map server, which
dynamically handle arbitrary shapefile, and will change the style like
color etc, on the basis of attribute from shapefile. I want to develop
and rendered choropleth map for arbitrary shapefile.
I know that we can use MapScript languge like python for custom
programming, and I already read some tutorial about python mapscript. I
need help/direction about which scripting language is easy to use and
more flexible and from where to start ,other link without Map-server
website and example.
I already use the Map file in cgi mode, but it is static and here we
manually change the file(metadata) for each shape file. i am interested
in a function /program which can handle styling for arbitrary shapefile.
Thanks in advance
sajid
student
All languages are the same, and can do the same thing. The question is
not which language is more flexable, but which language do I know the
best, or what language would I enjoy learning for this project.
I choose Perl. Not because of all the rave reviews it gets, or its
massive popularity, but because I know perl, I love it, I think in it.
So pick a language that mapscript supports. I can offer you the ideas I
used to write my site, and you can implement them in any language.
I use mod_perl, FastCGI, and uwsgi... all of which are pretty similar.
I start out with a url like:
http://maps.camavision.com/map/iowacityia
I pull off the last word and stuff that into $xmap.
Then I check the url for ether WMS or info, and if not found, I return a
suitable index.html file:
my $filename = MAPPATH./$xmap.map;
my $map = new mapscript::mapObj($filename);
MAPPATH is outside the htdocs folder.
Then, I've had reports where people have huge monitors so I need to make
sure the maxsize if at least 4096. I didnt want to check all my .map
files, so I just check in mapscript:
if ($map-{maxsize} 4096)
{
$map-{maxsize} = 4096;
}
I load various values from the map file, like the bounding box:
my $bbox = $map-{extent};
$vars{'minx'} = $bbox-{minx};
$vars{'miny'} = $bbox-{miny};
$vars{'maxx'} = $bbox-{maxx};
$vars{'maxy'} = $bbox-{maxy};
I generate some javascript for the index.html page:
$zoom = var bb = new OpenLayers.Bounds.fromArray([$vars{'minx'},
$vars{'miny'}, $vars{'maxx'}, $vars{'maxy'}]);\n
. \t\t\tmap.zoomToExtent(bb, true);\n;
And then I send it to the browser:
my $index = $config{$xmap}-{'index'} // 'index.html';
showTemplate($index, \%vars);
This page will include the openlayers stuff and setup to render the map.
openlayers will turn around and request map images using the url param WMS.
My code, when it sees a WMS requst does this:
$owreq = new mapscript::OWSRequest();
my @par = $web-paramNames();
for my $x (@par)
{
my $v = $web-param($x);
$owreq-setParameter($x, $v);
}
my $map = new mapscript::mapObj( MAPPATH./$xmap.map );
It creates a request object, and copies all the url params into the owreq.
And here is the part you will like. If you pass along a parcel number:
http://maps.camavision.com/map/iowacityia?pin=1004178001
It dynamically creates a layer called annotate_pin (which is the blue
highlight):
if ($layername =~ 'annotate_pin')
{
# did we get a click point?
my $cx = $web-param('LON');
my $cy = $web-param('LAT');
if ( defined($cx) defined($cy))
{
$xpin = getPin($cx, $cy);
}
$q = $db-prepare(select shapeid from $xmap.getpoint
where pin = \$1);
$q-execute($xpin);
my $layer = $map-getLayerByName('parcels');
$layer-open();
my $newlayer = $map-getLayerByName('annotate_pin');
$newlayer-{status} = $mapscript::MS_ON;
my $shp;
($sid) = $q-fetchrow_array;
if (defined($sid))
{
$shp = $layer-getShape(new
mapscript::resultObj($sid));
}
$q = undef;
$layer-close();
my $shape = $shp-clone();
$newlayer-addFeature($shape);
}
In the .map file, the layer annotate_pin exists, but is mostly empty. It
only contains a STYLE for drawing, but
Re: [mapserver-users] Intersect and Union with mapserver
saka royban wrote: Finally, as Jukka talked about QGIS. This is a little confusing to me. In a web mapping application which is implemented by MapServer, Can we rely on QGIS capabilities and use the in our application? If so, how would be the connection between MapServer and QGIS. I wanted to emphasize the difference in the meaning of union for ESRI and for PostGIS and most other open source GIS programs as well as for the Open Geospatial Consortiom. For the latter group union means the same as dissolve for ESRI as illustrated in http://resources.arcgis.com/en/help/main/10.1/index.html#//0017005n00. QGIS was just an example of programs which understand union in the other way than ESRI. I am not sure about how to do the union as ESRI understands it with PostGIS and SQL. I guess that first you should create new geometries by clipping the polygons on layers A and B and then transfer the attributes from layers A and B to the new geometries by using a spatial join. -Jukka Rahkonen- -- View this message in context: http://osgeo-org.1560.x6.nabble.com/Intersect-and-Union-with-mapserver-tp5095717p5096577.html Sent from the Mapserver - User mailing list archive at Nabble.com. ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
Re: [mapserver-users] FastCGI with multiple map files
Andy's correct, the mapfile parse overhead is so small as to be almost unmeasurable (I once tried). FCGI re-parses every time. It's a good thing, makes working w/ FCGI transparent. P. On Fri, Jan 3, 2014 at 2:41 PM, Andy Colson a...@squeakycode.net wrote: On 1/3/2014 4:08 PM, Richard Greenwood wrote: I'm running FastCGI but I'm not sure that I have it configured optimally, or even correctly. I have about a dozen map files. My requests look like: mapserv.fcgi?map=abc.map... mapserv.fcgi?map=def.map... mapserv.fcgi?map=ghi.map... Does FCGI know to cache each map file so that I have a FCGI thread(s) for each map file? Or do I just have FCGI threads that are re-reading which ever map file is needed? Would I do better with a small script wrapper around each mapserv+mapfile like: abc.fcgi def.fcgi ghi.fcgi Sorry - I don't feel like I'm articulating my question very well. Rich -- Richard Greenwood richard.greenw...@gmail.com mailto:richard.greenw...@gmail.com www.greenwoodmap.com http://www.greenwoodmap.com ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users I believe it'll reload the .map file every request. But, your OS should cache it so you wont actually be hitting disk, and reading/parsing a .map file is very quick. I think this is pretty far down on the list of things to optimize. (Well, thats my opinion. I've never actually timed it) -Andy ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users ___ mapserver-users mailing list mapserver-users@lists.osgeo.org http://lists.osgeo.org/mailman/listinfo/mapserver-users
