Hi Richard,

I plan to post a more detailed writeup of my experiences participating in the 
benchmark.

But basically the results were (for really large datasets from spain):

1) MapServer is super fast

2) Mapnik is almost as fast for most tests. And we consider this an excellent 
result as we can get faster with more work and profiling. No doubt some great 
ideas will likely come out of the upcoming sprint.

3) Mapnik appears to scale linearly which means that under high load it can be 
faster than MapServer (this is a *huge* positive outcome of the comparison).

4) Mapnik using a PostGIS backend (on a separate machine) appears to both be 
faster and scale better than MapServer. But this should be considered a *very* 
preliminary result as a single configuration change by MapServer could change 
the result in the future. Or another server could get around to doing a PostGIS 
run and be faster than Mapnik - we'll see.

5) Mapnik does not scale well when reprojecting geometries (thread locking?) 
and this is a key area for improvement.

Comparing just to MapServer is easiest for summary purposes, but many of the 
other servers that were involved provide interesting contrasts.

The results you want to look at for more details are:

http://svn.osgeo.org/osgeo/foss4g/benchmarking/scripts/results/benchmarking2010.odp
 (open office slides)

If you page through these slides you can see that some teams chose not to 
publish their results at this time. And in some cases some results are missing 
for Mapnik, because I either did not have time to run the benchmark (e.g. 
Shapefile + GeoTIFF combined) or Mapnik did not support the test (e.g. raster 
reprojection).

The main tests (and the ones that received the most attention by all teams) 
were using shapefile and geotiff datasources. The PostGIS test was not 
considered a "baseline test" (e.g. it was optional) and not all teams took the 
time to run it. Of course I focused quite a bit of testing effort on PostGIS 
because I know it is overwhelmingly the *most* important backend for most 
Mapnik users.

When I find time to post a blog entry about the benchmark I plan to provide 
some extra charts showing how to get Mapnik to scale well using PostGIS (hint: 
launching the server with *lots* (number of cores *4 ) of allowable threads but 
making sure you do not overload PostGIS with too many connections)

Dane


On Sep 15, 2010, at 3:12 PM, Richard Weait wrote:

> Hi Mapnik Fans,
> 
> I'm having a little trouble interpreting this graph, showing the
> results from the WMS shootout at FOSS4G.  It looks to me like Mapnik,
> and Dane's Paleoserver, performed better than any of the other
> competitors on the graph.  GeoServer, Constellation and Oracle appear
> in the legend, but not in the results, so I'm not sure what that
> means.
> 
> http://mapnik.org/news/2010/sep/10/wms_benchmarking_2010/
> 
> Congratulations on the great performance improvement over the last while, 
> Dane!
> _______________________________________________
> Mapnik-users mailing list
> [email protected]
> https://lists.berlios.de/mailman/listinfo/mapnik-users

_______________________________________________
Mapnik-users mailing list
[email protected]
https://lists.berlios.de/mailman/listinfo/mapnik-users

Reply via email to