there is a lot analysis of EBS IO performance out there. like http://orion.heroku.com/past/2009/7/29/io_performance_on_ebs/
but I think, my earlier question, about the purpose of this mapserver system needs to be addressed to be able to go further. for example, if you are reading a lot of layers/shapefiles to render pngs, thats one thing. If you are only interested in performance on image-based data, maybe just one giant layer of uncompressed GTifs thats another. It doesn't matter if you have the best IO, if you don't have the data optimized. On Fri, Jan 28, 2011 at 11:53 AM, Paul Spencer <[email protected]> wrote: > I don't have actual numbers handy to back this up, but a rough comparison > from what we observed rendering relatively complex maps was that EBS storage > was perhaps 2-4 as slow as a local dell desktop running linux with eSATA 1TB > drives (not high end hardware for sure). Using glusterfs was 8+ times as > slow. We ended up using EBS as we could fit all our data onto a 1TB disk, it > replicates reasonably quickly once snapshotted so to scale we start a new > instance and replicate the EBS volume behind a load balancer. Adding more > servers and copies of the data makes up for the slower IO speed somewhat but > every map draw still takes 2-4 times longer than using dedicated hardware. > On the other hand, it is very cost effective for scaling. But for the amount > of data that you are talking about, scaling by duplicating the EBS volumes > would be very expensive and I really thing shared storage via glusterfs is a > non-starter for that kind of volume of data if you want any kind of > reasonable render time. > > > On 2011-01-28, at 10:57 AM, [email protected] wrote: > >> What do you exactly mean by pathetic I/O on S3/EBS? > > > __________________________________________ > > Paul Spencer > Chief Technology Officer > DM Solutions Group Inc > http://research.dmsolutions.ca/ > > _______________________________________________ mapserver-users mailing list [email protected] http://lists.osgeo.org/mailman/listinfo/mapserver-users
