Hello, thanks for your replies Justin: i forgot to mention that i am distributing live FLV growing files (distribution using a modded lighthttpd mod_flv_streaming). Which means that all the leaf http servers have to have their root shared/mirrored in a quite precise way. They have to keep streaming the file all the time so that it's (relatively) up to date.
Second precision: we will host only media on Amazon, not the webapps/databases etc. I wanted to check distributed caching systems, like dijjer, but the problem is that whenever the software detects the file has changed (based on last modification time & file size) it will redownload it entirely. The propagation time can be an issue then. What would be ideal is a mirrored filesystem, one or several master servers (with write access), and slaves (read only), that would stream the file. Anybody here having had the same problem ? I know people often use rsync for this, but i can't. I'll have to try MogileFS, but there's still the EC2 problem: EC2 servers are "naked". The second issue is the lack of guaranteed bw, i don't think it will be easy to manage the network load (Amazon is very vague about the Internet link you have -- only speak about the between instances 250 MB link...). About http redirect load balancing: yes, it is what i am considering. However, pound seems to link it's load-balancing concepts with the reverse proxy functionnality; i want to do network bandwith balancing; with pound, redirection can be done according to the requested filetype/directory, which allows distributing the files following their name/place, not load (i may be wrong, sorry if that's the case). I'd be curious to know more about enomaly services or any other potential simple dynamic http file serving hosted services. Akamai is way too expensive for us (small young startup), p2p overlays are too intrusive (we like flash distribution), and i'm afraid rtsp servers are not as efficient as http file serving. Some rumors seem to indicate that a hypothetical genuine Amazon load balancing service is on it's way, but i don't know anything for sure... Cheers, Florent Thiery _______________________________________________ p2p-hackers mailing list [email protected] http://lists.zooko.com/mailman/listinfo/p2p-hackers
