Re: [IAEP] [Systems] Content Delivery Network is in production
On Sun, Oct 11, 2009 at 22:41, David Farning dfarn...@sugarlabs.org wrote: For the last couple of week, we have been working with Peter Pöml to set up mirrorbrain as the content deliver network for Sugar Labs. There are a number advantages for using a content delivery network. 1. Usability - We can remove the mirror information from http://wiki.sugarlabs.org/go/Sugar_on_a_Stick/Strawberry#Download_locations . All a _user_ has to worry about is the single http://download.sugarlabs.org location , redirection to individual mirrors is invisible to the user. 2. Scalability - Rather that increasing the bandwidth or throughput on a primary sl.org machine we can distribute the load across a system of mirrors. Mirrors are a very well understood concept in free software delivery. Mirrorbrain is used by both opensuse and open office with loads 2 orders of magnitutide above Sugar Labs' loads. 3. Locality - Mirrorbrain uses geoip for to determine the physical location of downloader and mirrors. Mirrorbrain can determine the most appropriate mirror for a given download. Any traffic going through htp://download.sugarlabs.org (including activity bundles) will be served through the content delivery network. Seems to be working pretty well from here in Portugal, download.sl.o gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl. Both max out my connection (1.2 MB/s). Congrats, Tomeu -- «Sugar Labs is anyone who participates in improving and using Sugar. What Sugar Labs does is determined by the participants.» - David Farning ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep
Re: [IAEP] [Systems] Content Delivery Network is in production
Seems to be working pretty well from here in Portugal, download.sl.o gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl. Both max out my connection (1.2 MB/s). Nice, we will be adding mirrors as the system stabilizes. The goal is for the download infrastructure to be ready to handle 10X the bandwidth usage as on the last soas release. As soon as then SoaS and Marketing teams decide dates for the release and associated press releases can someone send notices of those dates to the systems mailing. Last year I had to restart the web server on sunjammer every couple of hours when it froze:( It would be nice to have Bernie and the other infrastructure gurus around on days we expect larger than normal loads david Congrats, Tomeu ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep
Re: [IAEP] [Systems] Content Delivery Network is in production
wow wow wow, this is a way cool concept. Local updates that would be truly local automagically. I really would want to know how this ends up working for the large deploys , esp. Uruguay. I have been told that some servers are quite overstressed already as it seems (correct me here please) that as the machines there are booted they automatically try to connect somewhere OLPCish. If it were true, I guess that should be fixed. On Mon, Oct 12, 2009 at 9:34 AM, David Farning dfarn...@sugarlabs.orgwrote: Seems to be working pretty well from here in Portugal, download.sl.o gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl. Both max out my connection (1.2 MB/s). Nice, we will be adding mirrors as the system stabilizes. The goal is for the download infrastructure to be ready to handle 10X the bandwidth usage as on the last soas release. As soon as then SoaS and Marketing teams decide dates for the release and associated press releases can someone send notices of those dates to the systems mailing. Last year I had to restart the web server on sunjammer every couple of hours when it froze:( It would be nice to have Bernie and the other infrastructure gurus around on days we expect larger than normal loads david Congrats, Tomeu ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep
Re: [IAEP] [Systems] Content Delivery Network is in production
On Mon, Oct 12, 2009 at 10:56 AM, Yama Ploskonka yamap...@gmail.com wrote: wow wow wow, this is a way cool concept. Local updates that would be truly local automagically. I really would want to know how this ends up working for the large deploys , esp. Uruguay. I have been told that some servers are quite overstressed already as it seems (correct me here please) that as the machines there are booted they automatically try to connect somewhere OLPCish. If it were true, I guess that should be fixed. Some where between 80 and 90% of activity bundle download traffic comes from Uruguary:) I am hoping to find a couple of mirrors in Uruguay in the next couple of days. If you have any leads We need room for about 30GB of content. Yes, .82 deployments are set to communicate directly with olpc servers. This has been updated in .86. Another option is for Sugar Labs to work with the VIG to make our mirror system available to OLPC. david On Mon, Oct 12, 2009 at 9:34 AM, David Farning dfarn...@sugarlabs.org wrote: Seems to be working pretty well from here in Portugal, download.sl.o gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl. Both max out my connection (1.2 MB/s). Nice, we will be adding mirrors as the system stabilizes. The goal is for the download infrastructure to be ready to handle 10X the bandwidth usage as on the last soas release. As soon as then SoaS and Marketing teams decide dates for the release and associated press releases can someone send notices of those dates to the systems mailing. Last year I had to restart the web server on sunjammer every couple of hours when it froze:( It would be nice to have Bernie and the other infrastructure gurus around on days we expect larger than normal loads david Congrats, Tomeu ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep
Re: [IAEP] [Systems] Content Delivery Network is in production
I'll post to Sur. Pablo Flores might be the prime actor here. Dunno if 'guay can ever use the .86, the whole point of .84 was to make it usable by the guayish security system AFAIK, but I am suitably ignorant of those matters as to fact. If I were right, and I am afraid I might be :-) then we will solve nothing on the OLPC servers getting overworked, that will stay, but we might be able to get the bundles to be better accessible, but who knows. By now I've lost track who handles servers for OLPC. Could someone copy direct? On Mon, Oct 12, 2009 at 11:10 AM, David Farning dfarn...@sugarlabs.orgwrote: On Mon, Oct 12, 2009 at 10:56 AM, Yama Ploskonka yamap...@gmail.com wrote: wow wow wow, this is a way cool concept. Local updates that would be truly local automagically. I really would want to know how this ends up working for the large deploys , esp. Uruguay. I have been told that some servers are quite overstressed already as it seems (correct me here please) that as the machines there are booted they automatically try to connect somewhere OLPCish. If it were true, I guess that should be fixed. Some where between 80 and 90% of activity bundle download traffic comes from Uruguary:) I am hoping to find a couple of mirrors in Uruguay in the next couple of days. If you have any leads We need room for about 30GB of content. Yes, .82 deployments are set to communicate directly with olpc servers. This has been updated in .86. Another option is for Sugar Labs to work with the VIG to make our mirror system available to OLPC. david On Mon, Oct 12, 2009 at 9:34 AM, David Farning dfarn...@sugarlabs.org wrote: Seems to be working pretty well from here in Portugal, download.sl.o gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl. Both max out my connection (1.2 MB/s). Nice, we will be adding mirrors as the system stabilizes. The goal is for the download infrastructure to be ready to handle 10X the bandwidth usage as on the last soas release. As soon as then SoaS and Marketing teams decide dates for the release and associated press releases can someone send notices of those dates to the systems mailing. Last year I had to restart the web server on sunjammer every couple of hours when it froze:( It would be nice to have Bernie and the other infrastructure gurus around on days we expect larger than normal loads david Congrats, Tomeu ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep ___ IAEP -- It's An Education Project (not a laptop project!) IAEP@lists.sugarlabs.org http://lists.sugarlabs.org/listinfo/iaep