Re: [IAEP] [Systems] Content Delivery Network is in production

2009-10-12 Thread Tomeu Vizoso
On Sun, Oct 11, 2009 at 22:41, David Farning dfarn...@sugarlabs.org wrote:
 For the last couple of week, we have been working with Peter Pöml to
 set up mirrorbrain as the content deliver network for Sugar Labs.
 There are a number advantages for using a content delivery network.

 1. Usability -  We can  remove the mirror information from
 http://wiki.sugarlabs.org/go/Sugar_on_a_Stick/Strawberry#Download_locations
 .  All a _user_ has to worry about is the single
 http://download.sugarlabs.org location , redirection to individual
 mirrors is invisible to the user.

 2. Scalability - Rather that increasing the bandwidth or throughput on
 a primary sl.org machine we can distribute the load across a system of
 mirrors.  Mirrors are a very well understood concept in free software
 delivery.  Mirrorbrain is used by both opensuse and open office with
 loads 2 orders of magnitutide above Sugar Labs' loads.

 3. Locality - Mirrorbrain uses geoip for to determine the physical
 location of downloader and mirrors.  Mirrorbrain can determine the
 most appropriate mirror for a given download.

 Any traffic going through htp://download.sugarlabs.org (including
 activity bundles) will be served through the content delivery network.

Seems to be working pretty well from here in Portugal, download.sl.o
gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl.
Both max out my connection (1.2 MB/s).

Congrats,

Tomeu

-- 
«Sugar Labs is anyone who participates in improving and using Sugar.
What Sugar Labs does is determined by the participants.» - David
Farning
___
IAEP -- It's An Education Project (not a laptop project!)
IAEP@lists.sugarlabs.org
http://lists.sugarlabs.org/listinfo/iaep


Re: [IAEP] [Systems] Content Delivery Network is in production

2009-10-12 Thread David Farning
 Seems to be working pretty well from here in Portugal, download.sl.o
 gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl.
 Both max out my connection (1.2 MB/s).

Nice, we will be adding mirrors as the system stabilizes.  The goal is
for the download infrastructure to  be ready to handle 10X the
bandwidth usage as on the last soas release.

As soon as then SoaS and Marketing teams decide dates for the release
and associated press releases can someone send notices of those dates
to the systems mailing.

Last year I had to restart the web server on sunjammer every couple of
hours when it froze:(  It would be nice to have Bernie and the other
infrastructure gurus around on days we expect larger than normal loads


david
 Congrats,

 Tomeu
___
IAEP -- It's An Education Project (not a laptop project!)
IAEP@lists.sugarlabs.org
http://lists.sugarlabs.org/listinfo/iaep


Re: [IAEP] [Systems] Content Delivery Network is in production

2009-10-12 Thread Yama Ploskonka
wow wow wow, this is a way cool concept.  Local updates that would be truly
local automagically.  I really would want to know how this ends up working
for the large deploys , esp. Uruguay.  I have been told that some servers
are quite overstressed already as it seems (correct me here please) that as
the machines there are booted they automatically try to connect somewhere
OLPCish.  If it were true, I guess that should be fixed.

On Mon, Oct 12, 2009 at 9:34 AM, David Farning dfarn...@sugarlabs.orgwrote:

  Seems to be working pretty well from here in Portugal, download.sl.o
  gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl.
  Both max out my connection (1.2 MB/s).

 Nice, we will be adding mirrors as the system stabilizes.  The goal is
 for the download infrastructure to  be ready to handle 10X the
 bandwidth usage as on the last soas release.

 As soon as then SoaS and Marketing teams decide dates for the release
 and associated press releases can someone send notices of those dates
 to the systems mailing.

 Last year I had to restart the web server on sunjammer every couple of
 hours when it froze:(  It would be nice to have Bernie and the other
 infrastructure gurus around on days we expect larger than normal loads


 david
  Congrats,
 
  Tomeu
 ___
 IAEP -- It's An Education Project (not a laptop project!)
 IAEP@lists.sugarlabs.org
 http://lists.sugarlabs.org/listinfo/iaep

___
IAEP -- It's An Education Project (not a laptop project!)
IAEP@lists.sugarlabs.org
http://lists.sugarlabs.org/listinfo/iaep

Re: [IAEP] [Systems] Content Delivery Network is in production

2009-10-12 Thread David Farning
On Mon, Oct 12, 2009 at 10:56 AM, Yama Ploskonka yamap...@gmail.com wrote:
 wow wow wow, this is a way cool concept.  Local updates that would be truly
 local automagically.  I really would want to know how this ends up working
 for the large deploys , esp. Uruguay.  I have been told that some servers
 are quite overstressed already as it seems (correct me here please) that as
 the machines there are booted they automatically try to connect somewhere
 OLPCish.  If it were true, I guess that should be fixed.

Some where between 80 and 90% of activity bundle download traffic
comes from Uruguary:)  I am hoping to find a couple of mirrors in
Uruguay in the next couple of days.  If you have any leads  We
need room for about 30GB of content.

Yes, .82 deployments are set to communicate directly with olpc
servers.  This has been updated in .86.  Another option is for Sugar
Labs to work with the VIG to make our mirror system available to OLPC.

david

 On Mon, Oct 12, 2009 at 9:34 AM, David Farning dfarn...@sugarlabs.org
 wrote:

  Seems to be working pretty well from here in Portugal, download.sl.o
  gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl.
  Both max out my connection (1.2 MB/s).

 Nice, we will be adding mirrors as the system stabilizes.  The goal is
 for the download infrastructure to  be ready to handle 10X the
 bandwidth usage as on the last soas release.

 As soon as then SoaS and Marketing teams decide dates for the release
 and associated press releases can someone send notices of those dates
 to the systems mailing.

 Last year I had to restart the web server on sunjammer every couple of
 hours when it froze:(  It would be nice to have Bernie and the other
 infrastructure gurus around on days we expect larger than normal loads


 david
  Congrats,
 
  Tomeu
 ___
 IAEP -- It's An Education Project (not a laptop project!)
 IAEP@lists.sugarlabs.org
 http://lists.sugarlabs.org/listinfo/iaep


___
IAEP -- It's An Education Project (not a laptop project!)
IAEP@lists.sugarlabs.org
http://lists.sugarlabs.org/listinfo/iaep

Re: [IAEP] [Systems] Content Delivery Network is in production

2009-10-12 Thread Yama Ploskonka
I'll post to Sur.  Pablo Flores might be the prime actor here.

Dunno if 'guay can ever use the .86, the whole point of .84 was to make it
usable by the guayish security system AFAIK, but I am suitably ignorant of
those matters as to fact.

If I were right, and I am afraid I might be :-) then we will solve nothing
on the OLPC servers getting overworked, that will stay, but we might be able
to get the bundles to be better accessible, but who knows.  By now I've lost
track who handles servers for OLPC.  Could someone copy direct?



On Mon, Oct 12, 2009 at 11:10 AM, David Farning dfarn...@sugarlabs.orgwrote:

 On Mon, Oct 12, 2009 at 10:56 AM, Yama Ploskonka yamap...@gmail.com
 wrote:
  wow wow wow, this is a way cool concept.  Local updates that would be
 truly
  local automagically.  I really would want to know how this ends up
 working
  for the large deploys , esp. Uruguay.  I have been told that some servers
  are quite overstressed already as it seems (correct me here please) that
 as
  the machines there are booted they automatically try to connect somewhere
  OLPCish.  If it were true, I guess that should be fixed.

 Some where between 80 and 90% of activity bundle download traffic
 comes from Uruguary:)  I am hoping to find a couple of mirrors in
 Uruguay in the next couple of days.  If you have any leads  We
 need room for about 30GB of content.

 Yes, .82 deployments are set to communicate directly with olpc
 servers.  This has been updated in .86.  Another option is for Sugar
 Labs to work with the VIG to make our mirror system available to OLPC.

 david

  On Mon, Oct 12, 2009 at 9:34 AM, David Farning dfarn...@sugarlabs.org
  wrote:
 
   Seems to be working pretty well from here in Portugal, download.sl.o
   gets redirected to download2.sl.o (solarsail @ MIT?) and utwente.nl.
   Both max out my connection (1.2 MB/s).
 
  Nice, we will be adding mirrors as the system stabilizes.  The goal is
  for the download infrastructure to  be ready to handle 10X the
  bandwidth usage as on the last soas release.
 
  As soon as then SoaS and Marketing teams decide dates for the release
  and associated press releases can someone send notices of those dates
  to the systems mailing.
 
  Last year I had to restart the web server on sunjammer every couple of
  hours when it froze:(  It would be nice to have Bernie and the other
  infrastructure gurus around on days we expect larger than normal loads
 
 
  david
   Congrats,
  
   Tomeu
  ___
  IAEP -- It's An Education Project (not a laptop project!)
  IAEP@lists.sugarlabs.org
  http://lists.sugarlabs.org/listinfo/iaep
 
 

___
IAEP -- It's An Education Project (not a laptop project!)
IAEP@lists.sugarlabs.org
http://lists.sugarlabs.org/listinfo/iaep