---------- Forwarded message ---------- To: Brian Behlendorf <[EMAIL PROTECTED]> cc: [EMAIL PROTECTED] Subject: Re: some updates Date: Fri, 13 Jun 1997 09:36:23 +0200 From: Goran Oberg <[EMAIL PROTECTED]>
> The release of 1.2.0 caused an unprecedented amount of traffic on our > site; so much so that the bandwidth provider for www.apache.org has > begun to grumble. To address this, we have taken some measures to bolster > the effectiveness of the site in supporting mirrors: How are the load spread between http and ftp? I have choosen not run a ftp-service at apache.dc.luth.se because of the extra work maintaining a secure anonymous ftp-server. It would be interesting to know more about how many accesses different mirrors get and how they are distributed between http and ftp. > 1) We will now be running CGI scripts on mirror sites. Previously all CGI > scripts, such as the search field and bug database, had an explicit link > back to www.apache.org. These CGI scripts only rely upon perl 4 (or 5) > being at "/usr/local/bin/perl". Is this a problem? "We will now be running CGI scripts on mirror sites." Hmm, I don't think it's that easy. Apache is a great software in many ways, one of these ways is that with a little basic knowledge of the Apache system it's quite easy to maintain basic security. I would expect that most, if not all, mirrored www-sites won't let any executable file with cgi-suffix be executed by default. At least it wouldn't here at apache.dc.luth.se. I have made loose sketches on a simple distributed version of CPAN that wouldn't require every CPAN-like resolution go through one single point of failure and/or congestion. If there's enough interest in this idea I could perhaps pick this up again. Also, as Apache development spreads, perhaps an overall framework similar to Perl's CPAN module organization would be useful. See <URL:http://www.perl.com/ CPAN/CPAN.html> for more info. > There may be more issues brought up by this than I anticipated - let's > discuss them here. Thanks again to everyone for providing mirror sites, > hopefully the storm will die down soon. I'll append some statistics, hits by day and where visitors are entering from. Perhaps apache.dc.luth.se is somewhat off the map, located at the north-most university of Sweden, but when you look at the network topology in SUNET and NORDUnet apache.dc.luth.se is able to serve most of the sites connected to NORDUnet at a rate limited mainly be the bandwidth closest to the user, e.g. local lans. Here's some simple statistics I've thrown together. It's the number of accesses the last couple of week and a count of from where people are arriving. Out of 8892 accesses, 6822 (77%) where acknowledging their origin. Out of these there were 3222 (47%) originating from a non-apache.dc.luth.se address. I'll list those last in my letter. Anything after a '?' in the addresses have been removed to protect the anonymity of search-engines users. Any 'file'-URLs have also been removed. I hope these statistics is of interest to someone or can be useful in the analysis of how the efforts spreading the load should proceed. 1997-04-26 : 85 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-04-27 : 100 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-04-28 : 231 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-04-29 : 488 ( 0.5 kreq/day, 0.01 Mreq/month) 1997-04-30 : 380 ( 0.4 kreq/day, 0.01 Mreq/month) 1997-05-01 : 169 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-02 : 179 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-03 : 209 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-04 : 165 ( 0.2 kreq/day, 0.00 Mreq/month) 1997-05-05 : 270 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-06 : 212 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-07 : 276 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-08 : 124 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-09 : 175 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-10 : 133 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-11 : 106 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-12 : 277 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-13 : 266 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-14 : 298 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-15 : 224 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-16 : 315 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-17 : 54 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-18 : 161 ( 0.2 kreq/day, 0.00 Mreq/month) 1997-05-19 : 150 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-20 : 215 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-21 : 210 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-22 : 159 ( 0.2 kreq/day, 0.00 Mreq/month) 1997-05-23 : 201 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-24 : 81 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-25 : 70 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-26 : 256 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-05-27 : 194 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-05-28 : 136 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-29 : 109 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-30 : 120 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-05-31 : 140 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-06-01 : 57 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-06-02 : 68 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-06-03 : 95 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-06-04 : 179 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-06-05 : 139 ( 0.1 kreq/day, 0.00 Mreq/month) 1997-06-06 : 329 ( 0.3 kreq/day, 0.01 Mreq/month) 1997-06-07 : 188 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-06-08 : 33 ( 0.0 kreq/day, 0.00 Mreq/month) 1997-06-09 : 186 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-06-10 : 240 ( 0.2 kreq/day, 0.01 Mreq/month) 1997-06-11 : 165 ( 0.2 kreq/day, 0.00 Mreq/month) 1997-06-12 : 216 ( 0.2 kreq/day, 0.01 Mreq/month) 488 http://www.apache.org/ 192 http://index.opentext.net/OTI_Robot.html 93 http://euroseek.com 72 http://www.unit.liu.se/apache/ 69 http://www.apache.org/mirrors.html 37 http://www.dsv.su.se/webserver/index.html 30 http://www.dsv.su.se/webserver/www-server-dsv.html 24 http://www.excite.com/search.gw 20 http://www.pal.xgw.fi/apache/ 14 http://www.infoseek.com/Titles 12 http://webex.travsoft.com/ 10 http://www.infoap.com.ar/apache/ 6 http://www.apache.org/mirrors/list.cgi 5 http://numeri.campus.luth.se/ 5 http://gd.tuwien.ac.at/infosys/servers/http/apache/ 4 http://www.apache.org/mirrors/ 4 http://apache.www.nacamar.de/ 3 http://www.taxnews.com/ 3 http://sunsite.doc.ic.ac.uk/packages/apache/ 3 http://bond.edu.au/External/Misc/apache/ 2 http://www/webserver/www-server-dsv.html 2 http://www.ut.ee/apache/ 2 http://www.ub.lu.se/~marten/links/refs.html 2 http://www.metacrawler.com/crawler 2 http://www.euroseek.net/query 2 http://www.apache.org/#download 2 http://sunsite.icm.edu.pl/pub/www/apache/ 2 http://ftp.cs.tu-berlin.de//pub/net/www/apache/ 2 http://excite.com/search.gw 2 http://apache.org/ 1 http://www2.happysize.co.jp/apache/ 1 http://www.uuserv.net.tw/apache/ 1 http://www.ut.ee/apache/mirrors.html 1 http://www.syd.dit.csiro.au/tools/apache/ 1 http://www.student.kiruna.se/ 1 http://www.spies.com/~ceej/Journal/Mar97/970304.html 1 http://www.powertech.no/apache/ 1 http://www.oncomdis.on.ca/apache/ 1 http://www.module.vympel.msk.ru/mirror/apache/ 1 http://www.module.vympel.msk.ru/eng/mirror/apache/ 1 http://www.mbh.org/archive/apache/ 1 http://www.iworld.net/apache/ 1 http://www.it.kth.se/edu/gru/Fingerinfo/telesys.finger/Mobile.VT97/Labs/bookmark.html 1 http://www.ies.luth.se/depts/system/unix.htm 1 http://www.iWorld.net/apache/ 1 http://www.apache.de/ 1 http://sunsite.cnlab-switch.ch/www/mirror/apache/ 1 http://sunsite.auc.dk/apache/ 1 http://subzero.campus.luth.se/index 1 http://phf.apache.org/ 1 http://mathema.it/pub/apache/ 1 http://info.dsv.su.se/webserver/index.html 1 http://http://sunsite.sut.ac.jp/pub/archives/WWW/apache/mirrors.html 1 http://http://sunsite.sut.ac.jp/pub/archives/WWW/apache/default.html 1 http://guide-p.infoseek.com/Titles 1 http://foobar.szabinet.hu/apache/ 1 http://dsv.su.se/webserver/index.html 1 http://boomer.digibel.be/mirrors/apache/ 1 http://apache.oncomdis.on.ca/ 1 http://apache.compuex.com/ 1 http://apache.arctic.org/ 1 http://SunSITE.sut.ac.jp/pub/archives/WWW/apache/ 1 ftp://ftp.rediris.es/mirror/apache/index.html 1 ftp://ftp.apache.org/apache/mirrors.html
