#include <hallo.h>
* Simon Paillard [Sun, Feb 13 2011, 02:20:26AM]:
> Hi,
> 
> (Luca, don't know whether you want to be kept cc)
> 
> On Sat, Feb 12, 2011 at 08:33:29PM +0100, Eduard Bloch wrote:
> > reopen 612854
> > retitle 612854 About 1/7 of entries not working
> > thanks
> 
> > I just adopted my little script which looks for the availability of
> > Ubuntu information to Debian mirror data and the result is quite
> > disturbing. About 80 of 545 listed mirrors (resp. the HTTP URLs
> > representing the mirror data) are not reachable or not containing Debian
> > archive data.
> > 
> > List of bad mirrors attached. IMHO Mirrors.masterlist needs a serious
> > cleanup. I volunteer for the task if you wish me to do it.
> 
> Please refrain from giving false figure, it seems seems your script
> misinterprent the list contents:
> - tested Alias as if it were an alternate Site name, while it's intended to be
>   a clue about the trace file to be searched. (e.g.: debian.proxad.net)
> - still test disabled mirrors, i.e ignore X-Archive-http status, which says 
> the
>   mirror is not valid through this path (e.g: cudlug.cudenver.edu) 
> - other cases like ftp.tu-chemnitz.de, which is ok, I don't know why your
>   script considers it nok (not using apache listing ?)

Bien sûr, let's filter them then. The script looks for relevant contents
of a Release file. Now 17 are still remaining, see
attachment. See second attachment for the probing script.

> I'm sure few mirrors in the list are indeed not working, but that's certainly
> not 1/7.
> 
> http://mirror.debian.org/status.html (whose perl code is not happy with ftp
> with its recent move to bellini)

Ok... but I only cared about HTTP mirrors this time. Some are simply
down, some seem to have stopped synching a long time ago, some don't
have the debian directory anymore and some have the contents in the
known directory but one level below, like
http://debian.comu.edu.tr/debian/dists/stable/ and like
http://mirror.cc.columbia.edu/debian/ did when I reported the original
problem (looks like somebody fixed it in the meantime).

Regards,
Eduard.
http://algo.mur.at/debian
http://canyonero.heanet.ie/debian
http://cudlug.cudenver.edu/debian
http://debian.c3sl.ufpr.br/debian
http://debian.ciencias.uchile.cl/debian
http://debian.coe.psu.ac.th/debian
http://debian.csie.nctu.edu.tw/debian
http://debian.interhost.co.il/debian
http://debian.linux.org.tw/debian
http://debian.logiclinux.com/debian
http://debian.plusserver.de/debian
http://debian.proxad.net/debian
http://debian.secsup.org
http://debian.server4you.de/debian
http://debian.torredehanoi.org/debian
http://debian.turkmesh.com.tr/debian
http://debian.unesr.edu.ve/debian
http://debian.vserver.de/debian
http://debs.ifsul.edu.br/debian
http://dennou-h.ees.hokudai.ac.jp/debian
http://fma.if.usp.br/debian
http://frigga.gva.es/mirror/debian
http://ftp.bofh.it/debian
http://ftp.ceid.upatras.gr/pub/debian
http://ftp.coe.psu.ac.th/debian
http://ftp.cse.yzu.edu.tw/pub/Linux/debian/debian
http://ftp.grn.cat/debian
http://ftp.grn.es/debian
http://ftp.isu.edu.tw/debian
http://ftp.jyu.fi/debian
http://ftp.metu.edu.tr/debian
http://ftp.netspace.net.au/pub/debian
http://ftp.oss.tw/pub/Linux/debian/debian
http://ftp.pucpr.br/debian
http://ftp.th.debian.org/debian
http://ftp.tiscali.nl/debian
http://ftp.tu-chemnitz.de/pub/linux/debian/debian
http://ftp.ua.pt/debian
http://ftp.uga.edu/debian
http://ftp.v6.coe.psu.ac.th/debian
http://ftp3.ca.debian.org/debian
http://ftpmirror.proxad.net/debian
http://gelehallon.bsnet.se/debian
http://katmai.its.ac.id/debian
http://lennon.cc.jyu.fi/debian
http://linux.cdpa.nsysu.edu.tw/debian
http://linuxserv.uga.edu/debian
http://marla.ludost.net/debian
http://mirror.3fl.net.au/debian
http://mirror.3logic.net/debian
http://mirror.comp.nus.edu.sg/Debian
http://mirror.debian.mn/debian
http://mirror.in.th/debian
http://mirror.mountaincable.net/debian
http://mirror.pacific.net.au/debian
http://mirror.unej.ac.id/debian
http://mirror.ynet.sk/debian
http://mirror2.blueyonder.co.uk
http://mirrors.ispros.com.bd/debian
http://mirrors.sth.sze.hu/debian
http://mirrors.uol.com.br/pub/debian
http://mirrors.xservers.ro/debian
http://ns34892.ovh.net/debian
http://open.hands.com/debian
http://pegasus.rz.tu-clausthal.de/pub/linux/debian
http://rib.ticklers.org/debian
http://russell.cs.bilgi.edu.tr/debian
http://screwdriver.csua.berkeley.edu/debian
http://selene.servytec.es/debian
http://server.psn.ru/debian
http://spider.mur.at/debian
http://tengu.easynet.fr
http://torio.iq.usp.br/debian
http://uwsg.iu.edu/linux/debian
http://vlad-tepes.bofh.it/debian
http://watson.zp.ua/debian
http://windu.bcc.bilkent.edu.tr/debian
http://www.mirrorservice.org/sites/ftp.debian.org/debian
http://zaphod.gtlib.gatech.edu/debian
#!/usr/bin/perl
#

use strict;
my %fddset;
my %fdvset;
# temp values within one data set
my @hosts;
my @pathsdeb;
my @pathsvol;

while(<>)
{
   chomp;
   s/^\s+//;
   s/\s+$//;
   next if /^#/;
   if(/(\S+)\s*:\s*(\S+)/)
   {
      my $key=$1;
      my $value=$2;

      if($key eq "Site" || $key eq "Includes")
      {
         push(@hosts, split(/\s/, $value));
      }
      if($key eq "Archive-http")
      {
         push(@pathsdeb, $value);
      }
      if($key eq "Volatile-http")
      {
         push(@pathsvol, $value);
      }
   }
   elsif(@hosts)
   {
      foreach my $h (@hosts)
      {
         $fddset{"$h$_"}=1 foreach @pathsdeb;
         $fdvset{"$h$_"}=1 foreach @pathsvol;
      }
      undef @hosts;
      undef @pathsdeb;
      undef @pathsvol;
   }

}

sub dumpUrls
{
   my $setref=shift;
   my $output=shift;
   my $checkRelease=shift;

   open(fdd, ">$output") || die;

   foreach (sort(keys %$setref))
   {
      my $url="http://$_";;
      if($checkRelease)
      {
         $ENV{url}=$url; # let the shell get it right & safe
         if(system("wget -q -t1 -O- --timeout=15 \"\$url/dists/stable/Release\" | grep -q Suite:"))
         {
            print STDERR "Failed mirror URL: $url\n";
            next;
         }
      }
      print fdd "$url\n";
   }
   close(fdd) || die;
   print "$output created\n";
}

dumpUrls(\%fddset, "conf/deb_mirrors", 1);
dumpUrls(\%fdvset, "conf/debvol_mirrors", 0);

# XXX Use Getopt::Long to parse known options, add options for output
# directory, checked/unchecked, with/without Aliases, with/without disabled
# paths

Reply via email to