Re: www.debian.org very slow indeed?

2000-01-11 Thread Joey Hess
George Bonser wrote:
> Ok, pretty much scripting. The modification of the A record for DNS can be
> handled with the dynamic update capability of bind-8. Is the code Debian
> uses to distribute to the push mirrors available someplace. Would rather
> modify something that is already running than invent a new wheel.

http://www.debian.org/mirror/ftpmirror

-- 
see shy jo


Re: www.debian.org very slow indeed?

2000-01-10 Thread Nathan E Norman
On Sun, 9 Jan 2000, George Bonser wrote:

 : On Sun, 9 Jan 2000, Carl Fink wrote:
 : 
 : > Has anyone else noticed that the main (US) Debian servers have been
 : > remarkably slow lately?  Both trying to use the web site, and
 : > ftp.debian.org for apt. 
 : > 
 : > I've switched apt to a mirror, but the mirrors of the web site are
 : > also so slow as to be nearly unusable?

All this sounds like a problem with the provider ... traceroutes may be
in order.

 : One problem is the mirrors themselves. There is no standard method for
 : mirroring or any policy.

Uh, no - this isn't true for http.us.debian.org

[ snip ]

 : There is no policy for ensuring that the Packages file on 63.209.15.252
 : matches the files on 207.69.194.216 so failures are frequent. To avoid the
 : whole problem many just use ftp.debian.org and are done with it. I really
 : do not care if things are not the most current, I do care that it is
 : consistant and predictable.

Actually there is - all mirrors which comprise http.us.debian.org are
(supposed) to be primary-push mirrors.  They are updated regularly every
day at the same time.  The primary ftp server inititates the update.

 : Hate to bitch without offering a suggestion so one way of doing this is:
 : 
 : 1. round-robin mirrors grab all the new packages
 : 2. they notify the central server that the update is complete
 : 3. Once all servers have notified the central server that they have all
 :packages, the new Packages files are pushed to them and old packages
 :that have been replaced (files that no longer exists on the master ) 
 :are deleted.
 : 4. If a server has not notified the central master by a certain "drop
 :dead" time, it is removed from round-robin DNS and the Packages files
 :are pushed to the others. Once it reports in, its Packages file is sent
 :and it is added to the round-robin DNS.

Hmm, good ideas ... let's see code :)  You might want to float the idea
on debian-mirrors also.

Thanks,

--
Nathan Norman
MidcoNet  410 South Phillips Avenue  Sioux Falls, SD
mailto:[EMAIL PROTECTED]   http://www.midco.net
finger [EMAIL PROTECTED] for PGP Key: (0xA33B86E9)



Re: www.debian.org very slow indeed?

2000-01-10 Thread Nathan E Norman
On Sun, 9 Jan 2000, Carl Fink wrote:

 : Has anyone else noticed that the main (US) Debian servers have been
 : remarkably slow lately?  Both trying to use the web site, and
 : ftp.debian.org for apt. 

The web site is on a different server altogether as far as I know.

 : I've switched apt to a mirror, but the mirrors of the web site are
 : also so slow as to be nearly unusable?

Did you try http.us.debian.org?  That's a round-robin DNS record dor
several servers; there's a package whose name escapes me that will allow
you to find the "best" one.

Feel free to check out debian.midco.net; if it's fast for you use it :)
We're a primary-push mirror.

 : Has Debian gotten too popular for its infrastructure?

Possibly - it's hard to maintain "fast" net-access across the Internet
as a whole.  The infrastructure of the Internet itself grows in
complexity every day as well ...

 : I may actually be able to offer some mirror space in the near term,
 : but not right now.

There's a debian-mirrors list in addition to the mirror info on the web
page.

--
Nathan Norman
MidcoNet  410 South Phillips Avenue  Sioux Falls, SD
mailto:[EMAIL PROTECTED]   http://www.midco.net
finger [EMAIL PROTECTED] for PGP Key: (0xA33B86E9)



Re: www.debian.org very slow indeed?

2000-01-10 Thread Jason Gunthorpe

On Sun, 9 Jan 2000, George Bonser wrote:

> There is no policy for ensuring that the Packages file on 63.209.15.252
> matches the files on 207.69.194.216 so failures are frequent. To avoid the

Actually 63.209.15.252 recently had some sort of mirroring problem, it
should be fixed now. Otherwise the top level mirrors at least stay quite
well in sync.

Jason


Re: www.debian.org very slow indeed?

2000-01-10 Thread Brian Servis
*- On  9 Jan, Carl Fink wrote about "www.debian.org very slow indeed?"
> Has anyone else noticed that the main (US) Debian servers have been
> remarkably slow lately?  Both trying to use the web site, and
> ftp.debian.org for apt. 
> 
> I've switched apt to a mirror, but the mirrors of the web site are
> also so slow as to be nearly unusable?
> 
> Has Debian gotten too popular for its infrastructure?
> 
> I may actually be able to offer some mirror space in the near term,
> but not right now.

Try the mtr or traceroute command to see if it is not perhaps a server
inbetween you and ftp.debian.org.  For me I am not having any problems.
Another good tool is netselect to find a mirror which is faster for you.

# netselect -vv ftp.debian.org ftp.us.debian.org http.us.debian.org \
http.us.debian.org debian.midco.net
ftp.debian.org 211 ms  12 hops   80% ok ( 8/10) [  578]
ftp.us.debian.org  152 ms  15 hops  100% ok (10/10) [  380]
http.us.debian.org 218 ms  13 hops   90% ok ( 9/10) [  556]
http.us.debian.org 203 ms  12 hops   80% ok ( 8/10) [  556]
debian.midco.net   183 ms   9 hops   90% ok ( 9/10) [  385]
  380 ftp.us.debian.org


You should also try and use the {http,ftp}.us.debian.org sites rather
than the straight {http,ftp}.debian.org sites for apt.  The .us. sites
are on a round robin dns so will spread the load out over several
different sites.

# nslookup http.us.debian.org
Server:  localhost
Address:  127.0.0.1

Non-authoritative answer:
Name:http.us.debian.org
Addresses:  209.249.97.234, 141.213.4.21, 63.209.15.252, 207.69.194.216
  24.220.0.13


HTH,
Brian Servis
-- 

Mechanical Engineering  |  Never criticize anybody until you  
Purdue University   |  have walked a mile in their shoes,
[EMAIL PROTECTED]   |  because by that time you will be a
http://www.ecn.purdue.edu/~servis   |  mile away and have their shoes.