Package: mirrors
User: mirr...@packages.debian.org
Usertags: httpredir
Control: submitter -1  Martin Scharm <mar...@binfalse.de>



-------- Forwarded Message --------
Subject: Frequent Mirror Problems
Date: Fri, 24 Jun 2016 09:01:16 +0200
From: Martin Scharm <mar...@binfalse.de>
To: mirr...@debian.org

Hi mirrors team,

I am having a few problems with mirrors in the httpredir.debian.org
pool. If I try to install a lot of packages certain mirrors (or maybe it
is the httpredir service?) sometimes/often respond with an error after
downloading about 200 to 350 packages. The number of successful
downloads differs from time to time, but the problem occurs quite frequent.
That's especially annoying, as I'm developing a Docker image. So
downloaded packages won't be cached and I cannot (cleanly) run a second
apt-get call to get the remaining packages, which would still be a dirty
workaround.
In my case it's texlive-full that I'm trying to install. It feels like I
can run the same command a hundred times and it will fail in 85 cases. I
figured out that it helps to decrease the number of packages to be
downloaded. If I replace

> apt-get install -y texlive-full

with two apt-get calls

> apt-get install -y texlive-base
> apt-get install -y texlive-full

I've never seen any problems, which leads to my first hypothesis that
some mirrors seem to have problems with a lot of requests.

I first suspected that there is an issue with my network/dns settings,
but I'm developing that stuff from a university network and the Docker
servers do have the same issues building the image. Here you'll find
some automated builds of the image:
https://hub.docker.com/r/binfalse/texpile/builds/
As you see, two versions failed to build. Both did have a problem
downloading Debian packages:

* In case of
https://hub.docker.com/r/binfalse/texpile/builds/b8pvbtx94kn55jqundfcrwg/ the
mirror 128.31.0.66 didn't serve
http://httpredir.debian.org/debian/pool/main/g/gsfonts/gsfonts_8.11+urwcyr1.0.7~pre44-4.2_all.deb
* In case of
https://hub.docker.com/r/binfalse/texpile/builds/bjsdjeu8k6rbbcgsecxpkyz/ the
mirror 5.153.231.35 didn't deliver
http://httpredir.debian.org/debian/pool/main/t/texlive-extra/texlive-publishers-doc_2014.20141024-1_all.deb

Both links to the packages do work fine for me when accessed using a
browser or curl. However, that probably means nothing as I'm getting
redirected somewhere else.
If I try to download texlive-publishers-doc_2014.20141024-1_all.deb from
one of the failing servers above (naively assuming that it is supposed
to be in
/debian/pool/main/t/texlive-extra/texlive-publishers-doc_2014.20141024-1_all.deb)
I also get an error in my browser. Thus, my second hypothesis is that
there are simply some black sheep in the pool? And every once in a while
I unfortunately get redirected to a bad server? And the probability that
this happens just increases with the number of packages to be installed.

Or am I doing something wrong? It would be super cool if you could help
me with this issue. Please let me know if you need more information!

Thanks a lot for your efforts! You're doing a great thing! :)


Best wishes from Rostock,
Martin





Attachment: signature.asc
Description: OpenPGP digital signature

Reply via email to