Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-09-16 Thread David Kalnischkies
tags 636292 will-get-fixed-by-donkult-then-hell-freezes-over kthxbye On Fri, Sep 16, 2011 at 02:33, jida...@jidanni.org wrote: Given the difficulties in getting mirrors to use correct scripts I recall that was taken care of. and the apt not-safe-enough behavior of using different hosts Why

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-09-16 Thread Martin Bagge / brother
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 On 2011-09-16 02:33, jida...@jidanni.org wrote: Given the difficulties in getting mirrors to use correct scripts I recall that was taken care of. and the apt not-safe-enough behavior of using different hosts Why doesn't someone take care of

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-09-15 Thread jidanni
Given the difficulties in getting mirrors to use correct scripts I recall that was taken care of. and the apt not-safe-enough behavior of using different hosts Why doesn't someone take care of that. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject of

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-09-13 Thread jidanni
Actually all that is going to happen is one day I will accidentally send the tcpflow logs containing unrelated personal traffic too as the filtering is too complex, so I would appreciate it if someone looked into this bug. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-22 Thread Kurt Roeckx
On Mon, Aug 22, 2011 at 09:08:52AM +0800, jida...@jidanni.org wrote: starting Sun Aug 21 21:30:51 UTC 2011 Actually the first five minutes were spent in my 'sleep 5m' so it really is starting Sun Aug 21 21:35:51 UTC 2011 ending Sun Aug 21 21:36:55 UTC 2011 KR I'm not even sure that if

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-21 Thread jidanni
SP == Simon Paillard spaill...@debian.org writes: SP It's no longer the case, all ftp.us have no 80387. SP jidanni, do you still observe issues ? Yes, as a matter of fact I do. I even recorded the exact time window for you. In UTC as a special bonus. starting Sun Aug 21 21:30:51 UTC 2011 W:

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-21 Thread Kurt Roeckx
On Mon, Aug 22, 2011 at 06:12:43AM +0800, jida...@jidanni.org wrote: starting Sun Aug 21 21:30:51 UTC 2011 [...] ending Sun Aug 21 21:36:55 UTC 2011 I have a recommendation: that you fellows fix the this bug. As I have noted, it is certainly a one-liner. As we already pointed out, it is

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-21 Thread jidanni
starting Sun Aug 21 21:30:51 UTC 2011 Actually the first five minutes were spent in my 'sleep 5m' so it really is starting Sun Aug 21 21:35:51 UTC 2011 ending Sun Aug 21 21:36:55 UTC 2011 KR I'm not even sure that if you fix the multiple server connections KR that would get better or worse

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-13 Thread jidanni
H == Henrique de Moraes Holschuh h...@debian.org writes: H What I consider absurd is jidanni's probably one line bug comment. Naw... it's probably just a case of for(thing,checksum_of_thing){ do_dns_query(); #move this line before the loop get_it(); } -- To UNSUBSCRIBE, email

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-12 Thread Dominik Bay
On Fri, Aug 12, 2011 at 03:39, Henrique de Moraes Holschuh h...@debian.org wrote: On Fri, 12 Aug 2011, jida...@jidanni.org wrote: The checksum will come from a _different_ round robin machine, four out of five times. It's Russian Roulette. I can't bear to pull the trigger. A user would have to

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-12 Thread Henrique de Moraes Holschuh
On Fri, 12 Aug 2011, Dominik Bay wrote: On Fri, Aug 12, 2011 at 03:39, Henrique de Moraes Holschuh h...@debian.org wrote: On Fri, 12 Aug 2011, jida...@jidanni.org wrote: The checksum will come from a _different_ round robin machine, four out of five times. It's Russian Roulette. I can't

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-11 Thread jidanni
SP == Simon Paillard spaill...@debian.org writes: SP Could you please try to use ftp.us.d.o and confirm up to date ftpsync on all SP backends solved your problem ? I would be extremely ecstatically happy to. However, as I _proved_ in 636292 using tcpflow(1), a simple apt-get update, will make TWO

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-11 Thread Kurt Roeckx
On Sat, Aug 06, 2011 at 06:07:19AM +0800, jida...@jidanni.org wrote: Ha ha ha, it really does split a single apt-get update into two different places completely across the Internet. Any maybe even for singular servers like rocky-mountain... maybe upstream from it is the same splitting

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-11 Thread Henrique de Moraes Holschuh
On Fri, 12 Aug 2011, jida...@jidanni.org wrote: The checksum will come from a _different_ round robin machine, four out of five times. It's Russian Roulette. I can't bear to pull the trigger. A user would have to be crazy to use a round robin mirror until the apt team finally gets around to

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-07 Thread Henrique de Moraes Holschuh
On Sun, 07 Aug 2011, Kurt Roeckx wrote: The new .debs are done first, so that if you get a Packages or Sources file, you can actually download the files mentioned in those files. They are directly copied to the correct place since they are new files and not updated files. Then the

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-07 Thread jidanni
H == Henrique de Moraes Holschuh h...@debian.org writes: H That doesn't even need a third issue (multiple DNS queries) OK. But at least that part could be fixed now. No denying it is happening, as I showed with tcpflow! -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-06 Thread Kurt Roeckx
On Sat, Aug 06, 2011 at 09:30:44AM +0800, jida...@jidanni.org wrote: KR == Kurt Roeckx k...@roeckx.be writes: KR - There is always a delay between updating the Release file and KR the Packages and Sources file, and the error should go away KR after a short time. NOT acceptable. I hope

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-06 Thread jidanni
KR == Kurt Roeckx k...@roeckx.be writes: KR Except that it's about 1000 files. This is basicly what rsync KR --delay-updates does, and what is being used. And on a very busy KR mirror this can actually take some time to do. Well all I know is the 998 .debs should be done first. Then the 1 index

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-06 Thread Kurt Roeckx
On Sun, Aug 07, 2011 at 05:26:40AM +0800, jida...@jidanni.org wrote: KR == Kurt Roeckx k...@roeckx.be writes: KR Except that it's about 1000 files. This is basicly what rsync KR --delay-updates does, and what is being used. And on a very busy KR mirror this can actually take some time to do.

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread Kurt Roeckx
On Tue, Aug 02, 2011 at 09:10:40AM +0800, jida...@jidanni.org wrote: I think I have a very good idea of what is causing all those MD5Sum mismatch errors during apt-get update. ( http://article.gmane.org/gmane.linux.debian.user.mirrors/1368 ) You see during a single apt-get update, there

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread Henrique de Moraes Holschuh
(cc's kept since I am not really sure everyone involved is in subscribed to debian-mirrors. If you want me to start trimming them down, please say so). On Fri, 05 Aug 2011, Kurt Roeckx wrote: Even with multiple lines in the sources.list file I only see those 2 requests. Hmm, a normal request

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread jidanni
Oh my god even my rock solid rocky-mountain server is crumbling today: W: Failed to fetch http://rocky-mountain.csail.mit.edu/debian/dists/experimental/main/binary-i386/PackagesIndex MD5Sum mismatch W: Failed to fetch

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread jidanni
Ha ha ha, it really does split a single apt-get update into two different places completely across the Internet. Any maybe even for singular servers like rocky-mountain... maybe upstream from it is the same splitting problem somewhere. Anyway here we go: # cat /etc/apt/sources.list.d/* deb

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread jidanni
KR == Kurt Roeckx k...@roeckx.be writes: KR - There is always a delay between updating the Release file and KR the Packages and Sources file, and the error should go away KR after a short time. NOT acceptable. I hope on the mirrors they are not doing something like $ cd staging_area wget a

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread jidanni
$ wget a b mv a b staging_area With a and b and staging_area all being on the same disk partition, for almost an atomic operation... OK this is probably not the culprit today, but it is just good practice. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org with a subject

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-05 Thread jidanni
H == Henrique de Moraes Holschuh h...@debian.org writes: H Maybe using rsync or ftp can help, if it enforces the get everything H using the same connection that http might or might not allow apt to do. H But that does NOT scale well at the mirror server side, at all. Well whatever you do,

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-04 Thread Samuel Thibault
retitle 636292 MD5Sum mismatch error thanks jida...@jidanni.org, le Tue 02 Aug 2011 09:10:40 +0800, a écrit : I think I have a very good idea of what is causing all those MD5Sum mismatch errors during apt-get update. ( http://article.gmane.org/gmane.linux.debian.user.mirrors/1368 ) You see

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-04 Thread jidanni
ST == Samuel Thibault sthiba...@debian.org writes: ST I'm getting the error on all ftp.{uk,ch,fr}.debian.org sites, which do ST not use round robin at all. All I know is rocky-mountain.csail.mit.edu is rock solid. Try that. -- To UNSUBSCRIBE, email to debian-bugs-dist-requ...@lists.debian.org

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-04 Thread Jonathan Nieder
Hi, 積丹尼 wrote: You can test it yourself. Turn on verbose debugging in your DNS server, and do apt-get update, and check the log. Voila, two queries for each one line in sources.list! That particular consequence of mirrors' use of round-robin DNS is tracked as Bug#582352. As far as I can

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-04 Thread jidanni
forcemerge 636292 582352 thanks JN == Jonathan Nieder jrnie...@gmail.com writes: JN 積丹尼 wrote: You can test it yourself. Turn on verbose debugging in your DNS server, and do apt-get update, and check the log. Voila, two queries for each one line in sources.list! JN That particular

Bug#636292: MD5Sum mismatch is due to multiple DNS queries!

2011-08-01 Thread jidanni
X-Debbugs-Cc: spaill...@debian.org, debian-mirr...@lists.debian.org, h...@debian.org Package: apt Version: 0.8.15.5 I think I have a very good idea of what is causing all those MD5Sum mismatch errors during apt-get update. ( http://article.gmane.org/gmane.linux.debian.user.mirrors/1368 ) You