Hi David!
>(thankfully, apt/experimental has some improvements in terms of error >reporting which help here. Hash sum mismatch messages used to be >borderline useless – now they still are, but are very talkative ;) >That said, I am a bit surprised its installed in your chroot…) $ aptitude --version aptitude 0.8.1 Compiler: g++ 5.3.1 20160429 Compiled against: apt version 5.0.0 NCurses version 6.0 libsigc++ version: 2.8.0 Gtk+ support disabled. Qt support disabled. Current library versions: NCurses version: ncurses 6.0.20160319 cwidget version: 0.5.17 Apt version: 5.0.0 $ apt --version apt 1.3~exp3 (amd64) (jut for your information) > DISCLAIMER: I have this in apt.conf.d> cat /etc/apt/apt.conf.d/99fixbadproxy > Acquire::http::Pipeline-Depth 0; > Acquire::http::No-Cache true; > Acquire::BrokenProxy true; (While it might be true, the last option doesn't exist, so no effect) >APT is reasonably good at detecting proxies/servers which mess up >pipelining and disables pipelining automatically then (with a warning), >so I would suggest dropping all these options and see what a 'stock' apt >does. No-Cache /can/ work or its completely ignored as its just a hint >for proxies – it doesn't solve any of your problems through as all >requested files have unique names by now and there is no "old" cache >problem (there are also more of these options with more or less the same >intended effected as in the web everything must be done in a bunch of >incompatible vendor-specific ways… but I digress) I have to say a disclaimer: without that file even my machine wasn't able to work :) and it fails in the same way I: Copy /etc/apt/apt.conf.d/00aptitude /etc/apt/apt.conf.d/00trustcdrom /etc/apt/apt.conf.d/01-vendor-ubuntu /etc/apt/apt.conf.d/01autoremove /etc/apt/apt.conf.d/01autoremove-kernels /etc/apt/apt.conf.d/10periodic /etc/apt/apt.conf.d/15update-stamp /etc/apt/apt.conf.d/20archive /etc/apt/apt.conf.d/20auto-upgrades /etc/apt/apt.conf.d/20dbus /etc/apt/apt.conf.d/50appstream /etc/apt/apt.conf.d/50unattended-upgrades /etc/apt/apt.conf.d/70debconf /etc/apt/apt.conf.d/99synaptic /etc/apt/apt.conf.d/99update-notifier to chroot I: Installing apt-lines and pinning for experimental I: mounting /proc filesystem I: mounting /run/shm filesystem I: mounting /dev/pts filesystem I: policy-rc.d already exists I: Refreshing the base.tgz I: upgrading packages Get:1 http://giano.com.dist.unige.it/debian sid InRelease [209 kB] Get:2 http://giano.com.dist.unige.it/debian experimental InRelease [107 kB] Get:3 http://giano.com.dist.unige.it/debian sid/main amd64 Packages.diff/Index [27.9 kB] Get:4 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages.diff/Index [27.8 kB] Get:5 http://giano.com.dist.unige.it/debian sid/non-free amd64 Packages.diff/Index [27.8 kB] Get:6 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-04-2114.57.pdiff [14.8 kB] Get:7 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-0318.07.pdiff [17.1 kB] Get:8 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-0913.08.pdiff [7036 B] Get:9 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-1514.06.pdiff [20.4 kB] Get:10 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-05-2111.29.pdiff [17.5 kB] Get:11 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-0311.39.pdiff [11.8 kB] Get:12 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-0904.26.pdiff [68.7 kB] Ign:12 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-0904.26.pdiff Get:13 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-1505.17.pdiff [9176 B] Get:14 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-06-2107.39.pdiff [7160 B] Get:15 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-07-0309.38.pdiff [11.5 kB] Get:16 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-07-0911.25.pdiff [44.1 kB] Ign:16 http://giano.com.dist.unige.it/debian sid/main amd64 Packages 2016-07-07-0911.25.pdiff Get:17 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages.diff/Index [27.8 kB] Get:18 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages 2016-07-05-1514.06.pdiff [31 B] Get:19 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages 2016-07-05-2111.29.pdiff [431 B] Get:19 http://giano.com.dist.unige.it/debian sid/contrib amd64 Packages 2016-07-05-2111.29.pdiff [431 B] Get:20 http://giano.com.dist.unige.it/debian sid/non-free amd64 Packages 2016-07-05-2111.29.pdiff [434 B] Get:20 http://giano.com.dist.unige.it/debian sid/non-free amd64 Packages 2016-07-05-2111.29.pdiff [434 B] Get:21 http://giano.com.dist.unige.it/debian sid/main amd64 Packages [7150 kB] Err:21 http://giano.com.dist.unige.it/debian sid/main amd64 Packages Hash Sum mismatch Hashes of expected file: - Checksum-FileSize:7150036 [weak] - SHA256:4cb56a1539103ba2b95d944083297d9b75dc1221397ca5e805546af5f508a860 - MD5Sum:d796a3aa522903626c0264ad2011f17f [weak] Hashes of received file: - SHA256:722a3db60a5badd39166c6aa0185aec76c61d2d1948628fb601c7224288f6741 - MD5Sum:8ea70dc8048e38c715faeb601f9f4f84 [weak] - Checksum-FileSize:7139802 [weak] Last modification reported: Thu, 07 Jul 2016 08:32:20 GMT Release file created at: Thu, 07 Jul 2016 09:26:23 GMT Get:22 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-04-2114.57.pdiff [1942 B] Get:23 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-0318.07.pdiff [2246 B] Get:24 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-0913.08.pdiff [2471 B] Get:25 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-1514.06.pdiff [945 B] Get:26 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-05-2111.29.pdiff [15.6 kB] Get:27 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-0311.39.pdiff [12.6 kB] Get:28 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-0904.26.pdiff [1318 B] Get:29 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-1505.17.pdiff [21.9 kB] Get:30 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-06-2107.39.pdiff [215 B] Get:31 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-07-0309.38.pdiff [1228 B] Get:32 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-07-0911.25.pdiff [467 B] Get:32 http://giano.com.dist.unige.it/debian experimental/main amd64 Packages 2016-07-07-0911.25.pdiff [467 B] Fetched 7807 kB in 3s (2396 kB/s) Reading package lists... E: Failed to fetch http://giano.com.dist.unige.it/debian/dists/sid/main/binary-amd64/by-hash/SHA256/4cb56a1539103ba2b95d944083297d9b75dc1221397ca5e805546af5f508a860 Hash Sum mismatch Hashes of expected file: - Checksum-FileSize:7150036 [weak] - SHA256:4cb56a1539103ba2b95d944083297d9b75dc1221397ca5e805546af5f508a860 - MD5Sum:d796a3aa522903626c0264ad2011f17f [weak] Hashes of received file: - SHA256:722a3db60a5badd39166c6aa0185aec76c61d2d1948628fb601c7224288f6741 - MD5Sum:8ea70dc8048e38c715faeb601f9f4f84 [weak] - Checksum-FileSize:7139802 [weak] Last modification reported: Thu, 07 Jul 2016 08:32:20 GMT Release file created at: Thu, 07 Jul 2016 09:26:23 GMT >Your problem starts with this innocent looking line already, which is >present in both update calls – even in the one ending up working. What >apt is telling you here is that it wanted to do pdiff patching, but >while downloading this patch something bad happened (what exactly is >hard to say without debug options as printing the error message would >counter that the error is ignored, but my guess is hashsum mismatch), so >apt falls back to acquiring the entire file instead of trying to patch >up an old version. In the first update that worked, in your second it >doesn't: >Interestingly if you truncate the expected file to the size apt got from >the server and calculate hashes for it, you get the ones apt got, so the >proxy/server is sending the correct file, but either it doesn't sent >everything or apt isn't receiving everything. Or something of both… > >Please run apt with these options set: >Debug::Acquire::http "true"; >Debug::pkgAcquire::Worker "true"; >Acquire::Progress::Ignore::ShowErrorText "true"; well, I did comment the two lines you told me above Acquire::http::Pipeline-Depth 0; #Acquire::http::No-Cache true; #Acquire::BrokenProxy true; and now the experimental chroot has been updated with no issues. I still have an yakkety chroot that needs update, and with the following content Acquire::http::Pipeline-Depth 0; #Acquire::http::No-Cache true; #Acquire::BrokenProxy true; Debug::Acquire::http "true"; Debug::pkgAcquire::Worker "true"; Acquire::Progress::Ignore::ShowErrorText "true"; this is the output I: Copy /etc/apt/apt.conf.d/00aptitude /etc/apt/apt.conf.d/00trustcdrom /etc/apt/apt.conf.d/01-vendor-ubuntu /etc/apt/apt.conf.d/01autoremove /etc/apt/apt.conf.d/01autoremove-kernels /etc/apt/apt.conf.d/10periodic /etc/apt/apt.conf.d/15update-stamp /etc/apt/apt.conf.d/20archive /etc/apt/apt.conf.d/20auto-upgrades /etc/apt/apt.conf.d/20dbus /etc/apt/apt.conf.d/50appstream /etc/apt/apt.conf.d/50unattended-upgrades /etc/apt/apt.conf.d/70debconf /etc/apt/apt.conf.d/99fixbadproxy /etc/apt/apt.conf.d/99synaptic /etc/apt/apt.conf.d/99update-notifier to chroot I: mounting /proc filesystem I: mounting /run/shm filesystem I: mounting /dev/pts filesystem I: policy-rc.d already exists I: Refreshing the base.tgz I: upgrading packages Get:1 http://archive.ubuntu.com/ubuntu yakkety-proposed InRelease [95.7 kB] Get:2 http://archive.ubuntu.com/ubuntu yakkety InRelease [247 kB] Get:3 http://archive.ubuntu.com/ubuntu yakkety-proposed/main amd64 Packages [54.5 kB] Get:4 http://archive.ubuntu.com/ubuntu yakkety-proposed/universe amd64 Packages [201 kB] Err:4 http://archive.ubuntu.com/ubuntu yakkety-proposed/universe amd64 Packages Hash Sum mismatch Hashes of expected file: - Checksum-FileSize:201188 - SHA256:b75b6b2f6bab4ac4cdc52baf89addf8ad67850fbbd4944f42920987b737fe5f8 - SHA1:738d1744cc4da9e24515efc618af30838149002c - MD5Sum:2c3de3c80b5aa2b66a1d5fa9cce41377 Hashes of received file: - SHA256:6298ed1c0bc28f8d24d36304f680161c1892cddaf932a5ab2002debee749d60d - SHA1:91da46bd8393286b5af602621e54a96c8abc9490 - MD5Sum:66d9f854a7ab3a7fc692658e8f4193d8 - Checksum-FileSize:178104 Last modification reported: Thu, 07 Jul 2016 12:57:25 GMT Release file created at: Thu, 07 Jul 2016 12:57:20 GMT Get:5 http://archive.ubuntu.com/ubuntu yakkety/main amd64 Packages [1205 kB] Get:6 http://archive.ubuntu.com/ubuntu yakkety/universe amd64 Packages [7816 kB] Fetched 9596 kB in 3s (2497 kB/s) Reading package lists... E: Failed to fetch http://archive.ubuntu.com/ubuntu/dists/yakkety-proposed/universe/binary-amd64/by-hash/SHA256/b75b6b2f6bab4ac4cdc52baf89addf8ad67850fbbd4944f42920987b737fe5f8 Hash Sum mismatch Hashes of expected file: - Checksum-FileSize:201188 - SHA256:b75b6b2f6bab4ac4cdc52baf89addf8ad67850fbbd4944f42920987b737fe5f8 - SHA1:738d1744cc4da9e24515efc618af30838149002c - MD5Sum:2c3de3c80b5aa2b66a1d5fa9cce41377 Hashes of received file: - SHA256:6298ed1c0bc28f8d24d36304f680161c1892cddaf932a5ab2002debee749d60d - SHA1:91da46bd8393286b5af602621e54a96c8abc9490 - MD5Sum:66d9f854a7ab3a7fc692658e8f4193d8 - Checksum-FileSize:178104 Last modification reported: Thu, 07 Jul 2016 12:57:25 GMT Release file created at: Thu, 07 Jul 2016 12:57:20 GMT E: Some index files failed to download. They have been ignored, or old ones used instead. >That causes apt (or to be specific: apts 'http' method) to display the HTTP >request it makes as well as the responses it gets while the second shows the >interprocess communication between apt and its methods (beware, lots of >output). >And third causes apt to tell us the error it ignored, just for completeness. > >[aka: No need for wireshark or other "hard" debug stuff just yet, There >tends to be an option for everything in apt… so much that some are even >made up and people believe they exist: BrokenProxy from above ;) ] this is "my" fault, when I wasn't even able to apt-get upgrade, I googled around, found that stackoverflow [1] solution about the proxy issue, copy-pasted it, and everything was good. This is why I didn't investigate it further, since the issue was fixed BTW googling for Acquire::BrokenProxy=true shows *lots* of results [1] http://stackoverflow.com/questions/15505775/debian-apt-packages-hash-sum-mismatch thanks for your help! Gianfranco
