[Touch-packages] [Bug 1408963] Re: [Xbuntu 14.04, 14.10 and 15.04] Network manager stops working: iwl3945 0000:03:00.0: BSM uCode verification failed at addr ...; wlan0: deauthenticating from... by lo
If you are wondering how to disable power saving, please look at https://askubuntu.com/a/860754/35182 -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to network-manager in Ubuntu. https://bugs.launchpad.net/bugs/1408963 Title: [Xbuntu 14.04, 14.10 and 15.04] Network manager stops working: iwl3945 :03:00.0: BSM uCode verification failed at addr ...; wlan0: deauthenticating from... by local choice (Reason: 3=DEAUTH_LEAVING), Status in network-manager package in Ubuntu: Incomplete Bug description: From time to time, the system loses all wireles networks and kubuntu network manager applet goes blank - not even one network is shown. All wifi connections are broken. Rebooting fixes the issue, switching to WICD on-the-fly enables to continue browsing without rebooting, so it seems to be no hardware issue or iwl3945 issue. What to expect: stable connections and flawless network managing. What happens: so above. Further informations about the system, the network configuration, the package version can be found in the attachment, also parts of rsyslog and dmesg. Interesting, according to some helpers, are the following lines: dmesg: wlan0: deauthenticating from 02:26:4d:ac:8f:45 by local choice (Reason: 3=DEAUTH_LEAVING) lsb_release -a No LSB modules are available. Distributor ID: Ubuntu Description:Ubuntu 14.10 Release:14.10 Codename: utopic apt-cache policy network-manager network-manager: Installiert: 0.9.8.8-0ubuntu28 Installationskandidat: 0.9.8.8-0ubuntu28 Versionstabelle: *** 0.9.8.8-0ubuntu28 0 500 http://de.archive.ubuntu.com/ubuntu/ utopic/main amd64 Packages 100 /var/lib/dpkg/status To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/network-manager/+bug/1408963/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1521136] Re: NetworkManager segfaults on connect
Confirmed downgrading fixes the problem. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to network-manager in Ubuntu. https://bugs.launchpad.net/bugs/1521136 Title: NetworkManager segfaults on connect Status in network-manager package in Ubuntu: Confirmed Bug description: Upon connecting, NetworkManager from -updates is segfaulting: [ 139.520739] NetworkManager[15884]: segfault at 0 ip 00497ad7 sp 7fff77195d00 error 4 in NetworkManager[40+1bf000] Nov 30 10:31:23 arbella NetworkManager[16259]: keyfile: add connection in-memory (c4b6e184-67e3-4a12-8dd3-79ec7ef650e0,"enx803f5d087a34") Nov 30 10:31:23 arbella NetworkManager[16259]: (enx803f5d087a34): device state change: unmanaged -> unavailable (reason 'connection-assumed') [10 20 41] Nov 30 10:31:23 arbella NetworkManager[16259]: (enx803f5d087a34): device state change: unavailable -> disconnected (reason 'connection-assumed') [20 30 41] Nov 30 10:31:23 arbella NetworkManager[16259]: (enx803f5d087a34): Activation: starting connection 'enx803f5d087a34' (c4b6e184-67e3-4a12-8dd3-79ec7ef650e0) Nov 30 10:31:23 arbella NetworkManager[16259]: nm_device_get_device_type: assertion 'NM_IS_DEVICE (self)' failed Nov 30 10:31:23 arbella NetworkManager[16259]: (lo): link connected Nov 30 10:31:23 arbella NetworkManager[16259]: (lo): new Generic device (carrier: ON, driver: 'unknown', ifindex: 1) Nov 30 10:31:23 arbella NetworkManager[16259]: (wlp2s0): using nl80211 for WiFi device control Nov 30 10:31:23 arbella NetworkManager[16259]: (wlp2s0): driver supports Access Point (AP) mode Nov 30 10:31:23 arbella NetworkManager[16259]: (wlp2s0): new 802.11 WiFi device (carrier: UNKNOWN, driver: 'ath10k_pci', ifindex: 3) Nov 30 10:31:23 arbella NetworkManager[16259]: (wlp2s0): device state change: unmanaged -> unavailable (reason 'managed') [10 20 2] Nov 30 10:31:23 arbella kernel: [ 140.168048] IPv6: ADDRCONF(NETDEV_UP): wlp2s0: link is not ready Nov 30 10:31:23 arbella NetworkManager[16259]: urfkill disappeared from the bus Nov 30 10:31:23 arbella NetworkManager[16259]: use BlueZ version 5 Nov 30 10:31:23 arbella NetworkManager[16259]: wpa_supplicant running Nov 30 10:31:23 arbella NetworkManager[16259]: (wlp2s0): supplicant interface state: starting -> ready Nov 30 10:31:23 arbella NetworkManager[16259]: (lxcbr0): device state change: disconnected -> prepare (reason 'none') [30 40 0] Nov 30 10:31:23 arbella NetworkManager[16259]: (enx803f5d087a34): device state change: disconnected -> prepare (reason 'none') [30 40 0] Nov 30 10:31:23 arbella NetworkManager[16259]: Policy set 'enx803f5d087a34' (enx803f5d087a34) as default for IPv4 routing and DNS. ProblemType: Bug DistroRelease: Ubuntu 15.10 Package: Network-Manager 1.0.4-0ubuntu5 ProcVersionSignature: Ubuntu 4.2.0-18.22-generic 4.2.3 Uname: Linux 4.2.0-18-generic x86_64 ApportVersion: 2.19.1-0ubuntu5 Architecture: amd64 CurrentDesktop: Unity Date: Mon Nov 30 10:39:36 2015 IfupdownConfig: # interfaces(5) file used by ifup(8) and ifdown(8) auto lo iface lo inet loopback InstallationDate: Installed on 2015-11-21 (9 days ago) InstallationMedia: Ubuntu 15.10 "Wily Werewolf" - Release amd64 (20151021) IpRoute: default via 10.20.64.1 dev wlp2s0 proto static metric 600 10.0.3.0/24 dev lxcbr0 proto kernel scope link src 10.0.3.1 10.20.64.0/21 dev wlp2s0 proto kernel scope link src 10.20.66.104 metric 600 169.254.0.0/16 dev lxcbr0 scope link metric 1000 NetworkManager.state: [main] NetworkingEnabled=true WirelessEnabled=true WWANEnabled=true WimaxEnabled=true SourcePackage: network-manager UpgradeStatus: No upgrade log present (probably fresh install) nmcli-dev: DEVICE TYPE STATE DBUS-PATH CONNECTION CON-UUID CON-PATH lxcbr0 bridgeconnected /org/freedesktop/NetworkManager/Devices/3 lxcbr0 ac91e68a-905e-4cd2-a937-11b8c5f4bed0 /org/freedesktop/NetworkManager/ActiveConnection/1 wlp2s0 wifi connected /org/freedesktop/NetworkManager/Devices/2 Canonical-2.4GHz-g 4eb6b0d8-a49e-4e11-aff1-18ce3f158523 /org/freedesktop/NetworkManager/ActiveConnection/2 lo loopback unmanaged /org/freedesktop/NetworkManager/Devices/1 -- ---- nmcli-nm: Error: command ['nmcli', '-f', 'all', 'nm'] failed with exit code 2: Error: Object 'nm' is unknown, try 'nmcli help'. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/network-manager/+bug/1521136/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packa
[Touch-packages] [Bug 1462692] Re: Ordering cycle on NetworkManager-wait-online.service/start
openafs is: ezyang@sabre:~$ aptitude show openafs-client Package: openafs-client State: installed Automatically installed: yes Version: 1.6.11.1-0ppa1~ubuntu15.04.1 Priority: optional Section: net Maintainer: Benjamin Kaduk [truncated] which is coming from the official OpenAFS stable PPA: https://launchpad.net/~openafs/+archive/ubuntu/stable Here's the other command output ezyang@sabre:~$ systemctl cat screen-cleanup # /run/systemd/generator.late/screen-cleanup.service # Automatically generated by systemd-sysv-generator [Unit] Documentation=man:systemd-sysv-generator(8) SourcePath=/etc/init.d/screen-cleanup Description=LSB: screen sessions cleaning DefaultDependencies=no Before=sysinit.target After=remote-fs.target [Service] Type=forking Restart=no TimeoutSec=0 IgnoreSIGPIPE=no KillMode=process GuessMainPID=no RemainAfterExit=yes ExecStart=/etc/init.d/screen-cleanup start ExecStop=/etc/init.d/screen-cleanup stop ezyang@sabre:~$ dpkg -S screen-cleanup.service init.d/screen-cleanup dpkg-query: no path found matching pattern *screen-cleanup.service* screen: /etc/init.d/screen-cleanup -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to systemd in Ubuntu. https://bugs.launchpad.net/bugs/1462692 Title: Ordering cycle on NetworkManager-wait-online.service/start Status in systemd package in Ubuntu: Incomplete Bug description: I recently rebooted my computer, and NetworkManager didn't come online. Snooping dmesg revealed the problem: [ 16.371556] systemd[1]: Breaking ordering cycle by deleting job network.target/start [ 16.371561] systemd[1]: Job network.target/start deleted to break ordering cycle starting with network-online.target/start [ 16.371722] systemd[1]: Found ordering cycle on NetworkManager-wait-online.service/start [ 16.371727] systemd[1]: Found dependency on NetworkManager.service/start [ 16.371732] systemd[1]: Found dependency on basic.target/start [ 16.371736] systemd[1]: Found dependency on sockets.target/start [ 16.371739] systemd[1]: Found dependency on cups.socket/start [ 16.371743] systemd[1]: Found dependency on sysinit.target/start [ 16.371747] systemd[1]: Found dependency on screen-cleanup.service/start [ 16.371751] systemd[1]: Found dependency on remote-fs.target/start [ 16.371754] systemd[1]: Found dependency on openafs-client.service/start [ 16.371758] systemd[1]: Found dependency on network-online.target/start [ 16.371762] systemd[1]: Found dependency on NetworkManager-wait-online.service/start [ 16.371766] systemd[1]: Breaking ordering cycle by deleting job NetworkManager.service/start [ 16.371771] systemd[1]: Job NetworkManager.service/start deleted to break ordering cycle starting with NetworkManager-wait-online.service/start Manually running `sudo systemctl start NetworkManager` brought it back online. But there shouldn't be an ordering cycle! The problem seems to be that sockets wants cups, and then through a hilarious chain of events we hit openafs-client which obviously needs network. So for some reason, wants constraints are being honored too strictly. ProblemType: Bug DistroRelease: Ubuntu 15.04 Package: systemd 219-7ubuntu5 ProcVersionSignature: Ubuntu 3.19.0-18.18-generic 3.19.6 Uname: Linux 3.19.0-18-generic x86_64 NonfreeKernelModules: openafs ApportVersion: 2.17.2-0ubuntu1.1 Architecture: amd64 Date: Sat Jun 6 15:49:54 2015 EcryptfsInUse: Yes InstallationDate: Installed on 2013-11-21 (562 days ago) InstallationMedia: Ubuntu 13.10 "Saucy Salamander" - Release amd64 (20131016.1) MachineType: LENOVO 7762K3U PccardctlIdent: Socket 0: no product info available PccardctlStatus: Socket 0: no card ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.19.0-18-generic root=/dev/mapper/hostname-root ro quiet splash vt.handoff=7 SourcePackage: systemd UpgradeStatus: Upgraded to vivid on 2015-05-29 (8 days ago) dmi.bios.date: 02/21/2008 dmi.bios.vendor: LENOVO dmi.bios.version: 7SET25WW (1.11 ) dmi.board.name: 7762K3U dmi.board.vendor: LENOVO dmi.board.version: Not Available dmi.chassis.asset.tag: No Asset Information dmi.chassis.type: 10 dmi.chassis.vendor: LENOVO dmi.chassis.version: Not Available dmi.modalias: dmi:bvnLENOVO:bvr7SET25WW(1.11):bd02/21/2008:svnLENOVO:pn7762K3U:pvrThinkPadX61Tablet:rvnLENOVO:rn7762K3U:rvrNotAvailable:cvnLENOVO:ct10:cvrNotAvailable: dmi.product.name: 7762K3U dmi.product.version: ThinkPad X61 Tablet dmi.sys.vendor: LENOVO To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/systemd/+bug/1462692/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1462692] [NEW] Ordering cycle on NetworkManager-wait-online.service/start
Public bug reported: I recently rebooted my computer, and NetworkManager didn't come online. Snooping dmesg revealed the problem: [ 16.371556] systemd[1]: Breaking ordering cycle by deleting job network.target/start [ 16.371561] systemd[1]: Job network.target/start deleted to break ordering cycle starting with network-online.target/start [ 16.371722] systemd[1]: Found ordering cycle on NetworkManager-wait-online.service/start [ 16.371727] systemd[1]: Found dependency on NetworkManager.service/start [ 16.371732] systemd[1]: Found dependency on basic.target/start [ 16.371736] systemd[1]: Found dependency on sockets.target/start [ 16.371739] systemd[1]: Found dependency on cups.socket/start [ 16.371743] systemd[1]: Found dependency on sysinit.target/start [ 16.371747] systemd[1]: Found dependency on screen-cleanup.service/start [ 16.371751] systemd[1]: Found dependency on remote-fs.target/start [ 16.371754] systemd[1]: Found dependency on openafs-client.service/start [ 16.371758] systemd[1]: Found dependency on network-online.target/start [ 16.371762] systemd[1]: Found dependency on NetworkManager-wait-online.service/start [ 16.371766] systemd[1]: Breaking ordering cycle by deleting job NetworkManager.service/start [ 16.371771] systemd[1]: Job NetworkManager.service/start deleted to break ordering cycle starting with NetworkManager-wait-online.service/start Manually running `sudo systemctl start NetworkManager` brought it back online. But there shouldn't be an ordering cycle! The problem seems to be that sockets wants cups, and then through a hilarious chain of events we hit openafs-client which obviously needs network. So for some reason, wants constraints are being honored too strictly. ProblemType: Bug DistroRelease: Ubuntu 15.04 Package: systemd 219-7ubuntu5 ProcVersionSignature: Ubuntu 3.19.0-18.18-generic 3.19.6 Uname: Linux 3.19.0-18-generic x86_64 NonfreeKernelModules: openafs ApportVersion: 2.17.2-0ubuntu1.1 Architecture: amd64 Date: Sat Jun 6 15:49:54 2015 EcryptfsInUse: Yes InstallationDate: Installed on 2013-11-21 (562 days ago) InstallationMedia: Ubuntu 13.10 "Saucy Salamander" - Release amd64 (20131016.1) MachineType: LENOVO 7762K3U PccardctlIdent: Socket 0: no product info available PccardctlStatus: Socket 0: no card ProcKernelCmdLine: BOOT_IMAGE=/vmlinuz-3.19.0-18-generic root=/dev/mapper/hostname-root ro quiet splash vt.handoff=7 SourcePackage: systemd UpgradeStatus: Upgraded to vivid on 2015-05-29 (8 days ago) dmi.bios.date: 02/21/2008 dmi.bios.vendor: LENOVO dmi.bios.version: 7SET25WW (1.11 ) dmi.board.name: 7762K3U dmi.board.vendor: LENOVO dmi.board.version: Not Available dmi.chassis.asset.tag: No Asset Information dmi.chassis.type: 10 dmi.chassis.vendor: LENOVO dmi.chassis.version: Not Available dmi.modalias: dmi:bvnLENOVO:bvr7SET25WW(1.11):bd02/21/2008:svnLENOVO:pn7762K3U:pvrThinkPadX61Tablet:rvnLENOVO:rn7762K3U:rvrNotAvailable:cvnLENOVO:ct10:cvrNotAvailable: dmi.product.name: 7762K3U dmi.product.version: ThinkPad X61 Tablet dmi.sys.vendor: LENOVO ** Affects: systemd (Ubuntu) Importance: Undecided Status: New ** Tags: amd64 apport-bug vivid -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to systemd in Ubuntu. https://bugs.launchpad.net/bugs/1462692 Title: Ordering cycle on NetworkManager-wait-online.service/start Status in systemd package in Ubuntu: New Bug description: I recently rebooted my computer, and NetworkManager didn't come online. Snooping dmesg revealed the problem: [ 16.371556] systemd[1]: Breaking ordering cycle by deleting job network.target/start [ 16.371561] systemd[1]: Job network.target/start deleted to break ordering cycle starting with network-online.target/start [ 16.371722] systemd[1]: Found ordering cycle on NetworkManager-wait-online.service/start [ 16.371727] systemd[1]: Found dependency on NetworkManager.service/start [ 16.371732] systemd[1]: Found dependency on basic.target/start [ 16.371736] systemd[1]: Found dependency on sockets.target/start [ 16.371739] systemd[1]: Found dependency on cups.socket/start [ 16.371743] systemd[1]: Found dependency on sysinit.target/start [ 16.371747] systemd[1]: Found dependency on screen-cleanup.service/start [ 16.371751] systemd[1]: Found dependency on remote-fs.target/start [ 16.371754] systemd[1]: Found dependency on openafs-client.service/start [ 16.371758] systemd[1]: Found dependency on network-online.target/start [ 16.371762] systemd[1]: Found dependency on NetworkManager-wait-online.service/start [ 16.371766] systemd[1]: Breaking ordering cycle by deleting job NetworkManager.service/start [ 16.371771] systemd[1]: Job NetworkManager.service/start deleted to break ordering cycle starting with NetworkManager-wait-online.service/start Manually running `sudo systemctl start NetworkManager` brought it back
[Touch-packages] [Bug 1413428] Re: apt-get's HTTP pipeline desynchronizes, hilarity ensues
https://lists.debian.org/deity/2014/11/msg00038.html http://anonscm.debian.org/cgit/apt/apt.git/commit/?id=92e8c1f -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1413428 Title: apt-get's HTTP pipeline desynchronizes, hilarity ensues Status in apt package in Ubuntu: New Bug description: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt- get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll probably do it anyway.) ProblemType: Bug DistroRelease: Ubuntu 14.10 Package: apt 1.0.9.2ubuntu2 ProcVersionSignature: Ubuntu 3.1
[Touch-packages] [Bug 1413428] Re: apt-get's HTTP pipeline desynchronizes, hilarity ensues
Oh, apparently you have to set the timestamp on the files sometime before 29 Dec 2014 too, because nginx doesn't spazz unless the if-range is also sent. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1413428 Title: apt-get's HTTP pipeline desynchronizes, hilarity ensues Status in apt package in Ubuntu: New Bug description: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt- get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll probably do it anyway.) ProblemType: Bug DistroRelease: Ubuntu 14.10 Package: apt 1.0.9.2ubuntu
[Touch-packages] [Bug 1413428] Re: apt-get's HTTP pipeline desynchronizes, hilarity ensues
** Attachment added: "apt-get update -o Debug::Acquire::http=true log" https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1413428/+attachment/4303390/+files/log2 -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1413428 Title: apt-get's HTTP pipeline desynchronizes, hilarity ensues Status in apt package in Ubuntu: New Bug description: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt- get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll probably do it anyway.) ProblemType: Bug DistroRelease: Ubuntu 14.10 Package: apt
[Touch-packages] [Bug 1413428] Re: apt-get's HTTP pipeline desynchronizes, hilarity ensues
** Attachment added: "linux.dropbox.com_ubuntu_dists_utopic_main_i18n_Translation-en%5fUS.gz" https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1413428/+attachment/4303389/+files/linux.dropbox.com_ubuntu_dists_utopic_main_i18n_Translation-en%255fUS.gz -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1413428 Title: apt-get's HTTP pipeline desynchronizes, hilarity ensues Status in apt package in Ubuntu: New Bug description: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt- get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll
[Touch-packages] [Bug 1413428] Re: apt-get's HTTP pipeline desynchronizes, hilarity ensues
** Attachment added: "linux.dropbox.com_ubuntu_dists_utopic_main_binary-i386_Packages.bz2" https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1413428/+attachment/4303387/+files/linux.dropbox.com_ubuntu_dists_utopic_main_binary-i386_Packages.bz2 -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1413428 Title: apt-get's HTTP pipeline desynchronizes, hilarity ensues Status in apt package in Ubuntu: New Bug description: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt- get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll probabl
[Touch-packages] [Bug 1413428] Re: apt-get's HTTP pipeline desynchronizes, hilarity ensues
** Attachment added: "linux.dropbox.com_ubuntu_dists_utopic_main_binary-i386_Packages.gz" https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1413428/+attachment/4303388/+files/linux.dropbox.com_ubuntu_dists_utopic_main_binary-i386_Packages.gz -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1413428 Title: apt-get's HTTP pipeline desynchronizes, hilarity ensues Status in apt package in Ubuntu: New Bug description: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt- get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll probably
[Touch-packages] [Bug 1413428] [NEW] apt-get's HTTP pipeline desynchronizes, hilarity ensues
Public bug reported: tl;dr: apt-get improperly handles servers which respond 404 with HTTP content to a Range query, resulting in a desychronized HTTP buffer and hilarious bugs. OK, this is going to be a long one. Where to begin? I was updating my Aptitude packages and noticed that my Dropbox source was not updating correctly: Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Silly Dropbox, not checking their package list! I report it to them, and they report back that the URL being fetched seems to be giving back a well formed HTTP response, and that they couldn't reproduce. I verify that is the case. We ponder the problem for a while, clearing caches and permuting the source.list line, and finally someone suggests running -o Debug::Acquire::http=true. I take the log and scroll to the error line: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/i18n/Translation-en_US.lzma Package: dropbox Priority: optional Section: gnome Installed-Size: 404 Maintainer: Rian Hunter Architecture: amd64 Version: 2.10.0 Replaces: nautilus-dropbox Provides: nautilus-dropbox Depends: procps, python-gtk2 (>= 2.12), python (>= 2.5), libatk1.0-0 (>= 1.20.0), libc6 (>= 2.4), libcairo2 (>= 1.6.0), libglib2.0-0 (>= 2.16.0), libgtk2.0-0 (>= 2.12.0), libpango1.0-0 (>= 1.20.1) Suggests: nautilus (>= 2.16.0), python-gpgme (>= 0.1) Breaks: nautilus-dropbox Filename: pool/main/dropbox_2.10.0_amd64.deb Size: 94296 MD5sum: 39d2f6558a35defbb4e3346c66651da9 SHA1: f68b9e102b96a72f37e79f74ac7030cd881db284 SHA256: 5ddf820c1f2e2b12c7824f9691d09f204c33ec7073736891544b774f7e0a0812 Description: cloud synchronization engine - CLI and Nautilus extension Dropbox is a free service that lets you bring your photos, docs, and videos anywhere and share them easily. . This package provides a command-line tool and a Nautilus extension that integrates the Dropbox web service with your GNOME Desktop. Homepage: https://www.dropbox.com/ Err http://linux.dropbox.com utopic/main amd64 Packages Bad header line Well. That *sort* of looks reasonable. But I looked around at some of the other responses in the log, and I realized, "Oh shit, these should be HTTP headers!" Answer for: http://debian.stanford.edu/ubuntu/dists/utopic/InRelease HTTP/1.1 404 Not Found Date: Wed, 21 Jan 2015 22:54:17 GMT Server: Apache Vary: Accept-Encoding Content-Length: 227 Content-Type: text/html; charset=iso-8859-1 So, why, then, does Apt think that the content is the HTTP headers? I was reminded of an old bug I encountered in MediaWiki: https://issues.apache.org/bugzilla/show_bug.cgi?id=40953 https://bugzilla.mozilla.org/show_bug.cgi?id=363109#c12 https://phabricator.wikimedia.org/T19537 Checking the source, it does seem apt pipelines requests by default, so if it desynchronized in its processing of the HTTP stream, that would be bad news. Seeking back in the log, we see this: Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-amd64/Packages.bz2 HTTP/1.1 404 Not Found Server: nginx Date: Wed, 21 Jan 2015 22:54:17 GMT Content-Type: text/html Content-Length: 162 Connection: keep-alive Content-Range: bytes */1142 GET /ubuntu/dists/utopic/main/binary-i386/Packages.bz2 HTTP/1.1 Host: linux.dropbox.com Cache-Control: max-age=0 Range: bytes=2635- If-Range: Mon, 29 Dec 2014 22:30:54 GMT User-Agent: Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) Answer for: http://linux.dropbox.com/ubuntu/dists/utopic/main/binary-i386/Packages.bz2 404 Not Found 404 Not Found nginx Bingo. By the way, you won't be able to reproduce the error unless you can induce apt-get to send the If-Range/Range header to the server. apt-get only sends the header if it has some cached partial lists (which, BY THE WAY, are not cleared when you clear your apt cache, WHY?!) I'll attach some files which you can put in /var/lib/apt/lists/partial which, along with adding deb [arch=amd64,i386] http://linux.dropbox.com/ubuntu utopic main to your sources list, should cause you to be able to reproduce the error. For what it's worth, I also think the server is also partially to blame; I'm not sure but 404 doesn't seem like the right code to return here. I'll also attach full HTTP cache logs. Can forward to upstream on request. (In fact, I'll probably do it anyway.) ProblemType: Bug DistroRelease: Ubuntu 14.10 Package: apt 1.0.9.2ubuntu2 ProcVersionSignature: Ubuntu 3.16.0-28.38-generic 3.16.7-ckt1 Uname: Linux 3.16.0-28-generic x86_64 NonfreeKernelModules: openafs ApportVersion: 2.14.7-0ubuntu8.1 Architecture: amd64 Date: Wed Jan 21 15:27:02 2015 EcryptfsInUse: Yes InstallationDate: Installed on 2013-11-21 (426 days ago) InstallationMedia: Ubuntu 13.10 "Saucy Salamander" - Release amd64 (20131016.1) SourcePackage: apt UpgradeStatus: Upgraded to utopic on 2014-12-04 (48 days ago) ** Affects: apt (Ubuntu) Importance: Undecided Status: New ** Tags: amd64 apport-bug third-party-packages utopic ** Attachment added: "linux.dropbox.com_ubuntu_dist
