[Desktop-packages] [Bug 1579712] Re: Refresh hangs indefinitely, appstreamcli using 100% CPU
answers here since nobody have mentioned the 0.10 version. http://askubuntu.com/questions/854168/how-i-can-fix-appstream-cache- update-completed-but-some-metadata-was-ignored-d -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to appstream in Ubuntu. https://bugs.launchpad.net/bugs/1579712 Title: Refresh hangs indefinitely, appstreamcli using 100% CPU Status in appstream package in Ubuntu: Fix Released Status in appstream source package in Xenial: Fix Released Bug description: [Impact] * The cache refresh is blocked on a strdup on a non-NULL-terminated string in some very rare occasions (very rare because this bug is present for almost 3y without a single report). * Fixing this bug resolves the issue for people who might experience it. * See https://github.com/ximion/appstream/issues/35 for details. [Test Case 1] * Run `sudo appstreamcli refresh --force` * The AppStream cache should be updated, no change in behavior should be seen. [Test Case 2] * In case you were experiencing the almost-infinite hang when running `sudo appstreamcli refresh --force`, this issue should be fixed with the SRU. [Regression Potential] * Very low, since this only fixes the decompression code. There should be no sideeffects of that (given that the patch itself doesn't break anything, which it shouldn't, since it has been tested upstream for a while) [Other Info] * This fix has been applied upstream: https://github.com/ximion/appstream/commit/f33c520c37e2ba51d92402220250b8d501a2bf43 * A smaller version of the patch (one-liner) is available, at the expense of not having reduced memory usage: https://github.com/ximion/appstream/commit/378941787d3584b3eb31a6ebe40e0aacc10e180a /!\ Installing the bugfix from xenial-proposed, without going through APT: To install the fixed packages manually, please execute the following commands (for amd64, adjust URLs for other architectures): ``` cd /tmp && mkdir asfix cd asfix wget https://launchpad.net/ubuntu/+archive/primary/+files/appstream_0.9.4-1ubuntu1_amd64.deb wget https://launchpad.net/ubuntu/+archive/primary/+files/libappstream3_0.9.4-1ubuntu1_amd64.deb sudo dpkg -i libappstream3*.deb sudo dpkg -i appstream*.deb ``` To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/appstream/+bug/1579712/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
[Desktop-packages] [Bug 1579712] Re: Refresh hangs indefinitely, appstreamcli using 100% CPU
vigilian@docker:/tmp/asfix$ sudo dpkg -i *.deb (Lecture de la base de données... 234098 fichiers et répertoires déjà installés.) Préparation du dépaquetage de appstream_0.9.4-1ubuntu1_amd64.deb ... Dépaquetage de appstream (0.9.4-1ubuntu1) sur (0.9.4-1ubuntu1) ... Préparation du dépaquetage de libappstream3_0.9.4-1ubuntu1_amd64.deb ... Dépaquetage de libappstream3:amd64 (0.9.4-1ubuntu1) sur (0.9.4-1ubuntu1) ... Paramétrage de libappstream3:amd64 (0.9.4-1ubuntu1) ... Paramétrage de appstream (0.9.4-1ubuntu1) ... AppStream cache update completed, but some metadata was ignored due to errors. Traitement des actions différées (« triggers ») pour man-db (2.7.5-1) ... Traitement des actions différées (« triggers ») pour libc-bin (2.23-0ubuntu5) ... vigilian@docker:/tmp/asfix$ sudo appstreamcli refresh --force AppStream cache update completed, but some metadata was ignored due to errors. -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to appstream in Ubuntu. https://bugs.launchpad.net/bugs/1579712 Title: Refresh hangs indefinitely, appstreamcli using 100% CPU Status in appstream package in Ubuntu: Fix Released Status in appstream source package in Xenial: Fix Released Bug description: [Impact] * The cache refresh is blocked on a strdup on a non-NULL-terminated string in some very rare occasions (very rare because this bug is present for almost 3y without a single report). * Fixing this bug resolves the issue for people who might experience it. * See https://github.com/ximion/appstream/issues/35 for details. [Test Case 1] * Run `sudo appstreamcli refresh --force` * The AppStream cache should be updated, no change in behavior should be seen. [Test Case 2] * In case you were experiencing the almost-infinite hang when running `sudo appstreamcli refresh --force`, this issue should be fixed with the SRU. [Regression Potential] * Very low, since this only fixes the decompression code. There should be no sideeffects of that (given that the patch itself doesn't break anything, which it shouldn't, since it has been tested upstream for a while) [Other Info] * This fix has been applied upstream: https://github.com/ximion/appstream/commit/f33c520c37e2ba51d92402220250b8d501a2bf43 * A smaller version of the patch (one-liner) is available, at the expense of not having reduced memory usage: https://github.com/ximion/appstream/commit/378941787d3584b3eb31a6ebe40e0aacc10e180a /!\ Installing the bugfix from xenial-proposed, without going through APT: To install the fixed packages manually, please execute the following commands (for amd64, adjust URLs for other architectures): ``` cd /tmp && mkdir asfix cd asfix wget https://launchpad.net/ubuntu/+archive/primary/+files/appstream_0.9.4-1ubuntu1_amd64.deb wget https://launchpad.net/ubuntu/+archive/primary/+files/libappstream3_0.9.4-1ubuntu1_amd64.deb sudo dpkg -i libappstream3*.deb sudo dpkg -i appstream*.deb ``` To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/appstream/+bug/1579712/+subscriptions -- Mailing list: https://launchpad.net/~desktop-packages Post to : desktop-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~desktop-packages More help : https://help.launchpad.net/ListHelp
[Desktop-packages] [Bug 1579712] Re: Refresh hangs indefinitely, appstreamcli using 100% CPU
even with the fix on my production server I still have some problems. : @docker:~$ sudo apt update [sudo] Mot de passe de vigilian : Atteint:1 http://ppa.launchpad.net/x2go/stable/ubuntu xenial InRelease Atteint:2 http://be.archive.ubuntu.com/ubuntu xenial InRelease Réception de:3 http://be.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Atteint:4 http://download.virtualbox.org/virtualbox/debian xenial InRelease Réception de:5 http://be.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Atteint:6 https://apt.dockerproject.org/repo ubuntu-xenial InRelease Réception de:7 http://be.archive.ubuntu.com/ubuntu xenial-updates/main amd64 Packages [441 kB] Réception de:8 http://be.archive.ubuntu.com/ubuntu xenial-updates/main i386 Packages [433 kB] Réception de:9 http://be.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metadata [303 kB] Réception de:10 http://be.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [186 kB] Réception de:11 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [121 kB] Réception de:12 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [145 kB] Réception de:13 http://be.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [2.516 B] Réception de:14 http://be.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [208 B] Réception de:15 http://be.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [212 B] Réception de:16 http://be.archive.ubuntu.com/ubuntu xenial-backports/multiverse amd64 DEP-11 Metadata [212 B] Réception de:17 https://download.01.org/gfx/ubuntu/16.04/main xenial InRelease [3.651 B] Réception de:18 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Réception de:19 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [68,2 kB] Réception de:20 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [48,0 kB] Réception de:21 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [19,4 kB] Réception de:22 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [25,6 kB] Réception de:23 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 DEP-11 Metadata [212 B] 2.103 ko réceptionnés en 5s (392 ko/s) AppStream cache update completed, but some metadata was ignored due to errors. Lecture des listes de paquets... Fait Construction de l'arbre des dépendances Lecture des informations d'état... Fait All packages are up to date. W: https://download.01.org/gfx/ubuntu/16.04/main/dists/xenial/InRelease: Signature by key 09D6EF97BFB38E916EF060E756A3DEF863961D39 uses weak digest algorithm (SHA1) vigilian@docker:~$ sudo apt dist-upgrade Lecture des listes de paquets... Fait Construction de l'arbre des dépendances Lecture des informations d'état... Fait Calcul de la mise à jour... Fait 0 mis à jour, 0 nouvellement installés, 0 à enlever et 0 non mis à jour. @docker:~$ sudo apt update Atteint:1 http://ppa.launchpad.net/x2go/stable/ubuntu xenial InRelease Atteint:2 http://download.virtualbox.org/virtualbox/debian xenial InRelease Atteint:3 http://be.archive.ubuntu.com/ubuntu xenial InRelease Atteint:4 http://be.archive.ubuntu.com/ubuntu xenial-updates InRelease Atteint:5 http://be.archive.ubuntu.com/ubuntu xenial-backports InRelease Atteint:6 https://apt.dockerproject.org/repo ubuntu-xenial InRelease Réception de:7 https://download.01.org/gfx/ubuntu/16.04/main xenial InRelease [3.651 B] Atteint:8 http://security.ubuntu.com/ubuntu xenial-security InRelease 3.651 o réceptionnés en 0s (4.899 o/s) Lecture des listes de paquets... Fait Construction de l'arbre des dépendances Lecture des informations d'état... Fait All packages are up to date. W: https://download.01.org/gfx/ubuntu/16.04/main/dists/xenial/InRelease: Signature by key 09D6EF97BFB38E916EF060E756A3DEF863961D39 uses weak digest algorithm (SHA1) as you see I still have this bug but not all the time. I've already
Re: [Desktop-packages] [Bug 1575248] Re: "AppStream cache update completed, but some metadata was ignored due to errors." on "sudo apt-get update"
Ok. Does that joepardize the instalaltion or not? -Message d'origine- De : boun...@canonical.com [mailto:boun...@canonical.com] De la part de Krino Hoogestraat Envoyé : lundi 28 novembre 2016 19:27 À : c_cromph...@hotmail.com Objet : [Bug 1575248] Re: "AppStream cache update completed, but some metadata was ignored due to errors." on "sudo apt-get update" Bug still persists after update: 20161128 18:00 GMT. -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1575248 Title: "AppStream cache update completed, but some metadata was ignored due to errors." on "sudo apt-get update" To manage notifications about this bug go to: https://bugs.launchpad.net/appstream/+bug/1575248/+subscriptions -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to appstream in Ubuntu. https://bugs.launchpad.net/bugs/1575248 Title: "AppStream cache update completed, but some metadata was ignored due to errors." on "sudo apt-get update" Status in AppStream: Invalid Status in Ubuntu GNOME: Invalid Status in appstream package in Ubuntu: Invalid Status in fwupd package in Ubuntu: Fix Released Status in fwupd source package in Xenial: Fix Released Status in fwupd package in Debian: Fix Released Bug description: [Impact] * Checks for apt updates using apt or apt-get also update the appstream cache. Some of the appstream metadata installed locally isn't strictly valid as it's missing two fields. [Test Case] * fwupdmgr refresh * apt update * check for errors about metadata being ignored [Regression Potential] * This is just changing the XML metadata locally, I don't see any regression potential. [Other Info] * This fix has been applied upstream: https://github.com/hughsie/fwupd/commit/f4e0e88f7cba833a4badc1a3d62f1a08dd1bfd96 [Original report] I have found that when there are new packages available which my machine doesn't know about yet, if I run "sudo apt-get update" this is the output: Get:1 http://gb.archive.ubuntu.com/ubuntu xenial InRelease [247 kB] Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease Get:3 http://gb.archive.ubuntu.com/ubuntu xenial-updates InRelease [82.2 kB] Get:4 http://security.ubuntu.com/ubuntu xenial-security/main i386 Packages [28 B] Get:5 http://gb.archive.ubuntu.com/ubuntu xenial-backports InRelease [82.2 kB] Get:6 http://security.ubuntu.com/ubuntu xenial-security/restricted i386 Packages [28 B] Get:7 http://security.ubuntu.com/ubuntu xenial-security/universe i386 Packages [28 B] Get:8 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 Packages [28 B] Get:9 http://security.ubuntu.com/ubuntu xenial-security/multiverse i386 Packages [28 B] Get:10 http://security.ubuntu.com/ubuntu xenial-security/multiverse Translation-en [28 B] Get:11 http://gb.archive.ubuntu.com/ubuntu xenial/main amd64 Packages [1,201 kB] Get:12 http://gb.archive.ubuntu.com/ubuntu xenial/main i386 Packages [1,196 kB] Get:13 http://gb.archive.ubuntu.com/ubuntu xenial/main Translation-en_GB [426 kB] Get:14 http://gb.archive.ubuntu.com/ubuntu xenial/main Translation-en [568 kB] Get:15 http://gb.archive.ubuntu.com/ubuntu xenial/main amd64 DEP-11 Metadata [733 kB] Get:16 http://gb.archive.ubuntu.com/ubuntu xenial/main DEP-11 64x64 Icons [409 kB] Get:17 http://gb.archive.ubuntu.com/ubuntu xenial/restricted amd64 Packages [8,344 B] Get:18 http://gb.archive.ubuntu.com/ubuntu xenial/restricted i386 Packages [8,684 B] Get:19 http://gb.archive.ubuntu.com/ubuntu xenial/restricted Translation-en_GB [2,556 B] Get:20 http://gb.archive.ubuntu.com/ubuntu xenial/restricted Translation-en [2,908 B] Get:21 http://gb.archive.ubuntu.com/ubuntu xenial/restricted amd64 DEP-11 Metadata [186 B] Get:22 http://gb.archive.ubuntu.com/ubuntu xenial/universe amd64 Packages [7,532 kB] Get:23 http://gb.archive.ubuntu.com/ubuntu xenial/universe i386 Packages [7,512 kB] Get:24 http://gb.archive.ubuntu.com/ubuntu xenial/universe Translation-en_GB [3,040 kB] Get:25 http://gb.archive.ubuntu.com/ubuntu xenial/universe Translation-en [4,354 kB] Get:26 http://gb.archive.ubuntu.com/ubuntu xenial/universe amd64 DEP-11 Metadata [3,410 kB] Get:27 http://gb.archive.ubuntu.com/ubuntu xenial/universe DEP-11 64x64 Icons [7,448 kB] Get:28 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse amd64 Packages [144 kB] Get:29 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse i386 Packages [140 kB] Get:30 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse Translation-en_GB [88.1 kB] Get:31 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse Translation-en [106 kB] Get:32 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse amd64
[Desktop-packages] [Bug 1644498] Re: apt-get update returns "AppStream cache update completed, but some metadata was ignored due to errors." periodically
I don't have any mail monitoring Atteint:1 http://ppa.launchpad.net/x2go/stable/ubuntu xenial InRelease Atteint:2 http://be.archive.ubuntu.com/ubuntu xenial InRelease Réception de:3 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 kB] Atteint:4 http://download.virtualbox.org/virtualbox/debian xenial InRelease Réception de:5 http://be.archive.ubuntu.com/ubuntu xenial-updates InRelease [102 kB] Réception de:6 http://be.archive.ubuntu.com/ubuntu xenial-backports InRelease [102 kB] Atteint:7 https://apt.dockerproject.org/repo ubuntu-xenial InRelease Réception de:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 DEP-11 Metadata [66,9 kB] Réception de:9 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 64x64 Icons [43,3 kB] Réception de:10 http://security.ubuntu.com/ubuntu xenial-security/universe amd64 DEP-11 Metadata [19,4 kB] Réception de:11 http://security.ubuntu.com/ubuntu xenial-security/universe DEP-11 64x64 Icons [25,6 kB] Réception de:12 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 DEP-11 Metadata [212 B] Réception de:13 http://be.archive.ubuntu.com/ubuntu xenial-updates/main amd64 DEP-11 Metadata [293 kB] Réception de:14 http://be.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 64x64 Icons [182 kB] Réception de:15 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe amd64 DEP-11 Metadata [119 kB] Réception de:16 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe DEP-11 64x64 Icons [137 kB] Réception de:17 http://be.archive.ubuntu.com/ubuntu xenial-updates/multiverse amd64 DEP-11 Metadata [2.520 B] Réception de:18 http://be.archive.ubuntu.com/ubuntu xenial-backports/main amd64 DEP-11 Metadata [208 B] Réception de:19 http://be.archive.ubuntu.com/ubuntu xenial-backports/universe amd64 DEP-11 Metadata [212 B] Réception de:20 http://be.archive.ubuntu.com/ubuntu xenial-backports/multiverse amd64 DEP-11 Metadata [212 B] Réception de:21 https://download.01.org/gfx/ubuntu/16.04/main xenial InRelease [3.651 B] 1.200 ko réceptionnés en 0s (1.221 ko/s) AppStream cache update completed, but some metadata was ignored due to errors. Lecture des listes de paquets... Fait W: https://download.01.org/gfx/ubuntu/16.04/main/dists/xenial/InRelease: Signature by key 09D6EF97BFB38E916EF060E756A3DEF863961D39 uses weak digest algorithm (SHA1) So I don't know your patch is already deployed but seems not -- You received this bug notification because you are a member of Desktop Packages, which is subscribed to appstream in Ubuntu. https://bugs.launchpad.net/bugs/1644498 Title: apt-get update returns "AppStream cache update completed, but some metadata was ignored due to errors." periodically Status in appstream package in Ubuntu: In Progress Bug description: Periodically I get emails from a machine with the subject: Cronif [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi And a body of: AppStream cache update completed, but some metadata was ignored due to errors. I have a machine monitored by Munin. One of the plugins used on that machine is /etc/munin/plugins/apt which periodically counts the number of packets that can be upgraded. This is achieved by a crontab entry installed from the package which looks like this: # # cron-jobs for munin-node # MAILTO=root # If the APT plugin is enabled, update packages databases approx. once # an hour (12 invokations an hour, 1 in 12 chance that the update will # happen), but ensure that there will never be more than two hour (7200 # seconds) interval between updates.. */5 * * * * root if [ -x /etc/munin/plugins/apt_all ]; then /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 >/dev/null; fi For many months everything has been running smoothly. On the 23rd November 2016 I started getting the "AppStream cache update completed, but some metadata was ignored due to errors." messages at a rate of about ten a day. I did a quick Google search which turned up a handful of bugs from earlier this year, such as Bug1575248. That is marked as Fixed Released though, so I am raising this new bug. If there are any further diagnostic details I can provide, please let me know. ProblemType: Bug DistroRelease: Ubuntu 16.04 Package: appstream 0.9.4-1ubuntu1 ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24 Uname: Linux 4.4.0-47-generic x86_64 ApportVersion: 2.20.1-0ubuntu2.1 Architecture: amd64 Date: Thu Nov 24 09:57:18 2016