[Desktop-packages] [Bug 1579712] Re: Refresh hangs indefinitely, appstreamcli using 100% CPU

2016-12-29 Thread vigilian
answers here since nobody have mentioned the 0.10 version.
http://askubuntu.com/questions/854168/how-i-can-fix-appstream-cache-
update-completed-but-some-metadata-was-ignored-d

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to appstream in Ubuntu.
https://bugs.launchpad.net/bugs/1579712

Title:
  Refresh hangs indefinitely, appstreamcli using 100% CPU

Status in appstream package in Ubuntu:
  Fix Released
Status in appstream source package in Xenial:
  Fix Released

Bug description:
  [Impact]

   * The cache refresh is blocked on a strdup on a non-NULL-terminated string 
in some very rare occasions (very rare because this bug is present for almost 
3y without a single report).
   * Fixing this bug resolves the issue for people who might experience it.
   * See https://github.com/ximion/appstream/issues/35 for details.

  [Test Case 1]

   * Run `sudo appstreamcli refresh --force`
   * The AppStream cache should be updated, no change in behavior should be 
seen.

  [Test Case 2]

   * In case you were experiencing the almost-infinite hang when running
  `sudo appstreamcli refresh --force`, this issue should be fixed with
  the SRU.

  [Regression Potential]

   * Very low, since this only fixes the decompression code. There
  should be no sideeffects of that (given that the patch itself doesn't
  break anything, which it shouldn't, since it has been tested upstream
  for a while)

  [Other Info]

   * This fix has been applied upstream: 
https://github.com/ximion/appstream/commit/f33c520c37e2ba51d92402220250b8d501a2bf43
   * A smaller version of the patch (one-liner) is available, at the expense of 
not having reduced memory usage: 
https://github.com/ximion/appstream/commit/378941787d3584b3eb31a6ebe40e0aacc10e180a

  

  /!\ Installing the bugfix from xenial-proposed, without going through APT:
  To install the fixed packages manually, please execute the following commands 
(for amd64, adjust URLs for other architectures):

  ```
  cd /tmp && mkdir asfix
  cd asfix
  wget 
https://launchpad.net/ubuntu/+archive/primary/+files/appstream_0.9.4-1ubuntu1_amd64.deb
  wget 
https://launchpad.net/ubuntu/+archive/primary/+files/libappstream3_0.9.4-1ubuntu1_amd64.deb
  sudo dpkg -i libappstream3*.deb
  sudo dpkg -i appstream*.deb
  ```

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/appstream/+bug/1579712/+subscriptions

-- 
Mailing list: https://launchpad.net/~desktop-packages
Post to : desktop-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~desktop-packages
More help   : https://help.launchpad.net/ListHelp


[Desktop-packages] [Bug 1579712] Re: Refresh hangs indefinitely, appstreamcli using 100% CPU

2016-12-18 Thread vigilian
vigilian@docker:/tmp/asfix$ sudo dpkg -i *.deb
(Lecture de la base de données... 234098 fichiers et répertoires déjà 
installés.)
Préparation du dépaquetage de appstream_0.9.4-1ubuntu1_amd64.deb ...
Dépaquetage de appstream (0.9.4-1ubuntu1) sur (0.9.4-1ubuntu1) ...
Préparation du dépaquetage de libappstream3_0.9.4-1ubuntu1_amd64.deb ...
Dépaquetage de libappstream3:amd64 (0.9.4-1ubuntu1) sur (0.9.4-1ubuntu1) ...
Paramétrage de libappstream3:amd64 (0.9.4-1ubuntu1) ...
Paramétrage de appstream (0.9.4-1ubuntu1) ...
AppStream cache update completed, but some metadata was ignored due to errors.
Traitement des actions différées (« triggers ») pour man-db (2.7.5-1) ...
Traitement des actions différées (« triggers ») pour libc-bin (2.23-0ubuntu5) 
...
vigilian@docker:/tmp/asfix$ sudo appstreamcli refresh --force
AppStream cache update completed, but some metadata was ignored due to errors.

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to appstream in Ubuntu.
https://bugs.launchpad.net/bugs/1579712

Title:
  Refresh hangs indefinitely, appstreamcli using 100% CPU

Status in appstream package in Ubuntu:
  Fix Released
Status in appstream source package in Xenial:
  Fix Released

Bug description:
  [Impact]

   * The cache refresh is blocked on a strdup on a non-NULL-terminated string 
in some very rare occasions (very rare because this bug is present for almost 
3y without a single report).
   * Fixing this bug resolves the issue for people who might experience it.
   * See https://github.com/ximion/appstream/issues/35 for details.

  [Test Case 1]

   * Run `sudo appstreamcli refresh --force`
   * The AppStream cache should be updated, no change in behavior should be 
seen.

  [Test Case 2]

   * In case you were experiencing the almost-infinite hang when running
  `sudo appstreamcli refresh --force`, this issue should be fixed with
  the SRU.

  [Regression Potential]

   * Very low, since this only fixes the decompression code. There
  should be no sideeffects of that (given that the patch itself doesn't
  break anything, which it shouldn't, since it has been tested upstream
  for a while)

  [Other Info]

   * This fix has been applied upstream: 
https://github.com/ximion/appstream/commit/f33c520c37e2ba51d92402220250b8d501a2bf43
   * A smaller version of the patch (one-liner) is available, at the expense of 
not having reduced memory usage: 
https://github.com/ximion/appstream/commit/378941787d3584b3eb31a6ebe40e0aacc10e180a

  

  /!\ Installing the bugfix from xenial-proposed, without going through APT:
  To install the fixed packages manually, please execute the following commands 
(for amd64, adjust URLs for other architectures):

  ```
  cd /tmp && mkdir asfix
  cd asfix
  wget 
https://launchpad.net/ubuntu/+archive/primary/+files/appstream_0.9.4-1ubuntu1_amd64.deb
  wget 
https://launchpad.net/ubuntu/+archive/primary/+files/libappstream3_0.9.4-1ubuntu1_amd64.deb
  sudo dpkg -i libappstream3*.deb
  sudo dpkg -i appstream*.deb
  ```

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/appstream/+bug/1579712/+subscriptions

-- 
Mailing list: https://launchpad.net/~desktop-packages
Post to : desktop-packages@lists.launchpad.net
Unsubscribe : https://launchpad.net/~desktop-packages
More help   : https://help.launchpad.net/ListHelp


[Desktop-packages] [Bug 1579712] Re: Refresh hangs indefinitely, appstreamcli using 100% CPU

2016-12-18 Thread vigilian
even with the fix on my production server I still have some problems. :

@docker:~$ sudo apt update
[sudo] Mot de passe de vigilian : 
Atteint:1 http://ppa.launchpad.net/x2go/stable/ubuntu xenial InRelease
Atteint:2 http://be.archive.ubuntu.com/ubuntu xenial InRelease  
 
Réception de:3 http://be.archive.ubuntu.com/ubuntu xenial-updates InRelease 
[102 kB] 
Atteint:4 http://download.virtualbox.org/virtualbox/debian xenial InRelease 
  
Réception de:5 http://be.archive.ubuntu.com/ubuntu xenial-backports InRelease 
[102 kB]
Atteint:6 https://apt.dockerproject.org/repo ubuntu-xenial InRelease
  
Réception de:7 http://be.archive.ubuntu.com/ubuntu xenial-updates/main amd64 
Packages [441 kB]   
Réception de:8 http://be.archive.ubuntu.com/ubuntu xenial-updates/main i386 
Packages [433 kB]   
Réception de:9 http://be.archive.ubuntu.com/ubuntu xenial-updates/main amd64 
DEP-11 Metadata [303 kB]   
Réception de:10 http://be.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 
64x64 Icons [186 kB]  
Réception de:11 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe 
amd64 DEP-11 Metadata [121 kB]   
Réception de:12 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe 
DEP-11 64x64 Icons [145 kB]   
Réception de:13 http://be.archive.ubuntu.com/ubuntu xenial-updates/multiverse 
amd64 DEP-11 Metadata [2.516 B]
Réception de:14 http://be.archive.ubuntu.com/ubuntu xenial-backports/main amd64 
DEP-11 Metadata [208 B]
Réception de:15 http://be.archive.ubuntu.com/ubuntu xenial-backports/universe 
amd64 DEP-11 Metadata [212 B]
Réception de:16 http://be.archive.ubuntu.com/ubuntu xenial-backports/multiverse 
amd64 DEP-11 Metadata [212 B]
Réception de:17 https://download.01.org/gfx/ubuntu/16.04/main xenial InRelease 
[3.651 B]   
Réception de:18 http://security.ubuntu.com/ubuntu xenial-security InRelease 
[102 kB]   
Réception de:19 http://security.ubuntu.com/ubuntu xenial-security/main amd64 
DEP-11 Metadata [68,2 kB]
Réception de:20 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 
64x64 Icons [48,0 kB]
Réception de:21 http://security.ubuntu.com/ubuntu xenial-security/universe 
amd64 DEP-11 Metadata [19,4 kB]
Réception de:22 http://security.ubuntu.com/ubuntu xenial-security/universe 
DEP-11 64x64 Icons [25,6 kB]
Réception de:23 http://security.ubuntu.com/ubuntu xenial-security/multiverse 
amd64 DEP-11 Metadata [212 B]
2.103 ko réceptionnés en 5s (392 ko/s)
AppStream cache update completed, but some metadata was ignored due to errors.
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances   
Lecture des informations d'état... Fait
All packages are up to date.
W: https://download.01.org/gfx/ubuntu/16.04/main/dists/xenial/InRelease: 
Signature by key 09D6EF97BFB38E916EF060E756A3DEF863961D39 uses weak digest 
algorithm (SHA1)
vigilian@docker:~$ sudo apt dist-upgrade
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances   
Lecture des informations d'état... Fait
Calcul de la mise à jour... Fait
0 mis à jour, 0 nouvellement installés, 0 à enlever et 0 non mis à jour.
@docker:~$ sudo apt update
Atteint:1 http://ppa.launchpad.net/x2go/stable/ubuntu xenial InRelease
Atteint:2 http://download.virtualbox.org/virtualbox/debian xenial InRelease 

   
Atteint:3 http://be.archive.ubuntu.com/ubuntu xenial InRelease  

   
Atteint:4 http://be.archive.ubuntu.com/ubuntu xenial-updates InRelease  
  
Atteint:5 http://be.archive.ubuntu.com/ubuntu xenial-backports InRelease
  
Atteint:6 https://apt.dockerproject.org/repo ubuntu-xenial InRelease
  
Réception de:7 https://download.01.org/gfx/ubuntu/16.04/main xenial InRelease 
[3.651 B]
Atteint:8 http://security.ubuntu.com/ubuntu xenial-security InRelease
3.651 o réceptionnés en 0s (4.899 o/s) 
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances   
Lecture des informations d'état... Fait
All packages are up to date.
W: https://download.01.org/gfx/ubuntu/16.04/main/dists/xenial/InRelease: 
Signature by key 09D6EF97BFB38E916EF060E756A3DEF863961D39 uses weak digest 
algorithm (SHA1)

as you see I still have this bug but not all the time. I've already

Re: [Desktop-packages] [Bug 1575248] Re: "AppStream cache update completed, but some metadata was ignored due to errors." on "sudo apt-get update"

2016-11-28 Thread vigilian
Ok. Does that joepardize the instalaltion or not?

-Message d'origine-
De : boun...@canonical.com [mailto:boun...@canonical.com] De la part de Krino 
Hoogestraat
Envoyé : lundi 28 novembre 2016 19:27
À : c_cromph...@hotmail.com
Objet : [Bug 1575248] Re: "AppStream cache update completed, but some metadata 
was ignored due to errors." on "sudo apt-get update"

Bug still persists after update: 20161128 18:00 GMT.

--
You received this bug notification because you are subscribed to the bug report.
https://bugs.launchpad.net/bugs/1575248

Title:
  "AppStream cache update completed, but some metadata was ignored due
  to errors." on "sudo apt-get update"

To manage notifications about this bug go to:
https://bugs.launchpad.net/appstream/+bug/1575248/+subscriptions

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to appstream in Ubuntu.
https://bugs.launchpad.net/bugs/1575248

Title:
  "AppStream cache update completed, but some metadata was ignored due
  to errors." on "sudo apt-get update"

Status in AppStream:
  Invalid
Status in Ubuntu GNOME:
  Invalid
Status in appstream package in Ubuntu:
  Invalid
Status in fwupd package in Ubuntu:
  Fix Released
Status in fwupd source package in Xenial:
  Fix Released
Status in fwupd package in Debian:
  Fix Released

Bug description:
  [Impact]

   * Checks for apt updates using apt or apt-get also update the
  appstream cache.  Some of the appstream metadata installed locally
  isn't strictly valid as it's missing two fields.

  [Test Case]

   * fwupdmgr refresh
   * apt update
   * check for errors about metadata being ignored

  [Regression Potential]

   * This is just changing the XML metadata locally, I don't see any
  regression potential.

  [Other Info]
   
   * This fix has been applied upstream: 
https://github.com/hughsie/fwupd/commit/f4e0e88f7cba833a4badc1a3d62f1a08dd1bfd96

  [Original report]

  I have found that when there are new packages available which my
  machine doesn't know about yet, if I run "sudo apt-get update" this is
  the output:

  Get:1 http://gb.archive.ubuntu.com/ubuntu xenial InRelease [247 kB]
  Hit:2 http://security.ubuntu.com/ubuntu xenial-security InRelease
  Get:3 http://gb.archive.ubuntu.com/ubuntu xenial-updates InRelease [82.2 
kB]
  Get:4 http://security.ubuntu.com/ubuntu xenial-security/main i386 
Packages [28 B]
  Get:5 http://gb.archive.ubuntu.com/ubuntu xenial-backports InRelease 
[82.2 kB]
  Get:6 http://security.ubuntu.com/ubuntu xenial-security/restricted i386 
Packages [28 B]
  Get:7 http://security.ubuntu.com/ubuntu xenial-security/universe i386 
Packages [28 B]
  Get:8 http://security.ubuntu.com/ubuntu xenial-security/multiverse amd64 
Packages [28 B]
  Get:9 http://security.ubuntu.com/ubuntu xenial-security/multiverse i386 
Packages [28 B]
  Get:10 http://security.ubuntu.com/ubuntu xenial-security/multiverse 
Translation-en [28 B]
  Get:11 http://gb.archive.ubuntu.com/ubuntu xenial/main amd64 Packages 
[1,201 kB]
  Get:12 http://gb.archive.ubuntu.com/ubuntu xenial/main i386 Packages 
[1,196 kB]
  Get:13 http://gb.archive.ubuntu.com/ubuntu xenial/main Translation-en_GB 
[426 kB]
  Get:14 http://gb.archive.ubuntu.com/ubuntu xenial/main Translation-en 
[568 kB]
  Get:15 http://gb.archive.ubuntu.com/ubuntu xenial/main amd64 DEP-11 
Metadata [733 kB]
  Get:16 http://gb.archive.ubuntu.com/ubuntu xenial/main DEP-11 64x64 Icons 
[409 kB]
  Get:17 http://gb.archive.ubuntu.com/ubuntu xenial/restricted amd64 
Packages [8,344 B]
  Get:18 http://gb.archive.ubuntu.com/ubuntu xenial/restricted i386 
Packages [8,684 B]
  Get:19 http://gb.archive.ubuntu.com/ubuntu xenial/restricted 
Translation-en_GB [2,556 B]
  Get:20 http://gb.archive.ubuntu.com/ubuntu xenial/restricted 
Translation-en [2,908 B]
  Get:21 http://gb.archive.ubuntu.com/ubuntu xenial/restricted amd64 DEP-11 
Metadata [186 B]
  Get:22 http://gb.archive.ubuntu.com/ubuntu xenial/universe amd64 Packages 
[7,532 kB]
  Get:23 http://gb.archive.ubuntu.com/ubuntu xenial/universe i386 Packages 
[7,512 kB]
  Get:24 http://gb.archive.ubuntu.com/ubuntu xenial/universe 
Translation-en_GB [3,040 kB]
  Get:25 http://gb.archive.ubuntu.com/ubuntu xenial/universe Translation-en 
[4,354 kB]
  Get:26 http://gb.archive.ubuntu.com/ubuntu xenial/universe amd64 DEP-11 
Metadata [3,410 kB]
  Get:27 http://gb.archive.ubuntu.com/ubuntu xenial/universe DEP-11 64x64 
Icons [7,448 kB]
  Get:28 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse amd64 
Packages [144 kB]
  Get:29 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse i386 
Packages [140 kB]
  Get:30 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse 
Translation-en_GB [88.1 kB]
  Get:31 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse 
Translation-en [106 kB]
  Get:32 http://gb.archive.ubuntu.com/ubuntu xenial/multiverse amd64 

[Desktop-packages] [Bug 1644498] Re: apt-get update returns "AppStream cache update completed, but some metadata was ignored due to errors." periodically

2016-11-26 Thread vigilian
I don't have any mail monitoring 
Atteint:1 http://ppa.launchpad.net/x2go/stable/ubuntu xenial InRelease
Atteint:2 http://be.archive.ubuntu.com/ubuntu xenial InRelease  

Réception de:3 http://security.ubuntu.com/ubuntu xenial-security InRelease [102 
kB] 
Atteint:4 http://download.virtualbox.org/virtualbox/debian xenial InRelease 
  
Réception de:5 http://be.archive.ubuntu.com/ubuntu xenial-updates InRelease 
[102 kB]  
Réception de:6 http://be.archive.ubuntu.com/ubuntu xenial-backports InRelease 
[102 kB]  
Atteint:7 https://apt.dockerproject.org/repo ubuntu-xenial InRelease
Réception de:8 http://security.ubuntu.com/ubuntu xenial-security/main amd64 
DEP-11 Metadata [66,9 kB]
Réception de:9 http://security.ubuntu.com/ubuntu xenial-security/main DEP-11 
64x64 Icons [43,3 kB]
Réception de:10 http://security.ubuntu.com/ubuntu xenial-security/universe 
amd64 DEP-11 Metadata [19,4 kB]
Réception de:11 http://security.ubuntu.com/ubuntu xenial-security/universe 
DEP-11 64x64 Icons [25,6 kB]
Réception de:12 http://security.ubuntu.com/ubuntu xenial-security/multiverse 
amd64 DEP-11 Metadata [212 B]   
Réception de:13 http://be.archive.ubuntu.com/ubuntu xenial-updates/main amd64 
DEP-11 Metadata [293 kB]
Réception de:14 http://be.archive.ubuntu.com/ubuntu xenial-updates/main DEP-11 
64x64 Icons [182 kB]
Réception de:15 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe 
amd64 DEP-11 Metadata [119 kB]
Réception de:16 http://be.archive.ubuntu.com/ubuntu xenial-updates/universe 
DEP-11 64x64 Icons [137 kB]
Réception de:17 http://be.archive.ubuntu.com/ubuntu xenial-updates/multiverse 
amd64 DEP-11 Metadata [2.520 B]
Réception de:18 http://be.archive.ubuntu.com/ubuntu xenial-backports/main amd64 
DEP-11 Metadata [208 B]
Réception de:19 http://be.archive.ubuntu.com/ubuntu xenial-backports/universe 
amd64 DEP-11 Metadata [212 B]
Réception de:20 http://be.archive.ubuntu.com/ubuntu xenial-backports/multiverse 
amd64 DEP-11 Metadata [212 B]
Réception de:21 https://download.01.org/gfx/ubuntu/16.04/main xenial InRelease 
[3.651 B]   
1.200 ko réceptionnés en 0s (1.221 ko/s)
AppStream cache update completed, but some metadata was ignored due to errors.
Lecture des listes de paquets... Fait
W: https://download.01.org/gfx/ubuntu/16.04/main/dists/xenial/InRelease: 
Signature by key 09D6EF97BFB38E916EF060E756A3DEF863961D39 uses weak digest 
algorithm (SHA1)


So I don't know your patch is already deployed but seems not

-- 
You received this bug notification because you are a member of Desktop
Packages, which is subscribed to appstream in Ubuntu.
https://bugs.launchpad.net/bugs/1644498

Title:
  apt-get update returns "AppStream cache update completed, but some
  metadata was ignored due to errors." periodically

Status in appstream package in Ubuntu:
  In Progress

Bug description:
  Periodically I get emails from a machine with the subject:

  Cron  if [ -x /etc/munin/plugins/apt_all ]; then
  /etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x
  /etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12
  >/dev/null; fi

  And a body of:

  AppStream cache update completed, but some metadata was ignored due to
  errors.

  
  I have a machine monitored by Munin.  One of the plugins used on that machine 
is /etc/munin/plugins/apt which periodically counts the number of packets that 
can be upgraded.  This is achieved by a crontab entry installed from the 
package which looks like this:

  #
  # cron-jobs for munin-node
  #

  MAILTO=root

  # If the APT plugin is enabled, update packages databases approx. once
  # an hour (12 invokations an hour, 1 in 12 chance that the update will
  # happen), but ensure that there will never be more than two hour (7200
  # seconds) interval between updates..
  */5 * * * * root if [ -x /etc/munin/plugins/apt_all ]; then 
/etc/munin/plugins/apt_all update 7200 12 >/dev/null; elif [ -x 
/etc/munin/plugins/apt ]; then /etc/munin/plugins/apt update 7200 12 
>/dev/null; fi

  
  For many months everything has been running smoothly.  On the 23rd November 
2016 I started getting the "AppStream cache update completed, but some metadata 
was ignored due to errors." messages at a rate of about ten a day.  

  
  I did a quick Google search which turned up a handful of bugs from earlier 
this year, such as 
  Bug1575248.  That is marked as Fixed Released though, so I am raising this 
new bug.

  If there are any further diagnostic details I can provide, please let
  me know.

  ProblemType: Bug
  DistroRelease: Ubuntu 16.04
  Package: appstream 0.9.4-1ubuntu1
  ProcVersionSignature: Ubuntu 4.4.0-47.68-generic 4.4.24
  Uname: Linux 4.4.0-47-generic x86_64
  ApportVersion: 2.20.1-0ubuntu2.1
  Architecture: amd64
  Date: Thu Nov 24 09:57:18 2016