[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Still in 2022 on fresh 18.04.5 updated to 18.04.6 Kubuntu 32-bit -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: Invalid Status in apt-xapian-index: Invalid Status in apt-xapian-index package in Ubuntu: Confirmed Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Nope, the problem has not been fixed. Still there with Kubuntu 18.10. ** Changed in: apt-xapian-index (Ubuntu) Status: Invalid => Confirmed -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: Invalid Status in apt-xapian-index: Invalid Status in apt-xapian-index package in Ubuntu: Confirmed Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Problem has been fixed long ago ** Changed in: apt-xapian-index (Ubuntu) Status: Triaged => Invalid ** Changed in: apt-xapian-index Status: New => Invalid ** Changed in: ac100 Status: New => Invalid -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: Invalid Status in apt-xapian-index: Invalid Status in apt-xapian-index package in Ubuntu: Invalid Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Singtoh, I give many thanks for this fix. I have 4 cores (2 hyperthreads each, so '8 cores'), so the high single-thread usage didn't bother me too much... But the amount of time it took really frustrated me. This goes from a 'leave Synaptic open for a while and do something else' sort of thing, to a 'wait a couple seconds more' sort of thing. HUGE difference! -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: New Status in apt-xapian-index: New Status in apt-xapian-index package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Correction I didn't purge Synaptic and apt-xapian-index before. Now I did and the crashes stopped. The update-apt-xapian-index process is still heavy on resources but it does work faster. It needs about one minute on my machine after refreshing sources in Synaptic. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: New Status in apt-xapian-index: New Status in apt-xapian-index package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Installing a pure Debian package over Ubuntu one isn't a good advice. Anyway I tried it and all it did was a crash fest for update-apt-xapian- index process. It crashes for every single operation. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: New Status in apt-xapian-index: New Status in apt-xapian-index package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Hello All, Just thought I would add a comment to this. The apt-xapian-index has been driving me mad since installing Ubuntu 16.04, being very slow rebuilding and it was rebuilding every time I opened Synaptic taking a few minutes. I had a script that I found on ubuntu forum that would rebuild the index on a cronjob but that didn't solve the slow rebuilding of the index. I just found this build of apt-xapian-index and now the index rebuilds in only a couple of seconds and seems to have solved the problem on my machine. Here is the link if anyone is interested: https://packages.debian.org/sid/all/apt-xapian-index/download. This file(apt-xapian-index_0.47+nmu2_all.deb) seems to have cured things for me. All I did was purged Synaptic and also apt-xapin-index and re-installed Synaptic, then the new apt-xapian-index from the link and it works super on this machine. I hope this helps someone as I have tried everything to get this index thing working properly. What a PIA, Cheers, Singtoh -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: New Status in apt-xapian-index: New Status in apt-xapian-index package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
With actual commonly used cpu having multi cores, the index should be rebuilt on at least 2 cores (or half the total cores number, to let the others available for the other processes) -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in AC100_enablement: New Status in apt-xapian-index: New Status in apt-xapian-index package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been "fixed". every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS "Lucid Lynx" - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
I hit this problem while upgrading from Kubuntu 13.10 to 14.04. I have an old laptop with 512 MiB RAM and the updating process crawled to a halt. I just created a fake package to get rid of apt-xapian-index without having to edit system configuration files, see here: https://github.com/rdiez/Tools/tree/master/FakeReplacementForAptXapianIndex -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
On Xubuntu 14.04 (supposed to be light-weight), same problem, update- apt-xapian-index is knocking down the system -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
In KUbuntu 14.04 this bug is getting terrible. This process, update-apt- xapi, tries to take about 400 M of memory, and given the minimum cumulative KDE memory consumption of 1.5 G at idle, all my 2 G get consumed, so I can run nothing more! This indexing process starts almost each time when I start an upgrade through muon or a muon-related software. I cannot just remove the apt-xapian-index, because important things depend on it. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
** Tags added: saucy trusty -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Just had another look into my notes. The problem appeared for me after upgrading from quantal to raring. I have also found bug 1152736 and bug 1185172 dealing with a potential kswapd regression in Kernel 3.8 and might be related. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Just an idea: the case and environment Hontvári József Levente (hontvari) mentioned on 2013-04-13 should be easy to recreate, and could be used to track down the problem with this indexer. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Max Polk has a good analysis. Partly to help google, I would add that on a Quantal 64 bit server installed with Install a minimal virtual machine option and 256 MB RAM, the command (simulating the cron job) sudo /usr/sbin/update-apt-xapian-index -v -f results in an additional 300 MB RAM usage (100 MB from swap). I noticed this issue because almost every day I receive a mail from CRON saying: /etc/cron.daily/apt: Killed Looking at syslog, the kernel frequently kills it: Apr 13 10:37:43 regmail1 kernel: [325133.105582] select 1 (init), adj 0, size 167, to kill Apr 13 10:37:43 regmail1 kernel: [325133.105592] select 625 (java), adj 0, size 15923, to kill Apr 13 10:37:43 regmail1 kernel: [325133.105596] select 3915 (update-apt-xapi), adj 0, size 36048, to kill Apr 13 10:37:43 regmail1 kernel: [325133.105598] send sigkill to 3915 (update-apt-xapi), adj 0, size 36048 Obviously the indexing algorithm which was chosen is either extremely RAM hungry, or the implementation has a bug. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
** Tags added: quantal -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
** Tags added: amd64 raring -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
A weekly fatal unable to fork error message from /etc/cron.weekly/apt- xapian-index on a server with 512MB memory with a web server and database server running leads to this bug. That cron job calls /usr/sbin /update-apt-xapian-index, which is a Python script that imports axi and axi.indexer. Those Python packages are the heart of the problem. On an idle system with 512M memory and 768M swap, while /etc/cron.weekly /apt-xapian-index was running, I used free to see memory and swap used. It rose to then peaked at this: total used free Mem: 503528 497736 5792 Swap: 786428 231196 555232 Total used memory is 728M. After ending, it immediately dropped back to this: total used free Mem: 503528 259160 244368 Swap: 786428 224484 561944 Total used memory is 483M. I conclude that apt-xapian-index consumes the difference, which is 245M. Running apt-cache stats I see at the end Total space accounted for: 26.0 M. Therefore, it takes 245M to sort and index 26M of information. This seems conclusive that the algorithms, containers, and/or functions chosen are very inefficient. It should definitely not require 10 times the memory space of what is being indexed. The solution is to change the sorting algorithm in the python axi and axi.indexer modules. The first priority is to switch to an algorithm that consumes a whole lot less memory (i.e., each step of the algorithm keeps less objects in memory), and it will stop crashing and stop thrashing (memory swapping to disk). The second priority is of lesser importance (because renice can solve a lot of the effect), which is to switch to an algorithm that takes a lot less time to run (i.e., takes fewer steps to complete), and it will stop consuming so much CPU for so long. -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
Thats what i get on RR i386, logged as gnome-classic: Traceback (most recent call last): File /usr/sbin/update-apt-xapian-index, line 97, in module indexer.slave() File /usr/lib/python2.7/dist-packages/axi/indexer.py, line 454, in slave childProgress = ClientProgress(self.progress) File /usr/lib/python2.7/dist-packages/axi/indexer.py, line 211, in __init__ self.sock.connect(axi.XAPIANDBUPDATESOCK) File /usr/lib/python2.7/socket.py, line 224, in meth return getattr(self._sock,name)(*args) socket.error: [Errno 2] No such file or directory That report is beeing old and is still unassigned; Does that mean no one care ? -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
[Ac100] [Bug 655831] Re: update-apt-xapian-index bogs down system
dmesg cant be cut off in /var/log/dmesg, thats the file where your dmesg output gets dumped to right after boot, just grep in there instead of piping teh dmesg output to grep ... zram is enabled by default in all ubuntu ac100 images cat /proc/swaps should confirm this ... -- You received this bug notification because you are a member of AC100 Team, which is subscribed to AC100_enablement. https://bugs.launchpad.net/bugs/655831 Title: update-apt-xapian-index bogs down system Status in Enablement project for the Toshiba AC100 NetBook: New Status in Apt Xapian Index: New Status in “apt-xapian-index” package in Ubuntu: Triaged Bug description: Binary package hint: apt-xapian-index This is related to bug 363695 but is not a dupe - that has been fixed. every time the update-apt-xapian-index occurs, the system crawls. Possibly related to the I/O responsiveness bug of bug 131094. The process is extremely intrusive, taking simple things such as flash video and throwing the performance down the toilet. While this apport bug was collected via a Lucid machine this also affects maverick. ProblemType: Bug DistroRelease: Ubuntu 10.04 Package: apt-xapian-index 0.25ubuntu2 ProcVersionSignature: Ubuntu 2.6.32-25.44-generic 2.6.32.21+drm33.7 Uname: Linux 2.6.32-25-generic i686 NonfreeKernelModules: nvidia Architecture: i386 Date: Wed Oct 6 12:32:35 2010 InstallationMedia: Ubuntu 10.04 LTS Lucid Lynx - Release i386 (20100429) PackageArchitecture: all ProcEnviron: LANG=en_US.utf8 SHELL=/bin/bash SourcePackage: apt-xapian-index To manage notifications about this bug go to: https://bugs.launchpad.net/ac100/+bug/655831/+subscriptions ___ Mailing list: https://launchpad.net/~ac100 Post to : ac100@lists.launchpad.net Unsubscribe : https://launchpad.net/~ac100 More help : https://help.launchpad.net/ListHelp
