[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
ok, i have cut out a new bug for the issues left: https://bugs.edge.launchpad.net/ubuntu/+source/firefox/+bug/229745: #229745 - after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) if you want to follow there, feel free to subscribe to that bug. ** Description changed: + + Note: the follow up bug for this is https://bugs.edge.launchpad.net/ubuntu/+source/firefox/+bug/229745: + #229745 - after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) + + === + Browsing with Firefox 3.0b5 on Hardy (All updates applied) causes Xorg to use 50-60% CPU all the time. This is not limited to a particular site or page - it happens any time when Firefox is rendering pages. The high CPU usage makes browsing very jerky - switching tabs takes more time than it should, pages appear frozen for a brief moment. === From https://bugzilla.mozilla.org/show_bug.cgi?id=430530#c4: After some testing, it looks like this gets pretty bad on linux. Once we hit sqlite's cache size, sqlite starts hitting the disk pretty hard. While the database is small this isn't a big deal (we don't hit the cache limit), and once we're up-to-date it isn't as bad (we aren't adding as much data). But during the middle/end of the push to get the complete database, things take way too long, and we're thrashing the disk the whole time. We can reduce the amount of IO by increasing the cache size, and that'll help some (it'll help a whole lot if we increase the cache size by enough to hold the db). We might also need to look at throttling the update process a bit, so that we don't slam the system all at once... === To reproduce: 1. enable browser.safebrowsing.malware.enabled + browser.safebrowsing.enabled 2. observe IO on urlclassifier3.sqlite while browsing the web -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
(Just write bug #229745 and you get a correct bug link) -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Description changed: - - Note: the follow up bug for this is https://bugs.edge.launchpad.net/ubuntu/+source/firefox/+bug/229745: + Note: the follow up bug for this is bug #229745: #229745 - after fix for #215728 - Committing to urlclassifier3.sqlite still causes excessive CPU usage and disk I/O (the 2nd) === Browsing with Firefox 3.0b5 on Hardy (All updates applied) causes Xorg to use 50-60% CPU all the time. This is not limited to a particular site or page - it happens any time when Firefox is rendering pages. The high CPU usage makes browsing very jerky - switching tabs takes more time than it should, pages appear frozen for a brief moment. === From https://bugzilla.mozilla.org/show_bug.cgi?id=430530#c4: After some testing, it looks like this gets pretty bad on linux. Once we hit sqlite's cache size, sqlite starts hitting the disk pretty hard. While the database is small this isn't a big deal (we don't hit the cache limit), and once we're up-to-date it isn't as bad (we aren't adding as much data). But during the middle/end of the push to get the complete database, things take way too long, and we're thrashing the disk the whole time. We can reduce the amount of IO by increasing the cache size, and that'll help some (it'll help a whole lot if we increase the cache size by enough to hold the db). We might also need to look at throttling the update process a bit, so that we don't slam the system all at once... === To reproduce: 1. enable browser.safebrowsing.malware.enabled + browser.safebrowsing.enabled 2. observe IO on urlclassifier3.sqlite while browsing the web -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Are you sure it is Firefox to cause that IO load? Have you measured it? If you want I have a Systemtap script useful to find the IO bound process. With the proposed fix I've never experienced the issue again. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
The disk I/O is not as bad or as frequent as before. But it's still there, i have no idea how to measure it or where it comes from if you have a script or instructions on how to do this (measuring) i'll be happy to do that and report. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I can confirm this. The main problem is gone but it seems partly shifted. Every half an hour or something like that Firefox and nearly the whole system freezes (at least all disk tasks) for around ten seconds. My laptop hard disk isn't so fast so I guess Firefox syncs the the database everytime when it happens. It is now btw. 50 MB. If I disable the options the problem disappears. The kernel should better be able to scale/queue intensive hard disk ios so not one task is able to halt the whole system (Bug #131094). -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Hi guys, two useful methods to measure IO by process are the following, based on the great SystemTap linux kernel tool. The disktop.stp script, which can be found attached here, measure the first N processes odered by IO activity - a 'top' for disk resource, we could say. I've found it on the net, it seems to be made by Oracle and it is the porting to SystemTap of the equivalent Dtrace script. Once found the culprit process, we can also see the response time of each IO request that the process make with the iotime.stp script, which is provided with the systemtap package (/usr/share/doc/systemtap/examples/iotime.stp) I hope you can find them useful. Let us know if firefox is actually the process that hurts your performance. I've noticed that in Ubuntu there are also other very high disk demanding tool, for example the scrollkeeper-update or the slocate db updater. I think it should be paid more attention to the disk resource, often its impact on performance is overlooked but actually it is important. If the culprit process is a background tool, you can lower its IO priority with ionice - thanks to the linux fair CFQ scheduler. Let us know what you find! ** Attachment added: disktop.stp http://launchpadlibrarian.net/14453679/disktop.stp -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Yes, there is still some heavy disk I/O going on. It's no where near as bad as it was before the update. This patch is a HUGE improvement, but it still happens from time to time causing Firefox to become unresponsive for a few seconds. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
The easiest way to see which processes are doing i/o is to use iotop, there are packages in my PPA. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Hi, actually I've just measured some firefox heavy IO activity, but as Nick reported, it is a matter of seconds and in my case it doesn't make the whole system irresponsive as it was before the patch. Luckily I had disktop running, so here is the output. I can say that the the slowdown that I felt was probably due to the large write of 5.5MB in 5 seconds you can see at 18:28:31 - some random IO activity I guess. Sun May 11 18:28:11 2008 , Average: 657Kb/sec, Read:2642Kb, Write: 647Kb UID PID PPID CMD DEVICETBYTES 1000 58801 firefox sda3R 2605104 1000 58801 firefox sda3W 646660 1000 58751 transmission sdb2R98304 1000 58751 transmission sdb2W16384 1000 58071 multiload-apple sda3R 2049 Sun May 11 18:28:16 2008 , Average:1031Kb/sec, Read:2965Kb, Write: 2194Kb UID PID PPID CMD DEVICETBYTES 1000 58801 firefox sda3R 2936832 1000 58801 firefox sda3W 2246792 1000 58751 transmission sdb2R98304 1000 58071 multiload-apple sda3R 1366 Sun May 11 18:28:21 2008 , Average: 856Kb/sec, Read:2842Kb, Write: 1438Kb UID PID PPID CMD DEVICETBYTES 1000 58801 firefox sda3R 2826240 1000 58801 firefox sda3W 1440504 1000 58751 transmission sdb2R81920 1000 58751 transmission sdb2W32768 1000 58071 multiload-apple sda3R 2049 Sun May 11 18:28:26 2008 , Average: 607Kb/sec, Read:2089Kb, Write: 948Kb UID PID PPID CMD DEVICETBYTES 1000 58801 firefox sda3R 2023424 1000 58801 firefox sda3W 971588 1000 58751 transmission sdb2R 114688 1000 58071 multiload-apple sda3R 1366 0 53311 preload sda3W 131 Sun May 11 18:28:31 2008 , Average:1144Kb/sec, Read: 254Kb, Write: 5468Kb UID PID PPID CMD DEVICETBYTES 1000 58801 firefox sda3W 5599737 1000 58801 firefox sda3R 131204 1000 58751 transmission sdb2R 114688 1000 6157 5970iostat sda3R11652 1000 58071 multiload-apple sda3R 2049 1000 6157 5970 bash sda3R 531 Sun May 11 18:28:36 2008 , Average: 19Kb/sec, Read: 81Kb, Write: 16Kb UID PID PPID CMD DEVICETBYTES 1000 58751 transmission sdb2R81920 1000 58751 transmission sdb2W16384 1000 58071 multiload-apple sda3R 1366 -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I can confirm both the improvement because of the patch, and the remaining hugely diminished problem. Oh well, I have simply disabled the warning for attack websites. Who cares anyway, all they attack is Windows machines. :-) -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I should have been more clear: I mostly saw high i/o load, not CPU usage, and the .sqlite file was ~30MB. This came several days after installing your package (and deleting the old .sqlite files). Now things run fine with the official update, but I wonder if it can kick in again after some time. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I'm also still getting excessive disk I/O after the update. fire-fox grinds the disk while surfing -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
Re: [Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
On Wed, May 07, 2008 at 08:45:30PM -, Tormod Volden wrote: I installed the 1.9~b5+nobinonly-0ubuntu4~8.04.0mt1 from comment 69, but still had this problem. I have now reinstalled from hardy-updates. I see the version name is the same, but can I expect it to work better now? No, you are most likely seeing an unrelated issue (most likely a rendering operation or javascript consuming high CPU ... or flash). - Alexander -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Verification looks good so far, marking verification-done. I'll copy this once Alex answers to the previous question and it is not a problem. ** Tags added: verification-done ** Tags removed: verification-needed -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
urlclassifier2.sqlite is the old filename and is not used anymore. The schema/filename policy reads like this: // The database filename is updated when there is an incompatible // schema change and we expect both implementations to continue // accessing the same database (such as between stable versions of the // platform). #define DATABASE_FILENAME urlclassifier3.sqlite // The implementation version is updated during development when we // want to change schema, or to recover from updating bugs. When an // implementation version change is detected, the database is scrapped // and we start over. #define IMPLEMENTATION_VERSION 4 This update only bumped IMPLEMENTATION_VERSION. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Copied to hardy-updates. ** Changed in: xulrunner-1.9 (Ubuntu Hardy) Status: Fix Committed = Fix Released -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Same Problem with my laptop here. Extremely hard-disk usage with firefox 3 Beta5 and hardy heron makes laptop very very slow. not very nice ... -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
dave87, look at the post above yours (posted 11 hours ago). Fix was released, use System|Administration|Update Manager to download the latest updates. It will be two updates xulrunner-something. Enjoy, Dan. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I installed the 1.9~b5+nobinonly-0ubuntu4~8.04.0mt1 from comment 69, but still had this problem. I have now reinstalled from hardy-updates. I see the version name is the same, but can I expect it to work better now? -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Hi, I upgraded the xulrunner too, up to now the behaviour is ok! Thanks for the fix. When it will be available as a standard distribution package? -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
stek79. The packages are currently in hardy-proposed and should be tested from there (not from the PPA). Once we collected enough test results, they will go into hardy-updates, where all users will get them automatically. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
yes, please remove the PPA lines from your sources.list ... enable -proposed in System - Administration - Software sources ... and run sudo apt-get update; sudo apt-get install --reinstall xulrunner-1.9 Then test and submit your test-results. Thanks! -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
This is all rather subjective, as I didn't time it beforehand, but Firefox feels a lot more responsive after this fix, particularly just after entering a URL and when switching tabs. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I am using the proposed update and all works fine now (at least till this moment). By the way, I agree Colin, I feel Firefox more responsive. Good work! -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Using xulrunner-1.9 from hardy-proposed, verified that symptoms are no longer present using: 1) existing user with existing FF 2.0.0.14 profile (gutsy-security) migrated to FF 3.0b5 profile (hardy-proposed); 2) existing user with existing FF 3.0b5 profile (hardy-proposed); 3) new user with new FF 3.0b5 profile (hardy-proposed). -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
For the record, I have used the new xulrunner for over a day here and didn't notice any regressions. I don't use any fancy extensions, though (just AdBlock plus), and the proprietary flash. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Today (10 hours ago), I repeated the testing with xulrunner in proposed, instead of xulrunner from upstream (after applying Alexander Sack's instruction: https://bugs.launchpad.net/ubuntu/+bug/215728/comments/94 Again, no problems after a day of intensive web surfing. *Please* don't wait any longer with spreading this update through the normal channels. This bug is so bad, that reparation is extremely urgent. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I can confirm that this update doesn't introduce any regressions (the urlclassifier files are updated, web sites I use to visit work, etc). I've tested on a computer (and Firefox profile) upgraded from Ubuntu 5.04-5.10-6.06-8.04. I did some quick testing with a fresh profile and it seemed to work well too. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I can't test the version in hardy-proposed, because I can find a mirror that's up-to-date enough, and the connection to Main is patchy at best -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Same here. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Attachment removed: both urclassifier files http://launchpadlibrarian.net/13889583/urlclassifier.7z -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
same problem , same behaviour here. Laptop goes unusable. I went back to firefox 2 for now. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
No problems, but two questions. Before the workaround, I had two files: 4970496 2008-04-26 23:42 urlclassifier2.sqlite 23249920 2008-04-27 17:01 urlclassifier3.sqlite Now that I have installed xulrunner-1.9 version 1.9~b5+nobinonly- 0ubuntu4~8.04.0mt1 from hardy-proposed, I do not have the file urlclassifier2.sqlite I only have the file urlclassifier3.sqlite so: 33275904 2008-05-07 10:25 urlclassifier3.sqlite I have enabled both suspected attack sites and suspected forgery sites. 1. Is this absence of urlclassifier2.sqlite normal behaviour? 2. What does it imply? Thanks. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
initiating SRU process. ** Description changed: Browsing with Firefox 3.0b5 on Hardy (All updates applied) causes Xorg to use 50-60% CPU all the time. This is not limited to a particular site or page - it happens any time when Firefox is rendering pages. The high CPU usage makes browsing very jerky - switching tabs takes more time than it should, pages appear frozen for a brief moment. + + === + From https://bugzilla.mozilla.org/show_bug.cgi?id=430530#c4: + + After some testing, it looks like this gets pretty bad on linux. + + Once we hit sqlite's cache size, sqlite starts hitting the disk pretty hard. + While the database is small this isn't a big deal (we don't hit the cache + limit), and once we're up-to-date it isn't as bad (we aren't adding as much + data). + + But during the middle/end of the push to get the complete database, things take + way too long, and we're thrashing the disk the whole time. + + We can reduce the amount of IO by increasing the cache size, and that'll help + some (it'll help a whole lot if we increase the cache size by enough to hold + the db). We might also need to look at throttling the update process a bit, so + that we don't slam the system all at once... -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Attachment added: backport upstream patch for ffox 3 beta 5 http://launchpadlibrarian.net/14217721/bz430530_attachment_318939.patch -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Attachment added: diff of hardy-proposed upload http://launchpadlibrarian.net/14217741/215728.hardy-proposed.diff -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
parts of the upstream patch touch firefox 3, but for hardy we move the pref from browser/ to toolkit/ to prevent that both packages need to be updated. ** Description changed: Browsing with Firefox 3.0b5 on Hardy (All updates applied) causes Xorg to use 50-60% CPU all the time. This is not limited to a particular site or page - it happens any time when Firefox is rendering pages. The high CPU usage makes browsing very jerky - switching tabs takes more time than it should, pages appear frozen for a brief moment. === From https://bugzilla.mozilla.org/show_bug.cgi?id=430530#c4: After some testing, it looks like this gets pretty bad on linux. Once we hit sqlite's cache size, sqlite starts hitting the disk pretty hard. While the database is small this isn't a big deal (we don't hit the cache limit), and once we're up-to-date it isn't as bad (we aren't adding as much data). But during the middle/end of the push to get the complete database, things take way too long, and we're thrashing the disk the whole time. We can reduce the amount of IO by increasing the cache size, and that'll help some (it'll help a whole lot if we increase the cache size by enough to hold the db). We might also need to look at throttling the update process a bit, so that we don't slam the system all at once... + + === + + To reproduce: + + 1. enable browser.safebrowsing.malware.enabled + browser.safebrowsing.enabled + 2. observe IO on urlclassifier3.sqlite while browsing the web ** Changed in: firefox-3.0 (Ubuntu Hardy) Status: In Progress = Invalid -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Changed in: firefox-3.0 (Ubuntu Intrepid) Status: In Progress = Invalid -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Accepted into hardy-proposed, please test and give feedback here. ** Tags added: verification-needed -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Test instructions: Go to System - Administration - Software Sources and enable hardy-proposed in the Updates tab. Next, upgrade your system and once you got xulrunner-1.9 version 1.9~b5+nobinonly- 0ubuntu4~8.04.0mt1, verify that this problem is gone. Thanks for testing! - Alexander -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
To test thoroughly, do we also need a pristine FF3.0b5 environment (e.g., new user, or along the lines of rm -r ~/.mozilla, so that an existing urlclassifier cache is not in play)? -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
This fix didn't fix the problem I'm seeing in https://bugs.launchpad.net/bugs/224320, which is marked as a dup of this bug. Removed .mozilla and I still see the same problem as reported at 224320, after install of proposed xulrunner-1.9 -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Since upgrade to the xulrunner from hardy-proposed, my firefox crashes after watching videos on www.autsch.de and www.clipfish.de - I can watch one movie, the second crashes firefox. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I didn't experienced any high disk I/O and high CPU since upgrading to the mt-version. @Rocco and @Martin: Are you sure you closed/killed all firefox processes after upgrading? @Martin: I can't confirm any crashes on those sites with those flash videos. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Changed in: cruft (Ubuntu Intrepid) Sourcepackagename: xorg = cruft -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Still testing (over a day now) and still no problems. This update really works. Good job! :-) -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Rocco, I unduped your bug. You are seeing something else as you are sure that you experience no high IO load. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Daniel, afaict you don't need to remove any existing urlclassifier database. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Changed in: Ubuntu Intrepid Sourcepackagename: cruft = None -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I have added to /etc/apt/sources.list the following two lines: deb http://ppa.launchpad.net/mozillateam/ubuntu hardy main deb-src http://ppa.launchpad.net/mozillateam/ubuntu hardy main The currently installed packages are: firefox-3.0_3.0~b5+nobinonly-0ubuntu3_i386.deb xulrunner-1.9_1.9~b5+nobinonly-0ubuntu4~8.04.0mt1_i386.deb The previously encountered problems have not recurred. I have one question, though. Having ticked both the suspected attack site and suspected forgery site boxes, I find that I now have only urlclassifier3.sqlite in my .mozilla/firefox/blah directory, and it is growing at a modest rate. But there is no urlclassifier2.sqlite which was one of the files I was advised to delete previously. Does this have any significance? Thanks. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
@Alexander Sack: If I understand you correctly, you would like us to test a possible fix for this bug. If so, could you provide us with direct links to the packages in question (32-bit and 64-bit)? I can't find my way on the link page that you gave. By the way: why do you think that xulrunner is the culprit? On my Intel Core 2 Duo machine, running 32 bit Ubuntu, the problem wasn't solved after I removed both xulrunner Add-ons (british and dutch). So how can this bug be related to xulrunner? The only thing that helped was the workaround that I posted a few posts higher up in this thread. That succesful workaround suggests that the problem lies in Firefox 3 itself, not in the add-on xulrunner. Greetz, Pjotr. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Pjotr12345: The link is a PPA and contains the fixed xulrunner packages. You just add the PPA to your /etc/apt/sources.list and install the update through the package manager. And to clarify, xulrunner isn't a Firefox add-on. xulrunner is the backend to Firefox - without it, it won't work at all. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
@Alexander Sack and Chris Coulson: I get this error message from the system when I apt-get update with the addition of the line https://edge.launchpad.net/~mozillateam/+archive; in muy sources list: @thuiscomputer:~$ sudo apt-get update [sudo] password for : E: Type 'https://edge.launchpad.net/~mozillateam/+archive' on line 48 in sources list /etc/apt/sources.list is unknown Please make it a little easier for me to help you with testing. I consider myself to be an experienced Linux user, but this is over my head. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Pjotr: try to add the following line to your /etc/apt/sources.list: deb http://ppa.launchpad.net/mozillateam/ubuntu hardy main Good luck! -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
OK. Updates applied and testing started. I will report back in a day or so. Bedankt, Sander! :-) -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Intermediate report, in view of the critical importance of this bug (show stopper). After more than an hour of intensive surfing, with the warning for attack sites turned on (default configuration): no more problems. :-) However, urlclassifier3.sqlite has grown from 0,009 MB to 9,6 MB. Is this rate of increase normal? If so, how can the growth of this file be limited? -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I think it can be considered as fixed. A couple of hours more of intensive browsing and no problems at all. :-) Please roll out this update very quickly. It's extremely damaging for the reputation of Ubuntu, especially for an LTS-version. One remark: urlclassifier3.sqlite has grown to 18,8 MB. This worries me: how much more will it grow? And how can I stop it from growing to a huge size, apart from disabling the attack website warnings? -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Pjotr, that file contains information about malicious websites, and I think it's intended to become quite big. It however should stop growing at some point, when all information has been downloaded. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
Btw. could anyone of the kernel devs answer why a simple disk operation like this one uses 100% kernel cpu? I have made a bug report some time ago but the devs neglected it. It often happens on simple copy operation and similar things. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
test package with cherry-picked patch from upstream available in intrepid. please test. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
preparing and uploading hardy preview package of this cherry pick to mozillateam PPA: https://edge.launchpad.net/~mozillateam/+archive The version that will be upped in an hour or so is: 1.9~b5+nobinonly- 0ubuntu4~8.04.0mt1 Please test. ** Changed in: xulrunner-1.9 (Ubuntu Hardy) Status: In Progress = Fix Committed -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
flag resolved fixed on bugzilla : https://bugzilla.mozilla.org/show_bug.cgi?id=430530 -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Also affects: xulrunner-1.9 (Ubuntu) Importance: Undecided Status: New ** Changed in: firefox (Ubuntu Hardy) Status: New = Invalid ** Changed in: xorg (Ubuntu Hardy) Status: New = Invalid ** Changed in: xulrunner-1.9 (Ubuntu Hardy) Status: New = In Progress ** Changed in: xulrunner-1.9 (Ubuntu Intrepid) Importance: Undecided = High Status: New = In Progress ** Changed in: xulrunner-1.9 (Ubuntu Hardy) Importance: Undecided = High ** Changed in: firefox-3.0 (Ubuntu Hardy) Importance: Undecided = High Status: New = In Progress ** Changed in: firefox-3.0 (Ubuntu Intrepid) Status: Confirmed = In Progress ** Changed in: firefox-3.0 (Ubuntu Intrepid) Importance: Undecided = High -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
This bug was fixed in the package xulrunner-1.9 - 1.9~b5+nobinonly- 0ubuntu4 --- xulrunner-1.9 (1.9~b5+nobinonly-0ubuntu4) intrepid; urgency=low * fix LP: #215728 - excess disk IO when updating the url-classifier; we increase cache size of sqlite database and better align page size. Cherry-picking and backporting upstream fix from bmo#430530; other changes vs. upstream: we move default pref for cache size from browser/ to toolkit/ - add debian/patches/bz430530_attachment_318939.patch - update debian/patches/series * don't use gcc-4.2/g++-4.2 and dont depend on that package accordingly - update debian/rules - update debian/control -- Alexander Sack [EMAIL PROTECTED] Sat, 03 May 2008 01:08:17 +0200 ** Changed in: xulrunner-1.9 (Ubuntu Intrepid) Status: In Progress = Fix Released -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Changed in: firefox Status: In Progress = Fix Released -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I think the best thing is to go back to 7.10 and wait till they sort this crap out I mean why in the heck would they place a beta browser in this beats the bloody life out of me -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
There is an easy workaround. This workaround is successful: 1. Open Firefox 3 2. Disable phishing/attack detection in the security section of the Preferences 3. Close Firefox 4. Make hidden files visible (Locations - Personal folder - View - show hidden files) 5. Delete /home/user/.mozilla/firefox/blahblahblah.default/urlclassifier*.sqlite 6. Open Firefox. 7. There is no next step. You're done. :-) Greetz, Pjotr. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
revelationman: You can install the package firefox-2 in Ubuntu 8.04 if you want Firefox 2. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Changed in: firefox Status: Confirmed = In Progress -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
I just wanted to let you know that the problem occurs in Win XP Pro SP2 Swedish as well and has been doing since beta 1 beta 3 beta 5. It has now consumed 17 CPU minutes since I started Firefox about an hour ago, an mostly surfing this thread (Some googling to find the thread), and Yes It is reading/writing the urlclssifier files all the time. (It has done 6 million read requests 4 million write request, having read 6GB written 4GB of data, in the last hour) I will stop using this version going back to 2.14 for a while hoping that the problem will be solved. -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
** Summary changed: - [MASTER] High CPU Consumption + [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 215728] Re: [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O
113654 is most probably NOT a duplicate of this bug, i don't have any of the issues reported here and only get the problems when visiting that specific page -- [MASTER] Committing to urlclassifier3.sqlite causes excessive CPU usage and disk I/O https://bugs.launchpad.net/bugs/215728 You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
