[Touch-packages] [Bug 1123272] Re: high cpu usage on download (not optimised SHA256, SHA512, SHA1)
Hi Julian, I would suggest to rewords you initial comments to some thing like: "apt was heavy reworked and optimised, probably your initial problem won't hit you as hard as before. Hashing optimisation can't currently be done for this release without braking the ABI." Any way, thank you for your work and I hope you can still continue to do it. Sorry for my misunderstanding. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1123272 Title: high cpu usage on download (not optimised SHA256, SHA512, SHA1) Status in apt package in Ubuntu: Confirmed Bug description: http process takes about 20% on intel i5-3317. Here is output of ps aux: root 4309 21.7 0.0 37108 2344 pts/2S+ 18:17 0:01 /usr/lib/apt/methods/http it can be easy reproduces with "apt-get download firefox-dbg" or any other upgrade realted command. The reason of this overhead are this functions: 22,34% http libapt-pkg.so.4.12.0 [.] SHA256_Transform(_SHA256_CTX*, unsigned int const*) 14,81% http libapt-pkg.so.4.12.0 [.] SHA512_Transform(_SHA512_CTX*, unsigned long const*) 8,11% http libapt-pkg.so.4.12.0 [.] SHA1Transform(unsigned int*, unsigned char const*) 5,62% http libapt-pkg.so.4.12.0 [.] MD5Transform(unsigned int*, unsigned int const*) libapt uses own implementation of this hasches without any optimisation. Are there any reason why libapt do not use openssl? Beside current version of openssl has AVX optimised SHA* implementations. ProblemType: Bug DistroRelease: Ubuntu 13.04 Package: apt 0.9.7.7ubuntu1 ProcVersionSignature: Ubuntu 3.8.0-4.9-generic 3.8.0-rc6 Uname: Linux 3.8.0-4-generic x86_64 ApportVersion: 2.8-0ubuntu4 Architecture: amd64 Date: Tue Feb 12 18:12:33 2013 InstallationDate: Installed on 2012-09-13 (152 days ago) InstallationMedia: Ubuntu 12.10 "Quantal Quetzal" - Alpha amd64 (20120913.1) MarkForUpload: True ProcEnviron: TERM=xterm PATH=(custom, no user) XDG_RUNTIME_DIR= LANG=de_DE.UTF-8 SHELL=/bin/bash SourcePackage: apt UpgradeStatus: Upgraded to raring on 2013-02-06 (5 days ago) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1123272/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1123272] Re: high cpu usage on download (not optimised SHA256, SHA512, SHA1)
Well, definition of "extreamly" is wired. In this bug report we have i5 with 20%! I my case it was Intel Atom with 100% CPU usage and DSL 2000 Mbit/s! Atom is slow, but not slowest used CPU. -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to apt in Ubuntu. https://bugs.launchpad.net/bugs/1123272 Title: high cpu usage on download (not optimised SHA256, SHA512, SHA1) Status in apt package in Ubuntu: Confirmed Bug description: http process takes about 20% on intel i5-3317. Here is output of ps aux: root 4309 21.7 0.0 37108 2344 pts/2S+ 18:17 0:01 /usr/lib/apt/methods/http it can be easy reproduces with "apt-get download firefox-dbg" or any other upgrade realted command. The reason of this overhead are this functions: 22,34% http libapt-pkg.so.4.12.0 [.] SHA256_Transform(_SHA256_CTX*, unsigned int const*) 14,81% http libapt-pkg.so.4.12.0 [.] SHA512_Transform(_SHA512_CTX*, unsigned long const*) 8,11% http libapt-pkg.so.4.12.0 [.] SHA1Transform(unsigned int*, unsigned char const*) 5,62% http libapt-pkg.so.4.12.0 [.] MD5Transform(unsigned int*, unsigned int const*) libapt uses own implementation of this hasches without any optimisation. Are there any reason why libapt do not use openssl? Beside current version of openssl has AVX optimised SHA* implementations. ProblemType: Bug DistroRelease: Ubuntu 13.04 Package: apt 0.9.7.7ubuntu1 ProcVersionSignature: Ubuntu 3.8.0-4.9-generic 3.8.0-rc6 Uname: Linux 3.8.0-4-generic x86_64 ApportVersion: 2.8-0ubuntu4 Architecture: amd64 Date: Tue Feb 12 18:12:33 2013 InstallationDate: Installed on 2012-09-13 (152 days ago) InstallationMedia: Ubuntu 12.10 "Quantal Quetzal" - Alpha amd64 (20120913.1) MarkForUpload: True ProcEnviron: TERM=xterm PATH=(custom, no user) XDG_RUNTIME_DIR= LANG=de_DE.UTF-8 SHELL=/bin/bash SourcePackage: apt UpgradeStatus: Upgraded to raring on 2013-02-06 (5 days ago) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1123272/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
[Touch-packages] [Bug 1365874] Re: Ubuntu 14.04 does not support ext4 metadata checksumming
I would love to help with testing of metadata_csum as match as possible. Espesially becouse i waiting for this option so long time. But there are two problem which make it hard to do: - no e2fsprogs 1.43 package even on ppa. - all systems are still created without 64bit enabled. Before testing we need: - add 64bit option to mke2fs.conf by default. - make 1.42 not complain if metadata_csum is enabled. - provide ppa package with big fat warning: don't cry if you test it -- You received this bug notification because you are a member of Ubuntu Touch seeded packages, which is subscribed to e2fsprogs in Ubuntu. https://bugs.launchpad.net/bugs/1365874 Title: Ubuntu 14.04 does not support ext4 metadata checksumming Status in e2fsprogs package in Ubuntu: Confirmed Bug description: In the Trusty release notes Metadata checksumming is listed as one of the tech highlights of kernel 3.13. https://wiki.ubuntu.com/TrustyTahr/ReleaseNotes#New_features_in_14.04_LTS However, the userland tools do not support this kernel feature. To the best of my knowledge this will be supported in 1.43, and won't be backported to 1.42. IMHO this is very misleading. It's like a car salesperson sold you a sports car with an V8 engine. After you drove it home, you opened the hood and realized only 6 cylinders are working because 2 of the spark plugs were not included, and you have to buy aftermarket ones. rantBTW, I've been following the development of e2fsprogs for over a year. 1.43 release has been in limbo for God knows how long :( /rant To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/e2fsprogs/+bug/1365874/+subscriptions -- Mailing list: https://launchpad.net/~touch-packages Post to : touch-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~touch-packages More help : https://help.launchpad.net/ListHelp
