[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
Very disturbing, ~4.5x slower in ARM! ** Summary changed: - ARM Opentack API/Dashboard calls are very slow + Python 4.5x slower on ARM as seen with Opentack API/Dashboard calls -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: Python 4.5x slower on ARM as seen with Opentack API/Dashboard calls To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
A comparison of the results command pyperformance compare py2_arm64.json py2_x86.json ** Attachment added: "Output for the comparrison of arm64 vs x86" https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+attachment/4834307/+files/compare_arm64_vs_x86.txt -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
uname -a 4.4.0-66-generic #87-Ubuntu SMP Fri Mar 3 15:29:05 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux ** Attachment added: "Results generated on an x86 system" https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+attachment/4834306/+files/py2_x86.tgz -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
@Billy : Nevermind comment #11. mreed8855 mentioned that the benchmark comes with a "compare" option that can be used to compare results. Thx. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
@Billy Olsen : Michael R helped run the benchmarks you pointed to on ARM64 and posted the results on comm #9. Do you happen to know how they can be interpreted/compared with other archs ? Thanks, Raghu -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
Kernel version for the results produced in comment #9 ~$ uname -a Linux seidel 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20 14:58:00 UTC 2017 aarch64 aarch64 aarch64 GNU/Linux -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
I used the benchmark from the following link: https://github.com/python/performance I used the following command: pyperformance run --python=python2 -o py2.json ** Attachment added: "Results generated on a "Gigabyte R120-T33 ARM64 system"" https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+attachment/4829032/+files/py2.json.gz -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
fwiw, I believe we've always seen this problem on arm64, including with our trusty + mitaka cloud archive testing. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
May be related to bug 1638695 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
We're also seeing this in OIL. The dashboard takes so long to load sometimes that the browser times out. ** Tags added: oil -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
I'd suggest removing OpenStack from the mix and profiling python as Billy mentions. My observation is that simple python calls such as `openstack --help` are also more sluggish than expected. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
Billy Olsen (billy-olsen) wrote on 2017-02-13: If we think this is a python performance issue, it might be beneficial to get some data running the python performance suite - which is available here https://github.com/python/performance. Also, its likely we should target this at the Python Ubuntu package to see if there's some compile time optimizations that can be done for the python interpreter. ** Tags added: arm64 openstack uosci -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
dann frazier (dannf) wrote on 2017-01-26: Re: [Bug 1652377] Re: API calls are very slow : On Wed, Jan 25, 2017 at 6:31 PM, Ryan Beisner <1652...@bugs.launchpad.net> wrote: > Without scientific data at this point, I can confirm that every CLI/API > call I make on a freshly-deployed Xenial-Mitaka arm64 cloud is > noticeably sluggish compared with x86 deploys, where the x86 machines > are 6 years old, have 75% of the RAM, and less than half the advertised > cores. > > This is worth profiling without OpenStack in the mix. Do you know of a way to reproduce it without OpenStack in the mix? -dann -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
Ryan Beisner (1chb1n) wrote on 2017-01-26: For example, this should not take 19s on a cloud with no tenants, no instances, 1 image, and light system resource allocation per-node: `time glance image-list` +--++ | ID | Name | +--++ | 0d66c03c-fe4c-4d26-bfac-74ecb55735ab | xenial | +--++ real 0m19.580s user 0m0.888s sys 0m0.068s . `time nova list` jenkins@juju-osci1-machine-6:~/temp/openstack-charm-testing$ time nova list ++--+++-+--+ | ID | Name | Status | Task State | Power State | Networks | ++--+++-+--+ ++--+++-+--+ real 0m11.833s user 0m1.028s sys 0m0.076s -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1664764] Re: ARM Opentack API/Dashboard calls are very slow
Ryan Beisner (1chb1n) wrote on 2017-01-26: Without scientific data at this point, I can confirm that every CLI/API call I make on a freshly-deployed Xenial-Mitaka arm64 cloud is noticeably sluggish compared with x86 deploys, where the x86 machines are 6 years old, have 75% of the RAM, and less than half the advertised cores. This is worth profiling without OpenStack in the mix. I'd like to have HWCERT or Server Team or Kernel Team to provide system performance profiling methodology info (presuming there is an existing approach). Then I'd like to exercise that on these arm64 machines and the x86 machines, then compare to get baseline info (again, absent OpenStack). @raghu: please see if you can gather info from other teams and direct that info here. TIA! -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1664764 Title: ARM Opentack API/Dashboard calls are very slow To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/horizon/+bug/1664764/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
