[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Launchpad Bug Tracker]

This bug was fixed in the package nova - 2:13.1.2-0ubuntu2

---
nova (2:13.1.2-0ubuntu2) xenial; urgency=medium

  [ dann frazier ]
  * d/p/libvirt-add-hugepages-support-for-Power.patch (LP: #1568086).
  * d/p/libvirt-add-hugepages-support-for-arm64.patch (LP: #1623871).

 -- Corey Bryant   Tue, 18 Oct 2016 13:56:15
-0400

** Changed in: nova (Ubuntu Xenial)
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Corey Bryant]

** Tags removed: verification-needed
** Tags added: verification-done

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Brian Murray]

Hello Veena, or anyone else affected,

Accepted nova into xenial-proposed. The package will build now and be
available at https://launchpad.net/ubuntu/+source/nova/2:13.1.2-0ubuntu2
in a few hours, and then in the -proposed repository.

Please help us by testing this new package.  See
https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to
enable and use -proposed.  Your feedback will aid us getting this update
out to other Ubuntu users.

If this package fixes the bug for you, please add a comment to this bug,
mentioning the version of the package you tested, and change the tag
from verification-needed to verification-done. If it does not fix the
bug for you, please add a comment stating that, and change the tag to
verification-failed.  In either case, details of your testing will help
us make a better decision.

Further information regarding the verification process can be found at
https://wiki.ubuntu.com/QATeam/PerformingSRUVerification .  Thank you in
advance!

** Changed in: nova (Ubuntu Xenial)
   Status: In Progress => Fix Committed

** Tags added: verification-needed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[OpenStack Infra]

Reviewed:  https://review.openstack.org/372304
Committed: 
https://git.openstack.org/cgit/openstack/nova/commit/?id=50e0106d35ec1a3204c18f3912b0dc6cf6632305
Submitter: Jenkins
Branch:master

commit 50e0106d35ec1a3204c18f3912b0dc6cf6632305
Author: VeenaSL 
Date:   Mon Sep 19 13:36:53 2016 +0530

Adding hugepage and NUMA support check for aarch64

Nova ignores aarch64 while verifying for hugepage and NUMA support.
AARCH64 also supports hugepage and NUMA on the same libvirt versions as of 
x86.
Hence adding this chek for aarch64 also.

Change-Id: I7b5ae1dbdca4fdd0aee2eefd4099c4c4953b609a
Closes-bug: #1623871


** Changed in: nova
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Launchpad Bug Tracker]

This bug was fixed in the package nova - 2:14.0.0-0ubuntu1

---
nova (2:14.0.0-0ubuntu1) yakkety; urgency=medium

  * New upstream release for OpenStack Newton.
  * d/t/nova-compute-daemons: Skip test execution if running within a
container, ensuring that autopkgtests don't fail on armhf and s390x.
  * d/t/control,nova-compute-daemons: Don't install nova-compute as part
of the autopkgtest control setup, direct install hypervisor specific
nova-compute packages ensuring packages are configured in the correct
order and that nova-compute can access the libvirt socket.

 -- James Page   Fri, 07 Oct 2016 08:48:28 +0100

** Changed in: nova (Ubuntu)
   Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

MP for a xenial SRU:
  https://code.launchpad.net/~dannf/ubuntu/+source/nova/+git/nova/+merge/307882

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Launchpad Bug Tracker]

** Merge proposal linked:
   https://code.launchpad.net/~dannf/ubuntu/+source/nova/+git/nova/+merge/307882

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

** Changed in: nova (Ubuntu)
   Status: Triaged => Fix Committed

** Changed in: nova (Ubuntu)
 Assignee: (unassigned) => dann frazier (dannf)

** Changed in: nova (Ubuntu Xenial)
 Assignee: (unassigned) => dann frazier (dannf)

** Changed in: nova (Ubuntu Xenial)
   Status: Triaged => In Progress

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

Patch rebased on 2:14.0.0~rc2-0ubuntu2, MP here:
  https://code.launchpad.net/~dannf/ubuntu/+source/nova/+git/nova/+merge/307230

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Launchpad Bug Tracker]

** Merge proposal linked:
   https://code.launchpad.net/~dannf/ubuntu/+source/nova/+git/nova/+merge/307230

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

@mveenasl asked that I describe my testing process - here it is:

I pushed this change to a PPA:
  https://launchpad.net/~ce-hyperscale/+archive/ubuntu/cloud-mitaka

I then deployed OpenStack across a cluster of Cavium ThunderX CRB1s systems
using the current Mitaka Juju charms. I configured the nova-compute charm to 
pull
packages from this overlay PPA:

  openstack-origin: ppa:ce-hyperscale/cloud-mitaka

I logged into each of the 3 nova-compute nodes and created hugepages:

  $ echo 4096 | sudo tee /sys/kernel/mm/hugepages/hugepages-
2048kB/nr_hugepages

And restarted libvirt/nova-compute just to be sure they were detected:

  $ sudo service libvirt-bin restart; sudo service nova-compute restart

I configured the m1.small flavor type to use hugepages:
  $ nova flavor-key m1.small set hw:mem_page_size=2048

I then launched a guest:
  $ nova boot --image xenial-uefi  --flavor m1.small --nic 
net-id=0fed1d06-2c7c-48ab-b81b-112af6d362d7 uefi

Then found the corresponding hypervisor node and logged in.

I verified that QEMU was started w/ the appropriate memory-backend
settings:

$ ps -ef  | grep qemu
libvirt+  850307   1 42 16:17 ?00:00:12 
/usr/bin/qemu-system-aarch64 -name instance-0001 -S -machine 
virt,accel=kvm,usb=off,gic-version=3 -cpu host -drive 
file=/usr/share/AAVMF/AAVMF_CODE.fd,if=pflash,format=raw,unit=0,readonly=on 
-drive 
file=/var/lib/libvirt/qemu/nvram/instance-0001_VARS.fd,if=pflash,format=raw,unit=1
 -m 2048 -realtime mlock=off -smp 1,sockets=1,cores=1,threads=1 -object 
memory-backend-file,id=ram-node0,prealloc=yes,mem-path=/dev/hugepages/libvirt/qemu,share=yes,size=2147483648,host-nodes=0,policy=bind
 -numa node,nodeid=0,cpus=0,memdev=ram-node0 [...]


And that the hugepage pool was actually depleted:
 $ cat /sys/devices/system/node/node0/hugepages/hugepages-2048kB/free_hugepages
 3072

And finally, checked the console log to make sure the guest OS actually
booted:

ubuntu@ubuntu:~$ nova console-log uefi | tail -2
[  196.813164] cloud-init[1242]: Cloud-init v. 0.7.7 finished at Fri, 30 Sep 
2016 16:21:21 +. Datasource DataSourceEc2.  Up 196.73 seconds

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[Ubuntu Foundations Team Bug Bot]

** Tags added: patch

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

** Description changed:

- Although aarch64 supports spawning a vm with hugepages, in nova code,
- the libvirt driver considers only x86_64 and I686. Both for NUMA and
- Hugepage support, AARCH64 needs to be added. Due to this bug, vm can not
- be launched with hugepage using OpenStack on aarch64 servers.
+ [Impact]
+ Although aarch64 supports spawning a vm with hugepages, in nova code, the 
libvirt driver considers only x86_64 and I686. Both for NUMA and Hugepage 
support, AARCH64 needs to be added. Due to this bug, vm can not be launched 
with hugepage using OpenStack on aarch64 servers.
  
+ [Test Case]
  Steps to reproduce:
  On an openstack environment running on aarch64:
  1. Configure compute to use hugepages.
  2. Set mem_page_size="2048" for a flavor
- 3. Launch a VM using the above flavor. 
+ 3. Launch a VM using the above flavor.
  
  Expected result:
- VM should be launched with hugepages and the libvirt xml should have 
+ VM should be launched with hugepages and the libvirt xml should have
  
-   
-   
- 
-   
-   
+   
+   
+ 
+   
+   
  
  Actual result:
  VM is launched without hugepages.
  
  There are no error logs in nova-scheduler.
+ 
+ [Regression Risk]
+ Risk is minimized by the fact that this change is just enabling the same code 
for arm64 that is already enabled for the i386, amd64 and ppc64el Ubuntu 
architectures.

** Description changed:

  [Impact]
  Although aarch64 supports spawning a vm with hugepages, in nova code, the 
libvirt driver considers only x86_64 and I686. Both for NUMA and Hugepage 
support, AARCH64 needs to be added. Due to this bug, vm can not be launched 
with hugepage using OpenStack on aarch64 servers.
  
  [Test Case]
  Steps to reproduce:
  On an openstack environment running on aarch64:
  1. Configure compute to use hugepages.
  2. Set mem_page_size="2048" for a flavor
  3. Launch a VM using the above flavor.
  
  Expected result:
  VM should be launched with hugepages and the libvirt xml should have
  
    
    
  
    
    
  
  Actual result:
  VM is launched without hugepages.
  
  There are no error logs in nova-scheduler.
  
  [Regression Risk]
- Risk is minimized by the fact that this change is just enabling the same code 
for arm64 that is already enabled for the i386, amd64 and ppc64el Ubuntu 
architectures.
+ Risk is minimized by the fact that this change is just enabling the same code 
for arm64 that is already enabled for Ubuntu/x86.

** Patch added: "lp1623871-y.patch"
   
https://bugs.launchpad.net/ubuntu/+source/nova/+bug/1623871/+attachment/4749709/+files/lp1623871-y.patch

** Description changed:

  [Impact]
  Although aarch64 supports spawning a vm with hugepages, in nova code, the 
libvirt driver considers only x86_64 and I686. Both for NUMA and Hugepage 
support, AARCH64 needs to be added. Due to this bug, vm can not be launched 
with hugepage using OpenStack on aarch64 servers.
+ 
+ Note: this depends on the fix for LP: #1627926.
  
  [Test Case]
  Steps to reproduce:
  On an openstack environment running on aarch64:
  1. Configure compute to use hugepages.
  2. Set mem_page_size="2048" for a flavor
  3. Launch a VM using the above flavor.
  
  Expected result:
  VM should be launched with hugepages and the libvirt xml should have
  
    
    
  
    
    
  
  Actual result:
  VM is launched without hugepages.
  
  There are no error logs in nova-scheduler.
  
  [Regression Risk]
  Risk is minimized by the fact that this change is just enabling the same code 
for arm64 that is already enabled for Ubuntu/x86.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

** Changed in: nova (Ubuntu)
   Status: New => Triaged

** Changed in: nova (Ubuntu Xenial)
   Status: New => Triaged

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1623871] Re: Nova hugepage support does not include aarch64

[dann frazier]

** Also affects: nova (Ubuntu)
   Importance: Undecided
   Status: New

** Also affects: nova (Ubuntu Xenial)
   Importance: Undecided
   Status: New

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1623871

Title:
  Nova hugepage support does not include aarch64

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1623871/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs