2# Outline a bit more detail of what Cert and QA Deb testing will
exactly cover

   - Cert: Certification testing covers snapd snap only, it does not test the 
snapd deb, but it is still very relevant because it exercises the same go code 
on certified hardware and  customer devices (e.g. IOT customers who pay for the 
service). Test are based on checkbox and results are results presented on test 
observer. There are too many test to try and summarize here and many devices 
they are run on.
     - Use VPN to have a look around (see results for list of things tested) 
https://test-observer.canonical.com/#/snaps/79518
     - Currently they cover amd64, arm64 and armhf and we are working with them 
to enable riscv64
     - Created task for next cycle to document devices, architectures and 
features covered here: https://warthogs.atlassian.net/browse/SNAPDENG-34627
     - We are starting on a task this cycle to improve coverage for enterprise 
scenarios, part of which will likely be added to certification tests: 
https://warthogs.atlassian.net/browse/SNAPDENG-34424
 

  - QA deb testing covers all snapd functional and integration tests with more 
than 60K permutations on all supported ubuntu and ubuntu core releases on 
arm64, armhf, and amd64  
https://drive.google.com/file/d/1DeWC5yclLjmGcr7TSqMkwXvTkn69DVwl/view?usp=sharing
  - It includes the full set of unit tests on each of the systems/arches
  - "deb testing" refers the the fact the re-execution is disabled to ensure to 
runs all the test using the deb installed from -proposed.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/2089691

Title:
  [SRU] 2.67.1

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/snapd/+bug/2089691/+subscriptions


-- 
ubuntu-bugs mailing list
[email protected]
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

Reply via email to