[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: POSTPONED update testing framework to make use of spare ec2 time: POSTPONED - investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO + investigate/implement automated reporting of test results to iso.qa.ubuntu.com: POSTPONED Work items: setup smoke testing of previous ubuntu release images: DONE investigate options for testing ubuntu cloud images on freecloud/canonistack: POSTPONED investigate options for testing ubuntu cloud images on eucalyptus: POSTPONED [james blair] freecloud should get full arm servers and integrate: POSTPONED consider test of arm disk images or arm partition images in LXC: POSTPONED -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE - Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: POSTPONED update testing framework to make use of spare ec2 time: POSTPONED investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: setup smoke testing of previous ubuntu release images: DONE - investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO + investigate options for testing ubuntu cloud images on freecloud/canonistack: POSTPONED investigate options for testing ubuntu cloud images on eucalyptus: POSTPONED - [james blair] freecloud should get full arm servers and integrate: TODO + [james blair] freecloud should get full arm servers and integrate: POSTPONED consider test of arm disk images or arm partition images in LXC: POSTPONED -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Dave Walker: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: - [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE + [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE setup separate mailing list for test notifications: POSTPONED Work items for precise-alpha-2: - [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO + [utlemming] update image promotion process to integrate with Jenkins automated testing: POSTPONED update testing framework to make use of spare ec2 time: TODO investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: setup smoke testing of previous ubuntu release images: INPROGRESS investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: POSTPONED - [james blair] freecloud should get full arm servers and integrate: TODO + [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: POSTPONED -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE setup separate mailing list for test notifications: POSTPONED Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: POSTPONED - update testing framework to make use of spare ec2 time: TODO + update testing framework to make use of spare ec2 time: POSTPONED investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: - setup smoke testing of previous ubuntu release images: INPROGRESS + setup smoke testing of previous ubuntu release images: DONE investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: POSTPONED [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: POSTPONED -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE - setup separate mailing list for test notifications: POSTPONED + Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: POSTPONED update testing framework to make use of spare ec2 time: POSTPONED investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: setup smoke testing of previous ubuntu release images: DONE investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: POSTPONED [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: POSTPONED -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE setup separate mailing list for test notifications: POSTPONED Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO update testing framework to make use of spare ec2 time: TODO investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: - setup smoke testing of previous ubuntu release images: INPROGRESS + setup smoke testing of previous ubuntu release images: DONE investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: TODO [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: TODO -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Dave Walker: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: - [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE + [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE setup daily testing for current development release: DONE setup separate mailing list for test notifications: POSTPONED Work items for precise-alpha-2: - [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO + [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO update testing framework to make use of spare ec2 time: TODO investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: - setup smoke testing of previous ubuntu release images: DONE + setup smoke testing of previous ubuntu release images: INPROGRESS investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO - investigate options for testing ubuntu cloud images on eucalyptus: TODO - [james blair] freecloud should get full arm servers and integrate: TODO - consider test of arm disk images or arm partition images in LXC: TODO + investigate options for testing ubuntu cloud images on eucalyptus: POSTPONED + [james blair] freecloud should get full arm servers and integrate: TODO + consider test of arm disk images or arm partition images in LXC: POSTPONED -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen Canonistack? FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: a) An initial smoke test b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: - [james-page] agree funding of daily AMI testing/cost modelling for justification: INPROGRESS - setup daily testing for current development release: TODO - setup separate mailing list for test notifications: TODO + [james-page] agree funding of daily AMI testing/cost modelling for justification: DONE + setup daily testing for current development release: DONE + setup separate mailing list for test notifications: POSTPONED Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO update testing framework to make use of spare ec2 time: TODO investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: - setup smoke testing of previous ubuntu release images: TODO + setup smoke testing of previous ubuntu release images: INPROGRESS investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: TODO [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: TODO -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Robbie Williamson: Drafter: James Page = Ubuntu Server Team -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Robbie Williamson: Approver: Robbie Williamson = Dave Walker -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Dave Walker: Definition Status: Pending Approval = Approved -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Definition Status: Review = Pending Approval -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Definition Status: Discussion = Review -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise 1) Daily Smoke Testing of Ubuntu AMI's Triggered from cloud image query information. Should cover all images. Check that they boot. Verify each AMI once only. 2) Daily AMI testing for the development release Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. 3) Daily Testing of Cloud Images In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: Eucalyptus - Eucalyptus Community Cloud? + Eucalyptus Community Cloud? OpenStack - including KVM and LXC and Xen - Canonistack? - FreeCloud (NTT and RackSpace)? + Canonistack? + FreeCloud (NTT and RackSpace)? 4) Full Testing of Release Ubuntu Images Automated testing will be built into the twice weekly image release publishing process and will cover: - a) An initial smoke test - b) Followed by full image testing + a) An initial smoke test + b) Followed by full image testing Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p -cloud-image-testing Work items for precise-alpha-1: - agree funding of daily AMI testing/cost modelling for justification: TODO + [james-page] agree funding of daily AMI testing/cost modelling for justification: INPROGRESS setup daily testing for current development release: TODO setup separate mailing list for test notifications: TODO Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO update testing framework to make use of spare ec2 time: TODO investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO Work items: setup smoke testing of previous ubuntu release images: TODO investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: TODO [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: TODO -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Scope: Official ec2 images for Ubuntu Server across all regions for amd64 and i386 Coverage: All regions All zones All types Multi-instance Tests: simple-user-data multipart-user-data cloud-config default (no use of metadata service) Objective: a) Verification that ec2 images boot, reboot and shutdown OK b) Verification that cloud-unit is working OK in images Method: ubuntu-server-ec2-testing project Current Frequency: Candidates for Development Milestones only. Questions/Proposals: [james-page] We should be performing a daily test of ec2 images across all regions during development [james-page] We published new AMI's for most existing Ubuntu releases - but they don't get verified as good [james-page] Reporting of results is currently awkward between jenkins and iso tracker - this needs to be automated/easier [james-page] We should test the generic cloud image on OpenStack on a daily basis as well. Work Items: + agree funding of daily AMI testing/cost modelling for justification: TODO + setup daily testing for current development release: TODO + setup separate mailing list for test notifications: TODO + [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO + setup smoke testing of previous ubuntu release images: TODO + update testing framework to make use of spare ec2 time: TODO + investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO + investigate options for testing ubuntu cloud images on eucalyptus: TODO + investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO + [james blair] freecloud should get full arm servers and integrate: TODO + consider test of arm disk images or arm partition images in LXC: TODO -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: - Scope: Official ec2 images for Ubuntu Server across all regions for amd64 and i386 - Coverage: - All regions - All zones - All types - Multi-instance - Tests: - simple-user-data - multipart-user-data - cloud-config - default (no use of metadata service) + Summary of Objectives for Precise - Objective: - a) Verification that ec2 images boot, reboot and shutdown OK - b) Verification that cloud-unit is working OK in images + 1) Daily Smoke Testing of Ubuntu AMI's + Triggered from cloud image query information. + Should cover all images. + Check that they boot. + Verify each AMI once only. - Method: ubuntu-server-ec2-testing project - Current Frequency: Candidates for Development Milestones only. + 2) Daily AMI testing for the development release + Precise should implement daily image testing using basic smoke test to ensure that the AMI is always usable during the development cycle. - Questions/Proposals: - [james-page] We should be performing a daily test of ec2 images across all regions during development - [james-page] We published new AMI's for most existing Ubuntu releases - but they don't get verified as good - [james-page] Reporting of results is currently awkward between jenkins and iso tracker - this needs to be automated/easier - [james-page] We should test the generic cloud image on OpenStack on a daily basis as well. + 3) Daily Testing of Cloud Images + In addition to the published AMI's, we should implement testing of the generic cloud images on the following cloud platforms: + Eucalyptus + Eucalyptus Community Cloud? + OpenStack - including KVM and LXC and Xen + Canonistack? + FreeCloud (NTT and RackSpace)? - Work Items: + 4) Full Testing of Release Ubuntu Images + Automated testing will be built into the twice weekly image release publishing process and will cover: + a) An initial smoke test + b) Followed by full image testing + Testing will likely be implemented using Jenkins and published to jenkins.qa.ubuntu.com. + + Full Notes from UDS-P session: http://pad.ubuntu.com/uds-p-servercloud-p + -cloud-image-testing + + Work items for precise-alpha-1: agree funding of daily AMI testing/cost modelling for justification: TODO setup daily testing for current development release: TODO setup separate mailing list for test notifications: TODO + + Work items for precise-alpha-2: [utlemming] update image promotion process to integrate with Jenkins automated testing: TODO + update testing framework to make use of spare ec2 time: TODO + investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO + + Work items: setup smoke testing of previous ubuntu release images: TODO - update testing framework to make use of spare ec2 time: TODO investigate options for testing ubuntu cloud images on freecloud/canonistack: TODO investigate options for testing ubuntu cloud images on eucalyptus: TODO - investigate/implement automated reporting of test results to iso.qa.ubuntu.com: TODO [james blair] freecloud should get full arm servers and integrate: TODO consider test of arm disk images or arm partition images in LXC: TODO -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard set to: Scope: Official ec2 images for Ubuntu Server across all regions for amd64 and i386 Coverage: All regions All zones All types Multi-instance Tests: simple-user-data multipart-user-data cloud-config default (no use of metadata service) Objective: a) Verification that ec2 images boot, reboot and shutdown OK b) Verification that cloud-unit is working OK in images Method: ubuntu-server-ec2-testing project Current Frequency: Candidates for Development Milestones only. Questions/Proposals: [james-page] We should be performing a daily test of ec2 images across all regions during development [james-page] We published new AMI's for most existing Ubuntu releases - but they don't get verified as good [james-page] Reporting of results is currently awkward between jenkins and iso tracker - this needs to be automated/easier [james-page] We should test the generic cloud image on OpenStack on a daily basis as well. Work Items: -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by James Page: Whiteboard changed: Scope: Official ec2 images for Ubuntu Server across all regions for amd64 and i386 Coverage: - All regions - All zones - All types - Multi-instance - Tests: - simple-user-data - multipart-user-data - cloud-config - default (no use of metadata service) + All regions + All zones + All types + Multi-instance + Tests: + simple-user-data + multipart-user-data + cloud-config + default (no use of metadata service) Objective: - a) Verification that ec2 images boot, reboot and shutdown OK - b) Verification that cloud-unit is working OK in images + a) Verification that ec2 images boot, reboot and shutdown OK + b) Verification that cloud-unit is working OK in images Method: ubuntu-server-ec2-testing project Current Frequency: Candidates for Development Milestones only. Questions/Proposals: [james-page] We should be performing a daily test of ec2 images across all regions during development [james-page] We published new AMI's for most existing Ubuntu releases - but they don't get verified as good [james-page] Reporting of results is currently awkward between jenkins and iso tracker - this needs to be automated/easier [james-page] We should test the generic cloud image on OpenStack on a daily basis as well. Work Items: -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Robbie Williamson: Priority: Undefined = Essential -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-cloud-image-testing] Ubuntu Server Cloud Image Testing
Blueprint changed by Robbie Williamson: Definition Status: Drafting = Discussion -- Ubuntu Server Cloud Image Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-cloud-image-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
