[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: Update 20111001: Current ISO testing framework has been frozen; its not really maintainable past its current function in its current form. Framework will be re-factored to be more re-usable as part of work in the QA team. Work items that depend on new features postponed until precise+1. Requirements will be fed to the QA team. Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: Update ubuntu-server-iso-testing framework to support missing test cases: DONE Separate test configuration from framework codebase: DONE Work items precise-alpha-2: Write Multi-LVM test case: DONE Write RAID test case: DONE Work items precise-beta-1: Update test framework to support iSCSI testing: POSTPONED Write iSCSI root test cases: POSTPONED Work items precise-beta-2 Automated testing of orchestra: POSTPONED + Tactical solution for automated iSCSI testing: DONE Work items: - Expand manual test cases to cover options presented during install: TODO + Expand manual test cases to cover options presented during install: POSTPONED Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): DONE Questions/comments: What do you think Automated testing of preseed network installations using orchestra will include? --Daviey Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: + Update 20111001: + + Current ISO testing framework has been frozen; its not really + maintainable past its current function in its current form. + + Framework will be re-factored to be more re-usable as part of work in + the QA team. + + Work items that depend on new features postponed until precise+1. + Requirements will be fed to the QA team. + + + Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: Update ubuntu-server-iso-testing framework to support missing test cases: DONE Separate test configuration from framework codebase: DONE Work items precise-alpha-2: Write Multi-LVM test case: DONE Write RAID test case: DONE Work items precise-beta-1: - Update test framework to support iSCSI testing: TODO - Write iSCSI root test cases: TODO + Update test framework to support iSCSI testing: POSTPONED + Write iSCSI root test cases: POSTPONED Work items precise-beta-2 - Automated testing of orchestra: TODO + Automated testing of orchestra: POSTPONED Work items: Expand manual test cases to cover options presented during install: TODO - Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO + Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): DONE Questions/comments: What do you think Automated testing of preseed network installations using orchestra will include? --Daviey Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Robbie Williamson: Assignee: Ubuntu Server Team = James Page -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Robbie Williamson: Drafter: James Page = Ubuntu Server Team -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Robbie Williamson: Approver: Robbie Williamson = Dave Walker -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: - Update ubuntu-server-iso-testing framework to support missing test cases: TODO + Update ubuntu-server-iso-testing framework to support missing test cases: DONE Separate test configuration from framework codebase: DONE - Expand manual test cases to cover options presented during install: TODO Work items precise-alpha-2: Write Multi-LVM test case: DONE - Write RAID test case: TODO + Write RAID test case: DONE + + Work items precise-beta-1: + Update test framework to support iSCSI testing: TODO Write iSCSI root test cases: TODO - Work items precise-alpha-3: + Work items precise-beta-2 Automated testing of orchestra: TODO Work items: + Expand manual test cases to cover options presented during install: TODO Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO Questions/comments: What do you think Automated testing of preseed network installations using orchestra will include? --Daviey Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: Update ubuntu-server-iso-testing framework to support missing test cases: TODO - Separate test configuration from framework codebase: INPROGRESS + Separate test configuration from framework codebase: DONE Expand manual test cases to cover options presented during install: TODO Work items precise-alpha-2: - Write Multi-LVM test case: INPROGRESS + Write Multi-LVM test case: DONE Write RAID test case: TODO Write iSCSI root test cases: TODO Work items precise-alpha-3: Automated testing of orchestra: TODO Work items: Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO Questions/comments: What do you think Automated testing of preseed network installations using orchestra will include? --Daviey Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: Update ubuntu-server-iso-testing framework to support missing test cases: TODO - Separate test configuration from framework codebase: TODO + Separate test configuration from framework codebase: INPROGRESS Expand manual test cases to cover options presented during install: TODO Work items precise-alpha-2: - Write Multi-LVM test case: TODO + Write Multi-LVM test case: INPROGRESS Write RAID test case: TODO Write iSCSI root test cases: TODO Work items precise-alpha-3: Automated testing of orchestra: TODO Work items: Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO Questions/comments: What do you think Automated testing of preseed network installations using orchestra will include? --Daviey Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Dave Walker: Definition Status: Pending Approval = Approved -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: Update ubuntu-server-iso-testing framework to support missing test cases: TODO Separate test configuration from framework codebase: TODO Expand manual test cases to cover options presented during install: TODO Work items precise-alpha-2: Write Multi-LVM test case: TODO Write RAID test case: TODO Write iSCSI root test cases: TODO Work items precise-alpha-3: - Automated testing of preseed network installations using orchestra: TODO + Automated testing of orchestra: TODO Work items: Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO Questions/comments: What do you think Automated testing of preseed network installations using orchestra will include? --Daviey Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Definition Status: Discussion = Pending Approval -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Dave Walker: Whiteboard changed: Summary of Objectives for Precise: 1) Fill gaps in current server ISO testing scope - Multi LVM layout test - RAID tests - iSCSI root tests 2) Automated testing of preseeded network installations using orchestra - Cover mini.iso testing for all supported releases. 3) Separate ubuntu-server-iso-testing into framework and tests - Easier management of tests without rebuilding packages - Support for multiple releases much easier. 4) Investigate frameworks for testing the actual installation experience Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p -iso-install-testing Work items precise-alpha-1: Update ubuntu-server-iso-testing framework to support missing test cases: TODO Separate test configuration from framework codebase: TODO Expand manual test cases to cover options presented during install: TODO Work items precise-alpha-2: Write Multi-LVM test case: TODO Write RAID test case: TODO Write iSCSI root test cases: TODO Work items precise-alpha-3: Automated testing of preseed network installations using orchestra: TODO Work items: Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO + + Questions/comments: + What do you think Automated testing of preseed network installations using orchestra will include? --Daviey + Thanks -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard changed: - Scope: Installation of Ubuntu Server from ISO (amd64 and i386) - Coverage: - Default Ubuntu Server - - LVM Install - - Non-LVM Install - - Multi-LVM Install - GAP - - RAID Install - GAP - - iSCSI root Install - GAP - Minimal Virtual Server - Current Tasksel - Bind9 Server - LAMP - Mail Server - OpenSSH Server - PostgreSQL Server - Print Server - Samba Server - Tomcat Server - Virtualization Host + Summary of Objectives for Precise: - Objective: - Verifcation that - a) Single server installs in simple deployments from ISO work OK - b) Bootstrap deployments in Data Centre deployments work OK - - Method: ubuntu-server-iso-testing project - Current Frequency: Daily on production of new ISO images for development release + 1) Fill gaps in current server ISO testing scope + - Multi LVM layout test + - RAID tests + - iSCSI root tests - Questions/Proposals: - [james-page] Should we also be re-testing the released ISO's on a daily basis to ensure that -updates are not breaking installs. - [james-page] What additional tasks are we going to add in Precise? Orchestra stuff for example would need to be added to the list. - [james-page] We need to check if failsafe has been triggered across all installs as this is indicative of a bug. + 2) Automated testing of preseeded network installations using orchestra + - Cover mini.iso testing for all supported releases. - Work Items: - Update framework to support missing test cases: TODO + 3) Separate ubuntu-server-iso-testing into framework and tests + - Easier management of tests without rebuilding packages + - Support for multiple releases much easier. + + 4) Investigate frameworks for testing the actual installation experience + + Full session notes from UDS-P: http://pad.ubuntu.com/uds-p-servercloud-p + -iso-install-testing + + Work items precise-alpha-1: + Update ubuntu-server-iso-testing framework to support missing test cases: TODO + Separate test configuration from framework codebase: TODO + Expand manual test cases to cover options presented during install: TODO + + Work items precise-alpha-2: Write Multi-LVM test case: TODO Write RAID test case: TODO Write iSCSI root test cases: TODO + + Work items precise-alpha-3: + Automated testing of preseed network installations using orchestra: TODO + + Work items: + Investigation into potential frameworks for visual testing of server and desktop installs (speak to QA): TODO -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by James Page: Whiteboard set to: Scope: Installation of Ubuntu Server from ISO (amd64 and i386) Coverage: Default Ubuntu Server - LVM Install - Non-LVM Install - Multi-LVM Install - GAP - RAID Install - GAP - iSCSI root Install - GAP Minimal Virtual Server Current Tasksel Bind9 Server LAMP Mail Server OpenSSH Server PostgreSQL Server Print Server Samba Server Tomcat Server Virtualization Host Objective: Verifcation that a) Single server installs in simple deployments from ISO work OK b) Bootstrap deployments in Data Centre deployments work OK Method: ubuntu-server-iso-testing project Current Frequency: Daily on production of new ISO images for development release Questions/Proposals: [james-page] Should we also be re-testing the released ISO's on a daily basis to ensure that -updates are not breaking installs. [james-page] What additional tasks are we going to add in Precise? Orchestra stuff for example would need to be added to the list. [james-page] We need to check if failsafe has been triggered across all installs as this is indicative of a bug. Work Items: Update framework to support missing test cases: TODO Write Multi-LVM test case: TODO Write RAID test case: TODO Write iSCSI root test cases: TODO -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Robbie Williamson: Definition Status: Drafting = Discussion -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
[Blueprint servercloud-p-iso-install-testing] Ubuntu Server ISO Testing
Blueprint changed by Robbie Williamson: Priority: Undefined = Essential -- Ubuntu Server ISO Testing https://blueprints.launchpad.net/ubuntu/+spec/servercloud-p-iso-install-testing -- Ubuntu-server-bugs mailing list Ubuntu-server-bugs@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-server-bugs
