Testing
|
Size: 4131
Comment:
|
Size: 4299
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 5: | Line 5: |
| Testing is split into 3 main parts. | Testing is split into 2 main parts. 1. Contributing Tests 1. Contributing Results Most users will likely be interested in contributing test results for ubuntu during the jam. There are 3 different types of contributions that can be made. |
| Line 11: | Line 16: |
| The following descriptions can be used to help people decide how they want to participate. | The following descriptions can be used to help people decide which area they wish to contribute to. |
| Line 15: | Line 20: |
| Image or iso testing consists of downloading a copy of the latest daily ISO images, burning them to CDs/USB keys (or loading them into VM's) and testing them. This brings to light many issues that might have been missed by other early adopters and developers, especially in the CD builds and installers. | Image or iso testing consists of downloading a copy of the latest daily ISO images, burning them to CDs/USB keys (or loading them into VM's) and running through an installation with them. What's tested?: Iso image ubiquity / debian installer Requirements: * Launchpad/Ubuntu SSO account * Copy of the iso/image you wish to test Tutorials: [[https://wiki.ubuntu.com/Testing/ISO/Walkthrough|ISO Testing walkthrough]] |
| Line 19: | Line 36: |
| Application testing is the manual testing of specific things (test cases) in applications. Regression tests are specific tests for potential breakages from one release to another (they're also relevant for SRU testing, above). | Application testing is the manual testing of specific things (test cases) in applications. What's tested?: Specific ubuntu packages Requirements: * Launchpad/Ubuntu SSO account * Development version of ubuntu (installed or via live session from daily image) Tutorials: [[https://wiki.ubuntu.com/Testing/Cadence/Walkthrough|Cadence Testing Walkthrough]] ''Note, the ubuntu global milestone is incorporated with the normal cadence testing; hence the walkthrough is valid for the event'' |
| Line 23: | Line 52: |
| Hardware Testing is about the manual testing of specific things (test cases) mainly related to laptops hardware. The goal is to get Ubuntu to work great on as many different makes and models of laptops as possible and this can be done knowing which hardware works straight off the install CD and which hardware needs configuring or is poorly supported. | Hardware Testing is about the manual testing of specific things (test cases) mainly related to laptop hardware. Smoke tests are used to determine hardware compatibility for the system being tested. |
| Line 25: | Line 54: |
| = Requirements = | What's tested?: Hardware compatibility with ubuntu |
| Line 27: | Line 57: |
| A computer.<<BR>> A Launchpad Account.<<BR>> An image of the current daily development version of ubuntu<<BR>> A network connection.<<BR>> Finally a virtual machine, such as KVM/Qemu/Virtualbox, unless installing on hardware. |
Requirements: * Launchpad/Ubuntu SSO account * Development version of ubuntu (installed or via live session from daily image) * Laptop/Hardware for testing Tutorials: [[https://wiki.ubuntu.com/Testing/Laptop/Procedures|Laptop Testing Walkthrough]] |
| Line 43: | Line 76: |
| [[Testing/VirtualBox | Using VirtualBox (older version but works pretty much the same now).]]<<BR>> [[Testing/Automation/KVM | Towards the bottom half of the page gives you the general idea for a kvm command.]]<<BR>> |
[[Testing/VirtualBox | Using VirtualBox]]<<BR>> |
| Line 60: | Line 92: |
| === Application Testing === NOTE: Ubuntu global jam is a milestone, just like cadence testing. Thus the following tutorial can be followed. [[https://wiki.ubuntu.com/Testing/Cadence/Walkthrough|https://wiki.ubuntu.com/Testing/Cadence/Walkthrough]] |
If folks are interested in contributing testcases instead of results, direct them to the [[https://wiki.ubuntu.com/QATeam/ContributingTestcases|resources found on the QATeam wiki]]. In addition, refer them to the applicable launchpad project as needed. |
| Line 64: | Line 94: |
| === Install Testing === Follow the guide here: [[https://wiki.ubuntu.com/Testing/ISO/Walkthrough|https://wiki.ubuntu.com/Testing/ISO/Walkthrough]] === Hardware Testing === Boot your hardware up into a Live session, then follow: [[https://wiki.ubuntu.com/Testing/Laptop/Procedures|https://wiki.ubuntu.com/Testing/Laptop/Procedures]] |
[[https://launchpad.net/ubuntu-manual-tests|Ubuntu Manual Tests]] [[https://launchpad.net/ubuntu-autopilot-tests/|Ubuntu Autopilot Tests]] |
Testing Descriptions
Testing is split into 2 main parts.
- Contributing Tests
- Contributing Results
Most users will likely be interested in contributing test results for ubuntu during the jam. There are 3 different types of contributions that can be made.
- Image Testing.
- Application Testing
- Hardware Testing
The following descriptions can be used to help people decide which area they wish to contribute to.
Image Testing
Image or iso testing consists of downloading a copy of the latest daily ISO images, burning them to CDs/USB keys (or loading them into VM's) and running through an installation with them.
What's tested?: Iso image ubiquity / debian installer
Requirements:
- Launchpad/Ubuntu SSO account
- Copy of the iso/image you wish to test
Tutorials: ISO Testing walkthrough
Application Testing
Application testing is the manual testing of specific things (test cases) in applications.
What's tested?: Specific ubuntu packages
Requirements:
- Launchpad/Ubuntu SSO account
- Development version of ubuntu (installed or via live session from daily image)
Tutorials: Cadence Testing Walkthrough
Note, the ubuntu global milestone is incorporated with the normal cadence testing; hence the walkthrough is valid for the event
Hardware Testing
Hardware Testing is about the manual testing of specific things (test cases) mainly related to laptop hardware. Smoke tests are used to determine hardware compatibility for the system being tested.
What's tested?: Hardware compatibility with ubuntu
Requirements:
- Launchpad/Ubuntu SSO account
- Development version of ubuntu (installed or via live session from daily image)
- Laptop/Hardware for testing
Tutorials: Laptop Testing Walkthrough
Asking people to prepare for the Jam
Download a copy of the latest iso
Material
Important links:
The Iso Tracker.
The Package Tracker.
The Hardware Tracker.
Using VirtualBox
Holding the Session
You are encouraged to perform each type of testing in advance so you have a basic understanding of what to expect. In addition, it's encouraged for you to read the following pages:
https://wiki.ubuntu.com/Testing/QATracker
https://wiki.ubuntu.com/Testing/Activities
For each of the different types of testing a ubuntu global jam milestone should be setup on each tracker with the testcases ready to and and results ready to be reported against. See the tests on this milestone page
Note that unless folks are willing to do installations (via VM or real hardware) they will be testing using the live session of the image they brought with them (by booting it up into a VM or on real hardware).
Introduction Session
Provide an overview of each type of testing and let folks know they can choose to do any or all of the different types during the jam. Milestones will be setup on all three trackers, a summary of what all can be tested can be found on this milestone page.
If folks are interested in contributing testcases instead of results, direct them to the resources found on the QATeam wiki. In addition, refer them to the applicable launchpad project as needed.
Ubuntu Manual Tests Ubuntu Autopilot Tests
Tools & Helpful Information
Get help on #ubuntu-quality.
Jams/Testing (last edited 2015-07-28 21:25:13 by 1)