Ubuntu QA 9.10 Roadmap

Bugs

Triage

• Specialization Within bug-control

  • Encouraging specialisation and mentoring in bug-control. High PedroVillavicencio

• Package Greasemonkey Scripts

  • Create a native Ubuntu package and/or a team PPA. - Medium BrianMurray

Tracking & Fixing

• Fixing Bugs With Patches

  • A session with engineering teams on processing bugs with patches attached. High (i) BrianMurray

• Regression Immunisation

  • Put in place procedures to discover major upstream infrastructure changes early and chart the regression potential inherent in these for our users. Use this information at around Feature Freeze to decide whether to push out the new changes or roll back. High (i) DaveMurphy

Apport

• Increase Apport Adoption

  • Adjust documentation and Launchpad functionality to steer more people towards using apport. Push back on various groups in turn to file correctly. Essential HenrikOmma

• Increase Apport Coverage

  • The QA team will drive an effort to extend coverage of apport hooks to all core Ubuntu components. Medium (i) BrianMurray

• Apport In ubuntu-server

  • Discussion with server team about including apport by default as well as increasing Apport coverage for server packages. Medium SteveBeattie

Testing

Test coverage

• Expand Test Coverage

  • What tests do we need to include, and how to test them e.g. Webcam, Audio, Printing, etc. General spec for tracking extending test coverage. Essential RonaldMcCollam

• Extended Audio Testing

  • Extend both manual and automated test cases to test a range of use cases and hardware configurations on a regular basis. High RonaldMcCollam

• Suspend-Resume Testing

  • Integrate the kernel team's suspend-resume script more fully in the certification test setup, both as a fully automated and as a prompted test. High LeannOgasawara

• Daily Desktop Testing

  • Add desktop tests to the daily hardware testing schedule on laptops and netbooks. High EitanIsaacson

Install & upgrade

• Live CD pre-seed testing

  • Uses Ubiquity pre-seeding. Essential MarcTardif

• Package Testing

  • Setting up regular conflict-checker runs. High RonaldMcCollam

• Distribution Upgrade Testing

  • Automated or semi-automated test distribution upgrades (i.e. jaunty -> Karmic). Coordination with Michael Vogt who already does some automated tests. Medium SteveBeattie

• UNR Testing Automation

  • Perform install testing of UNR images on all laptop and netbook class devices as part of a regular testing - Incorporate automated desktop UNR tests from the OEM and Mobile teams. Medium RonaldMcCollam

Infrastructure

• Metrics Based Testing

  • Track the evolution of certain parameters such as boot speed and power usage that may not have a clear pass/fail threshold but for which historical data is desireable. We will extend out infrastructure to collect and display such data. Essential MarcTardif

• Virtual Testing Environments

  • Use regularly updated KVM instances that can be downloaded with various versions of Ubuntu for testing and debugging. Also consider instances that people can log into remotely. Medium SteveBeattie

• Testing Weather Report

  • A web application similar to the Ubuntu release weather report oriented towards Ubuntu pre-release testers that will display various bits of relevant information on the state of the development branch. Medium MuratGüneş

• Checkbox Enhancements

  • Various modifications to Checkbox to a) improve the user experience and b) provide required functionality for other Checkbox related blueprints.

• Checkbox Wishlist

  • Further modifications to Checkbox that are low priority or not fully defined. Although they are targeted for Karmic, they will only be tackled if there is time.

• Integrating Test Suites in Checkbox Using Filters

  • Use a filter pattern to integrate suites and metrics testing. - Medium MarcTardif

Key:

• - Needs drafting

• - Needs cleanup/review/more drafting

• - Approved