TestingProcessesUbuntuPersonal

Differences between revisions 2 and 5 (spanning 3 versions)
Revision 2 as of 2015-06-11 09:49:36
Size: 1661
Editor: 10
Comment:
Revision 5 as of 2015-06-11 11:26:10
Size: 2491
Editor: 107
Comment:
Deletions are marked like this. Additions are marked like this.
Line 7: Line 7:
vrruiz can you fill this section please
 * All merge proposals must have been reviewed and approved.
 * All automated tests must pass.
 * New features must come with automated tests.
 * New strings must be marked for translation.
Line 9: Line 14:

Install phablet-tools package in your desktop machine.

 * Flash the phone with the latest development image.
 * citrain device-upgrade <silo number> <password>
 * Overlay PPA
   * In case of Vivid + Overlay PPA, the silo packages need to be pinned to a higher priority. Otherwise, silo packages won't be installed.
   * Create /etc/apt/preferences.d/silo.pref file.
   * Add these lines:

{{{
Package: *
Pin: release o=LP-PPA-ci-train-ppa-service-landing-<silo number>
Pin-Priority: 1002
}}}
Line 10: Line 31:

  * [[https://wiki.ubuntu.com/Process/Merges/TestPlan/|List of test plans]].
Line 11: Line 35:
Any relevant silo bug should be added to the Regression Test Suite as draft.

WIP

There are a lot of new terms, tools and procedures we want to use for Testing on Ubuntu Personal. This page is here to document those processes.

Silo Testing

Prechecks

  • All merge proposals must have been reviewed and approved.
  • All automated tests must pass.
  • New features must come with automated tests.
  • New strings must be marked for translation.

Installation

Install phablet-tools package in your desktop machine.

  • Flash the phone with the latest development image.
  • citrain device-upgrade <silo number> <password>

  • Overlay PPA
    • In case of Vivid + Overlay PPA, the silo packages need to be pinned to a higher priority. Otherwise, silo packages won't be installed.
    • Create /etc/apt/preferences.d/silo.pref file.
    • Add these lines:

Package: *
Pin: release o=LP-PPA-ci-train-ppa-service-landing-<silo number>
Pin-Priority: 1002

Test Plan Locations

Reporting New Cases

Any relevant silo bug should be added to the Regression Test Suite as draft.

Tarball Testing

Prechecks

Installation

Test Plan Locations

Reporting New Cases

Sanity Testing

Prechecks

All silos are landed and all tarballs are landed.

Installation

Test Plan Locations

Reporting New Cases

Sanity is a deliberately selected small subset of tests targeting software interactions with hardware. Any additional tests felt required should be discussed with the entire team via the mailing list or standups.

Regression Testing

Prechecks

Sanity Must of been run to ensure the image is at least testable

Installation

Test Plan Locations

Reporting New Cases

New Cases should not be found while testing regression, however you may want make a note here(add a link later) to remind you to look at something during exploratory testing.

Exploratory Testing

Prechecks

Installation

Recording Test and Session

Reporting New Cases

If there is automation required here it should be reported as a bug for the development team.
If there are new manual cases they should be put into draft for review in practitest.

Automated Testing

Prechecks

Installation

Test Plan Locations

Reporting Of Failures

QATeam/TestingProcessesUbuntuPersonal (last edited 2015-12-03 13:56:01 by 1)