CallforTesting

Differences between revisions 2 and 3
Revision 2 as of 2012-07-23 20:47:57
Size: 3325
Editor: adsl-98-70-56-36
Comment:
Revision 3 as of 2012-07-23 20:50:44
Size: 3371
Editor: adsl-98-70-56-36
Comment:
Deletions are marked like this. Additions are marked like this.
Line 8: Line 8:
Have a look at http://packages.qa.ubuntu.com/qatracker/milestones/223/builds. Let's point out the different pieces: Have a look at [[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds|the Kernel testing]] as an example. Let's point out the different pieces:
Line 10: Line 10:
Quick summary of all the versions of the software, number of testers and bugs found (rollover the bugs to get additional details):
http://packages.qa.ubuntu.com/qatracker/milestones/223/history
[[http://packages.qa.ubuntu.com/qatracker/milestones/223/history|Quick summary of all the versions of the software, number of testers and bugs found (rollover the bugs to get additional details)]]
Line 13: Line 12:
Testcases for the software. Notice the link to the [[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/downloads|installation instructions]] and [[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/buginstructions|bug reporting instructions]]
http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/testcases
[[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/testcases|Testcases for the software]]. Notice the link to the [[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/downloads|installation instructions]] and [[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/buginstructions|bug reporting instructions]]
Line 16: Line 14:
Detailed results for the specifc version selected. Notice the usernames of the tester, bugs, the pass/fail indications and comments:
http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/testcases/1306/results
[[http://packages.qa.ubuntu.com/qatracker/milestones/223/builds/19062/testcases/1306/results|Detailed results for the specifc version selected]]. Notice the usernames of the tester, bugs, the pass/fail indications and comments
Line 19: Line 16:
A list of bugs, and more information about bug status found for each piece of software under test:
http://packages.qa.ubuntu.com/qatracker/reports/defects
[[http://packages.qa.ubuntu.com/qatracker/reports/defects|A list of bugs, and more information about bug status found for each piece of software under test]]

Summary

A call for testing is meant to call attention to a particular piece of software for testing over a short time-frame in order to confirm and resolve and bugs and ready for general consumption. The QA community can install and test your software for bugs and usability and provide bug reports and feedback using the qatracker.

What do I get?

As a developer, you will get consolidated feedback on how many people tested, the bugs reported, and any comments they may have left while testing. In addition, you will be able to see this for each of your versions of the software -- meaning you can spot regressions and confirm fixes between versions.

What does it look like?

Have a look at the Kernel testing as an example. Let's point out the different pieces:

Quick summary of all the versions of the software, number of testers and bugs found (rollover the bugs to get additional details)

Testcases for the software. Notice the link to the installation instructions and bug reporting instructions

Detailed results for the specifc version selected. Notice the usernames of the tester, bugs, the pass/fail indications and comments

A list of bugs, and more information about bug status found for each piece of software under test

What do I need to do?

Coordinate with Nicholas Skaggs to setup a tracker for your software. You'll need to supply the following

  • Testcases
    • The testcases can be simple smoke tests (like, "Does the application "work"?"), but ultimately we would like to add more in-depth testcases for specific funcationality. The testcase format should be as follows -- (the QA Community coordinator can help you with this):
      • Perform X action
      • Expect Y result
  • Create a ppa with builds for each of your target releases.
  • Create instructions for installing (something like add the ppa, and install X package)
  • Create instructions for uninstalling (usually just ppa purge works)
  • Create instructions for reporting a bug. It's important to note what package you want the bug report against, and if multiple packages, which one to report for which reason. You may choose to use ubuntu-bug, or provide a pre-formmatted link to 'report a bug' on launchpad.

Then what happens?

With those pre-requisites completed, the QA community coordinator will verify the application, tests and the ppa. A new milestone for your package will be created and linked to you. A wide call for testing will go out to the greater ubuntu community, and users will utilize the tracker to report results.

Results

As results come in, the tracker will update to reflect the number of contributors, what tests are passing or failing, and what bugs are reported. Everything is public and availible via the tracker.

Testing/CallforTesting (last edited 2013-04-25 18:45:07 by adsl-98-70-42-80)