NewGuide
|
Size: 2272
Comment:
|
Size: 1970
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 2: | Line 2: |
| = Testcase Formats = Two formats are currently recognized for use. For most testcases, the testcase should look like one of these: |
||<tablestyle="float:right; font-size: 0.9em; width:40%; background:#F1F1ED; margin: 0 0 1em 1em;" style="padding:0.5em;"><<TableOfContents>>|| = Testcase types = Two types of testcases are currently recognized for use; normal and smoke. |
| Line 5: | Line 6: |
| == Normal Testcase == ||<tablestyle="margin-left: -20px !important; line-height: 1em !important;" style="width: 20px;">|| || ||<-2> '''1. Perform X action''' || || || ''Expect Y result'' || ||<-2> '''2. Perform A action''' || || || ''Expect B result'' || || || ''Expect C result'' || |
=== Normal Testcase === This testcase is intended to provide step by step instructions, followed by an expected result for each step. To perform the testcase, read the perform action, and then verify the expected result step. If there is no expected result for the action, simply continue on performing the next action until the test is complete. |
| Line 13: | Line 10: |
| '''If all actions produce the expected results listed, please submit a 'passed' result.<<BR>> If an action fails, or produces an unexpected result, please submit a 'failed' result and file a bug. Please be sure to include the bug number when you submit your result.''' |
=== Smoke Testcase === This testcase is intended to ask generalized questions for you to answer before rendering a pass or fail result. The questions are used as an aide to help you test the image, package, hardware, etc that is intended. By design, these testcases are open-ended and require the user to think critically about if the item being tested has regressed or otherwise contains any bugs. To do this, the user must go through there own personal use-cases, and checking the results against there own expectations. This requires more user knowledge of the item being tested. |
| Line 16: | Line 13: |
| == Smoke Testcase == ||<tablestyle="margin-left: -20px !important; line-height: 1em !important;">'''1. Question 1?'''|| ||'''2. Question 2?'''|| ||'''3. Question 3?'''|| |
= Contributing Testcases = If you are [[https://launchpad.net/ubuntu-manual-tests|contributing a new manual testcase]], the text must include formatting to ensure it shows up visually correct on the qatracker. The following shows the markup required for all testcases. The current testcases in the repository will show the same markup applied. |
| Line 21: | Line 16: |
| '''If you answer 'yes' to all questions, please submit a 'passed' result.<<BR>> If you answer 'no' to any question, then please submit 'failed' and file a bug. Please be sure to include the bug number when you submit your result.''' == Syntax for Admins == === Normal Testcase === |
=== Testcase Format === |
| Line 27: | Line 18: |
| <h2>Testcase name <span>test-case-number-001</span></h2> <p>A brief description what the desired outcome and area of focus for the testcase is, if it isn't obvious after reading the testcase instructions.</p> |
|
| Line 34: | Line 28: |
<strong>If all actions produce the expected results listed, please <a href="results#add_result">submit</a> a 'passed' result. If an action fails, or produces an unexpected result, please <a href="results#add_result">submit</a> a 'failed' result and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong> |
|
| Line 38: | Line 29: |
| === Smoke Testcase === {{{ <dl> <dt>Question 1?</dt> <dt>Question 2?</dt> <dt>Question 3?</dt> </dl> <strong>If you answer 'yes' to all questions, please <a href="results#add_result">submit</a> a 'passed' result. If you answer 'no' to any question, then please <a href="results#add_result">submit</a> 'failed' and <a href="../../buginstructions">file a bug</a>. Please be sure to include the bug number when you <a href="results#add_result">submit</a> your result.</strong> }}} |
Testcase types
Two types of testcases are currently recognized for use; normal and smoke.
Normal Testcase
This testcase is intended to provide step by step instructions, followed by an expected result for each step. To perform the testcase, read the perform action, and then verify the expected result step. If there is no expected result for the action, simply continue on performing the next action until the test is complete.
Smoke Testcase
This testcase is intended to ask generalized questions for you to answer before rendering a pass or fail result. The questions are used as an aide to help you test the image, package, hardware, etc that is intended. By design, these testcases are open-ended and require the user to think critically about if the item being tested has regressed or otherwise contains any bugs. To do this, the user must go through there own personal use-cases, and checking the results against there own expectations. This requires more user knowledge of the item being tested.
Contributing Testcases
If you are contributing a new manual testcase, the text must include formatting to ensure it shows up visually correct on the qatracker. The following shows the markup required for all testcases. The current testcases in the repository will show the same markup applied.
Testcase Format
<h2>Testcase name <span>test-case-number-001</span></h2>
<p>A brief description what the desired outcome and area of focus for the
testcase is, if it isn't obvious after reading the testcase instructions.</p>
<dl>
<dt>Perform X action</dt>
<dd>Expect Y result</dd>
<dt>Perform A action</dt>
<dd>Expect B result</dd>
<dd>Expect C result</dd>
</dl>Testing/TestCaseFormat/NewGuide (last edited 2013-06-25 21:12:48 by nblzone-227-162)