From Fedora Project Wiki

(create draft test case sop)
 
No edit summary
Line 23: Line 23:
== Process ==
== Process ==


To actually create a test case, use the [[Template:QA/Test_Case|test case template]]. If you visit that page, you will see instructions for how to use the template in another page. Create a page for your test case. The names of test case pages should always begin ''QA:Testcase_'', unless you particularly wish the test case to be outside the QA name space. Use the template and fill in the ''description'' section with a brief description of the test case, the ''setup'' section with pre-test setup instructions if appropriate, the ''actions'' section with the procedure for running the test, and the ''results'' section with the possible outcomes of the test (but do not include non-generic instructions for what to do in the case of certain outcomes: see [[Be generic]] section). Add the page to the appropriate categories. You should almost always add it to [[Category:Test_Cases]]; other categories will depend on the type of test case.
To actually create a test case, use the [[Template:QA/Test_Case|test case template]]. If you visit that page, you will see instructions for how to use the template in another page. Create a page for your test case. The names of test case pages should always begin ''QA:Testcase_'', unless you particularly wish the test case to be outside the QA name space. Use the template and fill in the ''description'' section with a brief description of the test case, the ''setup'' section with pre-test setup instructions if appropriate, the ''actions'' section with the procedure for running the test, and the ''results'' section with the possible outcomes of the test (but do not include non-generic instructions for what to do in the case of certain outcomes: see [[:Be generic]] section). Add the page to the appropriate categories. You should almost always add it to [[Category:Test_Cases]]; other categories will depend on the type of test case.

Revision as of 14:18, 20 December 2010

This SOP describes the best practices for creating for Fedora.

Background

A test case is a set procedure with a limited range of possible results, intended to be followed in order to test something. Test cases can be used to test all sorts of things, not just software code.

Principles

In creating test cases, please keep the following principles in mind.

Test one thing at a time

A test case should be single-purpose: each test case should test one function. Do not write one giant test case to test twenty different things. If you need to test multiple functions, write several test cases and join them together with a test plan.

Be comprehensive

Try to make the description of the test process and the possible results as comprehensive and detailed as possible. Try to think of any assumptions you may be making about the process and instead write them out explicitly. Examples include specifying whether a test should start with a clean installation of the software to be tested (or the distribution as a whole), or whether to create some initial configuration before running a test. Try to place yourself in the shoes of someone who is entirely unfamiliar with the function to be tested, and make sure they can successfully complete the test simply by following the procedure. Feel free to link to more explicit instructions elsewhere in the Wiki or on the web for any complex steps. Try to make your instructions as accessible as practical to those without advanced knowledge of the topic area, and use simple English.

Be generic

As far as is possible without compromising comprehensiveness, try to write the test case such that it will not go 'stale'. Try to ensure your test case will be usable for a long time without regular editing. This principle is best illustrated by examples: for instance, in writing a test to determine whether audio works on a default Fedora installation, you should not assume that the default desktop will always be what it currently is, or that the same set of applications will always be installed, so you should not write instructions that are specific to a particular desktop's method for checking volume settings, or to a particular media player. This also means not to include instructions in a test case which are specific to a particular event for which you are initially creating the test case: write the test case so it will be generically useful long past any specific test event, and include additional, event-specific test instructions in the page for the event. More generic tests can more easily be adapted to apply to cases you may not have considered, and will not become rapidly useless if you are not in a position to maintain them.

Process

To actually create a test case, use the test case template. If you visit that page, you will see instructions for how to use the template in another page. Create a page for your test case. The names of test case pages should always begin QA:Testcase_, unless you particularly wish the test case to be outside the QA name space. Use the template and fill in the description section with a brief description of the test case, the setup section with pre-test setup instructions if appropriate, the actions section with the procedure for running the test, and the results section with the possible outcomes of the test (but do not include non-generic instructions for what to do in the case of certain outcomes: see Be generic section). Add the page to the appropriate categories. You should almost always add it to; other categories will depend on the type of test case.