??? The procedures for adjudication of tests and the resolution of disagreements.
??? The criteria for acceptance and certification if not all the tests have been passed by the release.
FIGURE 8.6
Alternative boilerplate test plan specification of suspension criteria (type)
FIGURE 8.7 Boilerplate test plan specification of resumption criteria
FIGURE 8.8 Boilerplate test plan specification of system test ending criteria
Example:
Testing will be discontinued on any build if one of the following conditions is encountered:
For all the following categories
??? Performance bug (PF);
??? Data bug (DA)
??? Logic bug (LO)
??? Feature bug (CA)
The following aggregate number of bugs is found:
??? 2 severity 1 bugs
??? 3 severity 2 bugs
??? 8 priority 3 bugs
Testing will not be halted for any lower-severity bug. Testing will resume when a new release is available. The test
execution order will then be:
??? Smoke and con?¬?dence tests.
??? The tests which found the bugs which have just been ?¬?xed
??? The regression tests
??? The rest of the tests
Criteria for system test resumption
??? The requisite tests have been modified and/or the missing functionality is believed to have been added.
??? A new build and release note have been provided.
Criteria for system test end
System testing implies a handover (to some other group, or a customer). The following criteria must thus have
been met for this to happen:
??? The release has been provided on CD with a release note explaining known weak points, or un?¬?xed bugs.
Pages:
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318