test execution reports - Testersuite help

Six standard reports are available for the phase test execution in a Test cycle . If desired, you can generate these reports by test type. For example, do you want to know the progress of performing tests for the User Acceptance Test? Then select this test type in the report.

Test runs with the status Cancelled are not shown in the test run reports. You can manually set the status of test runs to Cancelled. See also Test run status.

Below is a description of the six test execution reports.

1. Progress of test scenarios.
This report shows the progress of the execution of test scenarios. For each status, the number of test scenarios is shown. The status of a test scenario is determined by the statuses of the test cases in a test scenario. This works as follows:

Situation	Test scenario status
All test cases have the status Not started	Not started
All test cases have the status Ok or Skipped	Ok
One or more test cases have the status Not Ok	Not Ok
All test cases have the status Skipped	Skipped
In all other cases	Started

At the top of the report it is possible to filter on Test type (Unit test, System test etc.)
Furthermore, it is possible to filter on start and end date of the test runs
Display possibilities: only the table display

Example of this report:

2. Progress of test cases per product risk
This report shows the progress of the execution of test cases per product risk. A classification is made based on the risk of the product a test case is related to in combination with the execution status of the test case. When a test case is linked to a requirement, the risk of the product to which the requirement is linked is taken. It may be that the report shows a category No product risk . Test cases can fall into that category for two reasons:
1. The test case has no relationship to a product (and thus no product risk)
2. The test case has a relationship with a product but the product has no risk

At the top of the report it is possible to filter on Test type (Unit test, System test etc.)
Furthermore, it is possible to filter on start and end date of the test runs
Display options: Bar chart, Table, Progress bars
The bar chart offers an additional possibility to filter by clicking on and off the items in the legend, on the right of the report.

Example of this report:

3. Progress test cases per product/requirement
This report shows the progress of the execution of test cases per product and requirement.

Example of this report:

4. Progress of test cases per tester
This report shows the progress of the execution of test cases per tester.

Example of this report:

5. Progress of test steps per product/requirement.
This report works the same as the report '3. Progress of test cases per product/requirement'. The difference is that in this report not the number of test cases but the number of test steps within the test cases are shown. This allows for an even more detailed view of the progress. It may happen that there are large differences between the numbers of test steps per test case. In that case the report "Progress test cases per product/requirement" gives a less good picture of the progress.

6. Progress of test steps per tester.
This report works the same as the report '4. Progress of test cases per tester'. The difference is that in this report not the number of test cases but the number of test steps within the test cases are shown. This allows the progress to be viewed in even more detail. It may happen that there are large differences between the number of test steps per test case. In that case the report '4. Progress of test cases per tester' gives a less good picture of the progress.