Process documentation
Test report FAQ
Before reporting a test report problem, please check for the most common causes of the problems. When approached, the first question that you will be asked is, "Did you check the Test report FAQ?"

 

1.0 Why aren't my test results included in the test report?

This is the most common question, and is usually caused by a problem in either the test suite or in the execution history.

2.0 Why are my test results showing up as <pass/fail/inconclusive> when I checked them in as something else?

So far, this problem has always been caused by the execution history. Check the Time Frame Historic report and see if it reports the result the same way. If it does, then open the execution history and check to see if the history was generated correctly.

3.0 Why does the Total column show the wrong count of test cases?

So far, this problem has always been caused by the test report generator. Double-check the Time Frame Historic report and if the problem is in the Tabular report alone, then open a bugzilla against Test.UI.Reporting.

4.0 Why is the Completion Rate > 100%?

This problem can be caused either by the test report generator or by a mismatch between the test suite and the execution history. If the test suite was changed after the execution history was generated, then this is expected.

5.0 Why is the Completion Rate < 100%?

This problem can be caused either by the test report generator or by a mismatch between the test suite and the execution history. If the test suite was changed after the execution history was generated, then this is expected.

6.0 How do I generate the Tabular report so that I can check if things are okay?

Download the tabular report code and instructions. (These are posted on the main Documentation page in the link Generating test reports and posting them on the TPTP web page.) You don't need to generate the entire AllManualTests; instead, you can generate on a single test suite or on its associated AllTests if you want to check just your own histories.

7.0 How often are test reports generated?

Test reports are generated only during a test pass week. They are generated on demand; either a PMC member or a Project Lead asks for them to be generated. If you want to see a report generated, you can do that yourself by following the instructions in 6.0 (generate the tabular report).