Troubleshooting

The harness provides information in the following topics that you can use to troubleshoot problems:

Exit Codes

When the harness exits, it displays an exit code that you can use to determine the exit state. The following table contains a detailed description of the exit codes.

Exit Code Description
0 If tests were executed, all tests had passed results.
1 One or more tests were executed and had failed results.
2 One or more tests were executed and had errors.
3 A problem exists with the command-line arguments.
4 Harness internal error exists.

Harness Fails During Use

If the harness fails, you can use the harness.trace file in your work directory to troubleshoot the problem. The harness.trace file is a plain-text file that contains a log of harness activities during the test run. It is written in the work directory, is incrementally updated, and is intended primarily as a log of harness activity.

Problems Running Tests

The goal of a test run is for all tests in the test suite that are not filtered out to have passing results.

If the root test suite folder contains tests with errors or failing results, you must troubleshoot and correct the cause to successfully complete the test run. See Troubleshooting With the GUI in the Graphical User Interface User's Guide for information about the resources that the harness provides for troubleshooting.

Tests With Errors

Tests with errors are tests that could not be executed by the harness. These errors usually occur because the test environment is not properly configured. Use the GUI Test tabbed panes and configuration editor window to help determine the change required in the configuration. See Troubleshooting With the GUI in the Graphical User Interface User's Guide for information about the resources that the harness provides for troubleshooting.

Tests That Fail

Tests that fail are tests that were executed but had failing results. The test or the implementation may have errors.

Use the GUI Test Manager tabbed panes to identify and correct a test failure. See Troubleshooting With the GUI in the Graphical User Interface User's Guide for information about the resources that the harness provides for troubleshooting.

Problems Viewing Reports

The harness does not automatically generate reports of test results after a test run. You must generate test reports either from the command line or from the GUI.

Problems Writing Reports

You use filters to write test reports for a specific set of test criteria. Verify that you are using the appropriate filter to generate reports of test results. See Creating Reports in the Graphical User Interface User's Guide.

Problems Moving Reports

Test reports contain relative and fixed links to other files that may be broken when you move reports to other directories.

You must update these links when moving reports to other directories. The harness provides an EditLinks utility that updates the links in the reports for you when moving reports.


Copyright © 2001, 2010, Oracle and/or its affiliates. All rights reserved.