Auditing Test Results

The harness includes an audit tool that you can use to analyze the test results in a work directory. The audit tool verifies that all tests in a test suite ran correctly and identifies any audit categories in a test run with errors.

You can use the GUI or the command-line interface to audit a test run. See the Command-Line Interface User's Guide for a detailed description of auditing a test run from the command line.

Audit a Test Run

This is the start of a procedureTo audit a test run in the GUI, perform the following steps:

  1. Choose Tool > Test Results Auditor from the menu bar.

    The harness launches the Test Results Auditor and the Options dialog box. If you are repeating an audit, you might have to open the Options dialog box from the menu bar.
  1. If the harness did not launch the Options dialog box, choose Audit > Options from the menu bar.
  2. In the Options dialog box, specify the reference test suite.

    Audit Options dialog box

    See Audit Test Results Options for a detailed description. You can use the drop-down list or the chooser to specify a test suite. If you choose a reference test suite, the harness sets the entries in the work directory drop-down list to the work directories that are currently loaded and matches the specified test suite. If you have multiple test suites and work directories, specifying a test suite can simplify choosing the options.

    The harness always uses the test suite associated with the work directory that you choose to audit. See Work Directory below for a description of how to choose a work directory to audit.

  1. In the Options dialog box, specify the work directory.

    The harness audits the work directory named in the Work Directory field. A blank field indicates the work directory is not set.

    You can use the drop-down list or the chooser to specify the work directory to audit. If you choose a reference test suite, the harness only lists the work directories associated with it in the drop-down list. You are not limited to using these work directories. If you choose a work directory, the harness uses the test suite associated with the work directory and sets the entries in the Configuration File drop-down list to those most recently used with the work directory.

    If you do not choose a work directory, the harness uses the work directory associated with the configuration file that you specify. See Configuration File below for a description of how to choose a reference configuration file.

  1. In the Options dialog box, specify the configuration file.

    You can use the drop-down list or the chooser to specify a reference configuration file. If you specify a configuration file, it must be associated with the work directory. If the configuration file is not associated with the work directory, the harness displays an error message without performing the audit.

  1. Click the Start Audit button at the bottom of the Options dialog box.

    When the harness completes the audit, it displays the results in the Test Results Auditor.

    Audit Tool report

    See Test Results Auditor for detailed description of the Test Results Auditor.

    To repeat the audit, choose Audit > Options from the menu bar to open the Options dialog box and click the Start Audit button.

  1. Choose File > Close from the menu bar to close the Test Results Auditor.

Copyright © 2002, 2010, Oracle and/or its affiliates. All rights reserved.