Tabs

The execution result editor contains up to four tabs to present the data differently.

Overview

The Overview tab shows the environment at which the test scenario was executed and a message if the execution failed. It shows the complete Total Test Scenario in the state after the execution. If a validation file was present, it will also show the structure of the validation file. If code coverage was enabled in the execution context dialog box, a section with code coverage results will also be present where to total coverage percentage can be seen per component. It is possible to update the code coverage data manually by importing the code coverage files into the result. The Overview tab is good for getting an overview of the execution.

Details

The Details tab lists all Component, SQL Select and Read Dataset invocations in the test scenario, and it presents data from each call in the same UI as the Total Test Scenario editor uses. This makes it easy to see and manually evaluate outputs, whereas the Overview tab only shows a high level status the test Scenario.

It is possible to export the result of a component execution as a stub in XML to be used for test virtualization. See further explanation below and in the Test-Virtualization section.

Verify Result

The Verify result tab lists all Verify and Verify Dataset elements from the execution. It presents the result in a compare editor that makes it easy to spot the differences between expected and actual data. The Verify Dataset element compares two data sets record by record at the host and returns the records where differences have been found. For each record the actual and expected value is displayed in three rows of characters. The first row shows the record in plain text. This is not useful for binary data. The second and third rows show the upper and lower bit of the byte in hex. This is useful when comparing binary data.

Compare Text

The Compare Text tab is only available when a validation file has been used. It shows a textual compare editor that compares the complete execution result against the validation file. This tab is often easier to use for understanding differences between expected and actual data compared to the tree views in the Details tab.

Source

The Source tab shows the XML source of the execution result. Here you can see how the result is structured and that it contains three main parts; The result of the execution (under the AST node), a copy of the validation file if one was present at the execution, and the original execution context and Total Test Scenario used to produce the result.