The Execution History tab lets you review the execution history of a single execution while the Compare Reports tab lets you select multiple executions for comparison and analysis. All the test suites that are executed are listed on this tab. Use the basic or advanced search to narrow the list.

Note that you can compare the executions of a single test suite that is executed multiple times in the same environment. For example "SmokeTests_RLS-STG" is executed every day for the last 8 days at 9 AM. You can choose two or all eight execution reports and compare them.

There are two types of comparison reports, Execution Summary and Response Time.

For the Execution Summary comparison report, you can choose a maximum of 10 executions. The graph represents the pass percentage of the test cases for each execution. The rows in the table display the basic parameters and each column represents an execution. Similarly in the Test Cases table, the row represents the test cases and the columns represent an execution.

Click Test Steps to view the analysis for each test step in Test Steps tab. Use the drop-down in the first row first column to change the test case or click the Test Cases tab. Click the eye icon in the Error Type column for additional failure details.

The Response Time comparison report consists of two tabs, Test Case Summary and Test Cases. In the Test Case Summary tab, the row displays the test cases and each column represents an execution. In addition to the executions, the 75th percentile and then 90th percentile data are shown in the first two columns. The data above 75th percentile is highlighted in orange whereas the date above 90th percentile is highlighted in red.

In the Test Cases tab, a graphical representation of response time in milliseconds for each test step across all selected execution dates and time is displayed. The X axis represents the test step execution date and time and the Y axis represents the response time in milliseconds. The resource URL is also shown. You can view this data for each test case.

You can download the Response Time comparison report in an Excel sheet. The naming convention is ResponseTimeSummary_<TestSuiteName>.xlsx.