Home
Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
Evaluating results in web analytic reports
After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
Comparing results among runs
To analyze the difference between two or more reports, you can compare them. For example, to analyze the performance of the application at different time slots or different milestone builds, you can compare two runs.

Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
- Evaluating results in web analytic reports
  After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
  - Comparing results among runs
    To analyze the difference between two or more reports, you can compare them. For example, to analyze the performance of the application at different time slots or different milestone builds, you can compare two runs.
  - Comparing schedule stages
    When you are running a schedule, in this context, is used to refer to both VU Schedule and Rate Schedule that contains stages, time ranges are automatically created for each stage. You can view a report that compares these stages, and you also can set preferences to display the report automatically at the end of a staged run.
  - Comparing results from various regions or agent locations
    When you run a schedule that includes agents from different regions, use the Web Analytic reports to compare the performance data from these regions.
  - Generating functional test reports
    You can generate functional test reports of your tests, which summarize the pass or fail verdicts of elements in the test log. Functional reports are generated from the test run as HTML files that use predefined report designs.
  - Publishing test results to the server
    The test results indicates the quality of application under test. Different stakeholders to the application might want to check the quality of application but do not have the workbench or desktop client installed. As a desktop client user, you can publish the test result to HCL OneTest™ Server so that others can view it from the web browser.
  - Customizing reports
    You can customize reports to specifically investigate a performance problem in more detail than what is provided in the default reports.
  - Export test results
    You can export the test result in different formats to share it with different stakeholders.
  - Viewing response time breakdown
    You can do detailed analysis of the response time to find bottlenecks in the HTTP traffic of the application.
- Logs overview
  HCL OneTest™ Performance uses logs to store different types of information, which you can use to determine the reason for a test failure.
- Reports and counters
  See the description of the counters for all of the performance reports.

Comparing results among runs

To analyze the difference between two or more reports, you can compare them. For example, to analyze the performance of the application at different time slots or different milestone builds, you can compare two runs.

About this task

You can compare the test runs from the Test Navigator view or from the web analytics report itself. To compare test runs from the Test Navigator view, select the runs, right-click, and click Compare Results.

You can compare the test runs that are in the same project or in the different projects. When comparing multiple runs, you cannot compare multiple time-ranges or stages.

Procedure

To compare runs from the web analytics report:

Open the run or report to serve as the basis for comparison.
Click the name of the run next to the Menu option
Click Add and navigate to the run to compare with.
Multiple runs are displayed in the report.
Optional: To add, remove, or move the position of the runs, click Manage .