Home
Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
Evaluating results in web analytic reports
After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
Customizing reports
You can customize reports to specifically investigate a performance problem in more detail than what is provided in the default reports.
Modifying counters in a graph
To gather additional information for diagnosing performance problems, you can modify the counters that are displayed in a graph.

Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
- Evaluating results in web analytic reports
  After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
  - Comparing results among runs
    To analyze the difference between two or more reports, you can compare them. For example, to analyze the performance of the application at different time slots or different milestone builds, you can compare two runs.
  - Comparing schedule stages
    When you are running a A schedule, in this context, is used to refer to both VU Schedule and Rate Schedule. that contains stages, time ranges are automatically created for each stage. You can view a report that compares these stages, and you also can set preferences to display the report automatically at the end of a staged run.
  - Comparing results from various regions or agent locations
    When you run a schedule that includes agents from different regions, use the Web Analytic reports to compare the performance data from these regions.
  - Generating functional test reports
    You can generate functional test reports of your tests, which summarize the pass or fail verdicts of elements in the test log. Functional reports are generated from the test run as HTML files that use predefined report designs.
  - Publishing test results to the server
    The test results indicates the quality of application under test. Different stakeholders to the application might want to check the quality of application but do not have the workbench or desktop client installed. As a desktop client user, you can publish the test result to HCL OneTest™ Server so that others can view it from the web browser.
  - Publishing specific results to the server
    If you have a single test result or multiple test results that are not yet published to HCL OneTest™ Server, you can publish all of them simultaneously.
  - Customizing reports
    You can customize reports to specifically investigate a performance problem in more detail than what is provided in the default reports.
    - Creating custom reports
      If the default reports do not address your needs, you can create your own reports.
    - Viewing trending reports
      To view the trend of response time for an application over a period of time, open the trend report for a run. In addition to the response time, you can view the trend for the loops, transactions, and performance requirements for the application.
    - Filtering results
      By filtering the results that are displayed in a report, you can remove unnecessary data and focus on the data that is significant to you. If you save the changes, the report will contain these updates the next time that you open it.
    - Adding additional counters on a separate page
      You can add additional counters on a separate page without editing an existing report to investigate performance problems in detail.
    - Customizing the appearance of graphs in a report
      To display the data in a table, bar chart, or line chart in a manner that caters to your test requirements, use the controls that are available in the View Options of a report.
    - Changing the report displayed during a run
      Use this page to select the default report that opens during a run. Typically, you select Determine default report based on protocols in test, which determines the protocols that you are testing and automatically opens the appropriate protocol-specific reports.
    - Modifying counters in a graph
      To gather additional information for diagnosing performance problems, you can modify the counters that are displayed in a graph.
    - Correcting time offset
      Response time breakdown and resource monitoring data is time stamped using the system clock of the host computer. If there are differences between the system clocks of the host computers that you include in a test, then response time breakdown and resource monitoring data are skewed in reports. The best practice is to synchronize the system clocks on all computers that you include in a test. When this is not possible, you can correct the time offset of each host computer after a test run. Typically, correct the time offset on all computers to match the system clock of the workbench computer.
  - Export test results
    You can export the test result in different formats to share it with different stakeholders.
  - Viewing response time breakdown
    You can do detailed analysis of the response time to find bottlenecks in the HTTP traffic of the application.
- Logs overview
  HCL OneTest™ Performance uses logs to store different types of information, which you can use to determine the reason for a test failure.
- Reports and counters
  See the description of the counters for all of the performance reports.

Modifying counters in a graph

To gather additional information for diagnosing performance problems, you can modify the counters that are displayed in a graph.

About this task

Counters are specific in-built queries that gather statistical information from the recorded test. The information can be the number of page hits, response time, and user load. By default, each report has pre-defined counters. You can add or remove the counters from the graphs in the report.

Procedure

From the Test Navigator, double-click the report to modify the counters.
To add or remove a counter from a report, click the Menu icon .
Click the Edit icon .
To modify counters on a specific graph, click Settings icon .
On the View Settings page, select the Counters tab and perform the following sub-steps to add, remove, or move the counters in a graph:
1. To add a counter, click the Plus button and select the counters from the drop-down list.
2. To remove the selected counter, click the Remove button .
3. To move a counter, use the up-down control buttons .
The Preview section displays the result of the actions.
Optional: For a selected counter, you can change the component of the counter. Based on the counter selection, the Component field shows the options available for that counter.
Optional: You can change the Cumulated value for the selected counter if you want to show the cumulation values on a graph. Select one of the following options based on the requirement:
- Select No to display the value of the last interval on the current time range.
- Select From beginning of time range to display the cumulation of all values of the current time range.
- Select From beginning of run to display the cumulation of all values from the beginning of the run to the end of the current time range.
Notes:
- For line charts, the default value is No.
- For bar chart, pie chart, and tables, the default value is From beginning of time range.
- The fields Label, Path, and Unit are non-editable.
Click Apply.
Click Save from the menu.
Optional: To create another report with these changes, click Save As.
To exit the edit mode, click the Edit icon .

Results

You have updated the counter information for the specific report.