Home
Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
Evaluating results in web analytic reports
After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
Customizing reports
You can customize reports to specifically investigate a performance problem in more detail than what is provided in the default reports.
Filtering results
By filtering the results that are displayed in a report, you can remove unnecessary data and focus on the data that is significant to you. If you save the changes, the report will contain these updates the next time that you open it.

Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
- Evaluating results in web analytic reports
  After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
  - Comparing results among runs
    To analyze the difference between two or more reports, you can compare them. For example, to analyze the performance of the application at different time slots or different milestone builds, you can compare two runs.
  - Comparing schedule stages
    When you are running a A schedule, in this context, is used to refer to both VU Schedule and Rate Schedule. that contains stages, time ranges are automatically created for each stage. You can view a report that compares these stages, and you also can set preferences to display the report automatically at the end of a staged run.
  - Comparing results from various regions or agent locations
    When you run a schedule that includes agents from different regions, use the Web Analytic reports to compare the performance data from these regions.
  - Generating functional test reports
    You can generate functional test reports of your tests, which summarize the pass or fail verdicts of elements in the test log. Functional reports are generated from the test run as HTML files that use predefined report designs.
  - Publishing test results to the server
    The test results indicates the quality of application under test. Different stakeholders to the application might want to check the quality of application but do not have the workbench or desktop client installed. As a desktop client user, you can publish the test result to HCL OneTest™ Server so that others can view it from the web browser.
  - Publishing specific results to the server
    If you have a single test result or multiple test results that are not yet published to HCL OneTest™ Server, you can publish all of them simultaneously.
  - Customizing reports
    You can customize reports to specifically investigate a performance problem in more detail than what is provided in the default reports.
    - Creating custom reports
      If the default reports do not address your needs, you can create your own reports.
    - Viewing trending reports
      To view the trend of response time for an application over a period of time, open the trend report for a run. In addition to the response time, you can view the trend for the loops, transactions, and performance requirements for the application.
    - Filtering results
      By filtering the results that are displayed in a report, you can remove unnecessary data and focus on the data that is significant to you. If you save the changes, the report will contain these updates the next time that you open it.
    - Adding additional counters on a separate page
      You can add additional counters on a separate page without editing an existing report to investigate performance problems in detail.
    - Customizing the appearance of graphs in a report
      To display the data in a table, bar chart, or line chart in a manner that caters to your test requirements, use the controls that are available in the View Options of a report.
    - Changing the report displayed during a run
      Use this page to select the default report that opens during a run. Typically, you select Determine default report based on protocols in test, which determines the protocols that you are testing and automatically opens the appropriate protocol-specific reports.
    - Modifying counters in a graph
      To gather additional information for diagnosing performance problems, you can modify the counters that are displayed in a graph.
    - Correcting time offset
      Response time breakdown and resource monitoring data is time stamped using the system clock of the host computer. If there are differences between the system clocks of the host computers that you include in a test, then response time breakdown and resource monitoring data are skewed in reports. The best practice is to synchronize the system clocks on all computers that you include in a test. When this is not possible, you can correct the time offset of each host computer after a test run. Typically, correct the time offset on all computers to match the system clock of the workbench computer.
  - Export test results
    You can export the test result in different formats to share it with different stakeholders.
  - Viewing response time breakdown
    You can do detailed analysis of the response time to find bottlenecks in the HTTP traffic of the application.
- Logs overview
  HCL OneTest™ Performance uses logs to store different types of information, which you can use to determine the reason for a test failure.
- Reports and counters
  See the description of the counters for all of the performance reports.

Filtering results

By filtering the results that are displayed in a report, you can remove unnecessary data and focus on the data that is significant to you. If you save the changes, the report will contain these updates the next time that you open it.

About this task

If there is a lot of data in a bar or line chart that causes some of the data to not display by default, you can use the horizontal scroll bar on the X-axis to view the rest of the data. There is also a filter icon to filter the data based on the text on labels.

The table at the bottom of the chart also includes a lot of information. So, now, the tabular data is presented in pages. There is also the filter icon to filter the data in the table.

Procedure

To filter the data in a report, open that report.
Click the Menu icon and click Edit.
On the graph or table, click the Settings icon .

On the View Settings page, in the Filter section, select one of the following options and specify the values:

Option	Description
Filter by count	Display the specified number of items. For example, if you select this option and then type `15`, the report will show the 15 items with the highest values (Show highest values) or the 15 items with the lowest values (Show lowest values).
Filter by value	Display items based on a comparison with the specified value. For example, if you select this option and then type `15`, the report will show all of the items that are higher than 15 (Show counters above filter values) or lower than 15 (Show counters below filter value).
Filter by name	Display items that match the specified name. If you are filtering a table, the label is usually a page, and is listed in the left column. If you are filtering a graph, the label is a legend in the graph.

See the changes in the Preview section.

Click the Apply button.

If you are filtering a table by count or value, the Primary counter for table filtering lists the counters in the heading of the table that you are filtering. Select a primary counter. If a value is removed by the primary filter, all other data occupying the same row as the removed value is also removed, thus maintaining the integrity of the results.

What to do next

To remove a filter, follow the same steps but at step 4 modify or delete the value.