Home
Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
Evaluating results in web analytic reports
After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
Export test results
You can export the test result in different formats to share it with different stakeholders.
Methods to export test results into a JSON file
You can export test results to a JSON file in different ways. You can then share the exported test results with different stakeholders and they can analyze test data without using the product.

Test Manager Guide
This guide describes how to keep track of the performance of the application by evaluating the test results. This guide is intended for test managers.
- Evaluating results in web analytic reports
  After the test run, evaluate the results in the web analytic reports. Web analytics collect data using new technologies thereby providing better user experience.
  - Comparing results among runs
    To analyze the difference between two or more reports, you can compare them. For example, to analyze the performance of the application at different time slots or different milestone builds, you can compare two runs.
  - Comparing schedule stages
    When you are running a schedule, in this context, is used to refer to both VU Schedule and Rate Schedule that contains stages, time ranges are automatically created for each stage. You can view a report that compares these stages, and you also can set preferences to display the report automatically at the end of a staged run.
  - Comparing results from various regions or agent locations
    When you run a schedule that includes agents from different regions, use the Web Analytic reports to compare the performance data from these regions.
  - Generating functional test reports
    You can generate functional test reports of your tests, which summarize the pass or fail verdicts of elements in the test log. Functional reports are generated from the test run as HTML files that use predefined report designs.
  - Publishing test results to the server
    The test results indicates the quality of application under test. Different stakeholders to the application might want to check the quality of application but do not have the workbench or desktop client installed. As a desktop client user, you can publish the test result to HCL OneTest™ Server so that others can view it from the web browser.
  - Customizing reports
    You can customize reports to specifically investigate a performance problem in more detail than what is provided in the default reports.
  - Export test results
    You can export the test result in different formats to share it with different stakeholders.
    - Creating an executive summary from the workbench
      To create a printable report that summarizes the findings of the performance test run on a single view, create an executive summary. You can export the data of the test run as an executive summary from a single report or from multiple reports such as Performance Report, Mobile and Web UI Statistical Report, Transaction Report, and Loop Report. You can then open the summary in a word-processing program to further format and annotate the data.
    - Creating an executive summary from the Web Analytics report
      To create a printable report that summarizes the findings of the performance test run on a single view, create an executive summary. You can choose to view the executive summary on a web browser or save it on a computer.
    - Exporting reports to HTML format
      When you export a test run and share it, people can analyze test data without using the test workbench. You can also email the test run or post it on a web server. The exported run can be displayed and printed from any browser. A test run contains multiple reports. You can choose to export any or all of the reports.
    - Exporting results to a CSV file
      To further analyze test results, you can export all statistics or specific statistics captured during a run to a CSV file.
    - Methods to export test results into a JSON file
      You can export test results to a JSON file in different ways. You can then share the exported test results with different stakeholders and they can analyze test data without using the product.
      - Exporting results to a JSON file by using the product
        When you want to analyze test results in a text format, you can export all test results or specific test results that are captured during a test run to a JSON file by using the product.
      - Exporting results to a JSON file by using a web analytic report
        When you want to analyze test results in a text format, you can export all test results or specific test results that are captured during a test run to a JSON file by using a web analytic report.
    - Sharing URL of test run
      When you share the URL of the test run with other people, they can view and analyze the test results on a browser on their computer if the test workbench is running on your computer at that time.
    - Exporting report metadata
      To share report metadata with another test workbench user, export the report definition. Use this option to share customized report formats with other users. The recipient imports the metadata with Eclipse's Import option and views the report from the Test Navigator or in the list of reports in the web report.
  - Viewing response time breakdown
    You can do detailed analysis of the response time to find bottlenecks in the HTTP traffic of the application.
- Logs overview
  HCL OneTest™ Performance uses logs to store different types of information, which you can use to determine the reason for a test failure.
- Reports and counters
  See the description of the counters for all of the performance reports.

Methods to export test results into a JSON file

You can export test results to a JSON file in different ways. You can then share the exported test results with different stakeholders and they can analyze test data without using the product.

You can export the test results into a JSON file by using any of the following methods:

Product
Web analytics report from the product
Command-line interface

When you use the product method to export test results, you can select multiple test results simultaneously. However, when you use the web analytics report or the command line, then you can export a report of the test result.