Home
Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in HCL DevOps Test Hub (Test Hub). You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
Integrations with other applications
You can integrate certain applications with HCL DevOps Test Hub (Test Hub) to run tests, view the test results, and create defects.
Integration with IBM® DevOps Deploy
You can integrate HCL DevOps Test Hub (Test Hub) with IBM® DevOps Deploy (Deploy) to run test assets as a Process from Deploy.
Installing the DevOps Test Hub Deploy plugin
You must install the DevOps Test Hub Deploy plugin to run test assets from IBM® DevOps Deploy (Deploy).

Test Execution Specialist Guide
This guide describes tasks that you must complete before you can configure and run tests in HCL DevOps Test Hub (Test Hub). You can find information about configuring runs for the different test types that are supported. You can also find information about other tasks that you can perform on the Resource Monitoring Service, Virtualization, and Integrations with third-party applications. This guide is intended for testers or test execution specialists.
- System modeling
  You can use the system model feature on HCL DevOps Test Hub (Test Hub) to create a model that simulates an application or system under test. You can define components to represent the actual components in the system under test, define their relationships and then view the components in a system under test as a diagrammatic representation.
- Prerequisites to running tests
  Before you can run a test asset in a project on HCL DevOps Test Hub (Test Hub), you must read the information about the different tests assets. You can add a remote static agent, Docker host, or Kubernetes cluster to the project and then select it as an alternate location to run the test assets.
- Management of agents
  You can find information about managing performance agents or API agents that you install on remote computers and then configure the remote agents to register with HCL DevOps Test Hub (Test Hub). After the agents are registered, you can add them to your projects and then select them as locations to run tests or virtual services.
- Management of Docker hosts
  You can find information about the tasks that you can perform on remote Docker hosts. After you set up a remote Docker host, you can register the Docker host with HCL DevOps Test Hub (Test Hub). You must then add the registered remote Docker host to your project before you can run tests on the remote Docker host location.
- Management of remote Kubernetes clusters
  You can find information about the tasks that you can perform on remote Kubernetes clusters. After you set up a remote Kubernetes cluster, you can register the external cluster with a team space on HCL DevOps Test Hub (Test Hub). You must then add the remote cluster to a project before you run test assets or resources on the remote Kubernetes cluster.
- Management of mobile device cloud credentials
  You can find information about managing the credentials that are required to connect to mobile device clouds from HCL DevOps Test Hub (Test Hub).
- Test run configurations
  You can configure and run tests in HCL DevOps Test Hub (Test Hub) after you add the test resources to your project in your team space.
- Configuration of test runs in a GitHub Actions Workflow
  You can configure test runs of test resources that are in a project repository of HCL DevOps Test Hub (Test Hub) in a GitHub Actions Workflow. You can choose to run test resources that are in your server project in the GitHub Workflow when you do not want to run the test resources without opening the Test Hub project.
- Configuration of a scan of an application code
  You can use HCL DevOps Test Hub (Test Hub) to scan your application code for security vulnerabilities similar to using the HCL® AppScan CodeSweep plugin to scan code in Visual Studio.
- Management of running tests
  Find information about the tasks that you can perform on a test that you configured for a run either while it runs or after it completes the run.
- Management of virtualized services
  You can find information about the tasks that you can perform on and manage the virtualized services that run on HCL DevOps Test Hub (Test Hub). You can start or stop the virtual services that are available to Test Hub. You can view the routing rules and usage statistics of virtualized services, agents, or intercepts that are connected to Test Hub.
- Test results
  After the tests, Suites, or schedules are run and completed, you can view the results and open the reports in HCL DevOps Test Hub (Test Hub) to analyze the verdict, the performance, and statistics. You can also re-execute tests and schedules from the Results page with the same commit id.
- Machine learning capabilities in DevOps Test Hub
  HCL DevOps Test Hub (Test Hub) uses Machine learning (ML) algorithms to analyze tests that match certain requirements and criteria, and then presents the findings as insights and recommendations after the tests are run. You can use the insights and recommendations to interpret the test results and identify the problem areas in the system under test.
- Resource monitoring
  When you apply load to a system under test, the amount of resources consumed by your system is increasing. If the capacity of the resources does not match the load, you can see performance issues in the results. Resource monitoring in HCL DevOps Test Hub (Test Hub) helps you monitoring the resources of a system and establish the performance metrics and usage data of the system. Thus, you can observe the health of these resources while a schedule is running.
- Configuration of a change management system
  When you use any application to create and track defects (bugs), issues, or other work items, you can configure the application as a change management system on HCL DevOps Test Hub (Test Hub). You can then create defects (bugs), issues, or other work items without the need to open your application.
- Integrations with other applications
  You can integrate certain applications with HCL DevOps Test Hub (Test Hub) to run tests, view the test results, and create defects.
  - Integration plugin compatibility matrix
    You can find information about the versions of the integration plugin that are compatible with HCL DevOps Test Hub (Test Hub).
  - Integration with Azure DevOps
    When you use Azure DevOps for continuous integration and continuous development of your application, you can run tests created for your application and available in a project on HCL DevOps Test Hub (Test Hub), in Azure DevOps pipelines by using the HCL DevOps Test Hub extension.
  - Integration with HCL DevOps Deploy
    You can integrate HCL DevOps Test Hub (Test Hub) with HCL DevOps Deploy (Deploy) to run test assets as a Process from Deploy.
  - Integration with IBM® DevOps Deploy
    You can integrate HCL DevOps Test Hub (Test Hub) with IBM® DevOps Deploy (Deploy) to run test assets as a Process from Deploy.
    - Installing the DevOps Test Hub Deploy plugin
      You must install the DevOps Test Hub Deploy plugin to run test assets from IBM® DevOps Deploy (Deploy).
    - Using a custom trust store for IBM® DevOps Deploy
      You can use a custom trust store in the DevOps Test Hub Deploy plugin file to establish a trusted and secure connection between the IBM® DevOps Deploy (Deploy) server and HCL DevOps Test Hub (Test Hub).
    - Creating a component in IBM® DevOps Deploy
      You must create a component to include artifacts and processes in IBM® DevOps Deploy (Deploy). The artifacts include runnable files, images, databases, configuration instructions. Whereas the processes define the activities that components can perform.
    - Creating a process in IBM® DevOps Deploy
      You must create a process for the component to include step properties for the test that you want to run from IBM® DevOps Deploy (Deploy).
    - Configuring the process in IBM® DevOps Deploy
      You must configure the process that you created for the component to organize the steps in the process, specify the properties of the steps, and connect them in IBM® DevOps Deploy (Deploy).
    - Creating a resource in IBM® DevOps Deploy
      You must create a resource to associate agents with components that you created in IBM® DevOps Deploy (Deploy).
    - Configuring the resource in IBM® DevOps Deploy
      You must configure the resource to add an agent and associate the agent with the component in IBM® DevOps Deploy (Deploy).
    - Creating an application in IBM® DevOps Deploy
      You must create an application in IBM® DevOps Deploy (Deploy) to fetch all the components together that you want to deploy.
    - Configuring the application in IBM® DevOps Deploy
      You must configure the application in IBM® DevOps Deploy (Deploy) to associate resources with environments and define processes to run test assets.
    - Running tests from IBM® DevOps Deploy
      You can run test assets from IBM® DevOps Deploy (Deploy) as a Process to test your application under test.
  - Integration with IBM® Engineering Test Management
    As a Project Owner, you can integrate Engineering Test Management as a quality management solution with HCL DevOps Test Hub (Test Hub). You can run test assets that are available in a project from Engineering Test Management.
  - Integration with Jenkins
    You can use the HCL DevOps Test Hub (Test Hub) plugin to integrate Test Hub with Jenkins. After you complete the integration, you can run tests assets that are available in a project of Test Hub from a Jenkins server.
  - Integration with Xray test management for Jira
    When you use Jira as a change management system on HCL DevOps Test Hub (Test Hub) and you use Xray as the test management application in Jira, you can integrate Xray with Test Hub. With this integration, you can export the test results of the tests that run on Test Hub to your Jira project. You can then view and use the test results in your project in Jira.
- Managing access to DevOps Test Hub
  Desktop clients and third-party integrations use offline user tokens to connect to HCL DevOps Test Hub (Test Hub).
- Working with DevOps Test Hub REST services
  When you want to use the REST APIs of HCL DevOps Test Hub (Test Hub) in your test automation scripts, you can view the REST APIs that are exposed by Test Hub. You can also run the APIs from within your project in Test Hub.

Installing the DevOps Test Hub Deploy plugin

You must install the DevOps Test Hub Deploy plugin to run test assets from IBM® DevOps Deploy (Deploy).

Before you begin

You must be familiar with working with Deploy.
You must have performed the following tasks:
- Installed Deploy. For more information about the installation, refer to the IBM Urban Code documentation.
- Been granted access to Deploy.
- Downloaded the DevOps Test Hub Deploy plugin from the HCL® License & Delivery portal.
  
  For more information about specific versions of plug-in, see Integration plugin compatibility matrix.

Procedure

Log in to Deploy, if you are not already logged in.
The Deploy dashboard is displayed.
Click Settings.
Click Automation Plugins from the Automation pane.
Click Load plugin.
Click Choose File to locate and open the compressed DevOps Test Hub Deploy plugin file.

Remember: You must not extract the DevOps Test Hub Deploy plugin compressed file contents.
Click Submit.

The installed plugin is displayed on the Automation Plugins tab.

Results

You have installed the DevOps Test Hub Deploy plugin on Deploy.

What to do next

You must create a Component in Deploy. See Creating a component in IBM DevOps Deploy.