Known issues

You can find the known issues that are identified, if any, in this version of HCL DevOps Test Performance (Test Performance). You can also find the known issues identified in the earlier versions of Test Performance. DevOps Test Performance is the new name of HCL OneTest Performance from 11.0.0 onwards.

Known issues in Test Performance 2023.12 (11.0.0)

The known issues identified in Test Performance 2023.12 (11.0.0) are as follows:

ID

Description

Identified in version

TP-90515

The single shell-shared package, DevOps-Test-UI-and-Performance-Windows-x86, is not available anymore. To install DevOps Test UI and DevOps Test Performance in the shell-shared mode on the 32-bit platform, you must use DevOps-Test-UI-Windows-x86 and DevOps-Test-Performance-Windows-x86 packages by using Installation Manager.

11.0.0

Known issues from earlier versions

The known issues identified in the earlier versions of Test Performance that are still applicable are as follows:

Table 1. Known issues from earlier versions

ID

Description

Identified in version

Applicable in and until version

TP-88149

When you record a Citrix test by using the on-server or published application options on Citrix Workspace App 23.03, the recording fails with a client error. Citrix Workspace App 23.03 only supports recording by using Web Interface and ICA file options.

10.5.4

TP-88120

When you import projects from Git, tests run from the command line fail if you use wildcards to identify tests or if you use the option -testType.

The workaround for this limitation is that you can avoid using assets from Git. Alternatively, you can export or import test assets with dependencies into a different workspace.

10.5.4

TP-88193

You cannot use Git Actions to run tests when HCL OneTest Performance is installed on MacOS Ventura 13.

10.5.3

10.5.4

TP-88149

When you run HCL OneTest Performance on MacOS Ventura, the "Preferences" option in the Rational Performance Tester menu is displayed as "Settings".

10.5.3

TP-85460

When you install HCL OneTest Performance 10.5.1 or later on a Windows Server 2022 computer, and open the Web Analytics reports for editing, the icons are not displayed. To work around the problem, you can perform the following steps on browsers other than Internet Explorer:
  1. Open HCL OneTest Performance.
  2. Go to Window > Preferences.
  3. Select Test > Performance Reports
  4. Select In external browser" under Open Statistics Report.
  5. Click OK.
  6. Close the report and then double-click the result.
Perform the following steps in Internet Explorer:
  1. Enter Internet options in the start menu.
  2. Select Local Intranet in the Security tab.
  3. Click Sites.
  4. Type http://127.0.0.1, and then click Add.
  5. Click Close, and then click OK.
  6. Restart HCL OneTest Performance.

10.5.1

TP-84021

When you start the HCL OneTest Performance adapter for IBM Rational Quality Manager as a Windows service, the schedule run fails with license errors.

To work around this problem, you must add the License Server ID and License Server URL as System Environment variables by performing the following steps:

  1. Right-click the Windows icon from the Windows taskbar, and then click System.
  2. Click Advanced system settings from the Related setting.
  3. Click the Advanced tab, and then click Environment Variables.
  4. Click New from the System variables.
  5. Enter HCL_ONETEST_LICENSING_URL in the Variable name.
  6. Enter the URL of the License Server in the Variable value.
  7. Click OK.
  8. Click New from the System variables.
  9. Enter HCL_ONETEST_LICENSING_ID in the Variable name.
  10. Enter the ID of the License Server in the Variable value.
  11. Click OK.

10.5.0

TP-83770

When you install HCL OneTest Performance on Windows systems, and then open a performance test report by using an internal browser, the icons are not displayed in the performance report.

To work around this problem, you must perform the following steps:

  1. Close HCL OneTest Performance
  2. Open Internet Explorer.
  3. Click Settings - Internet options, and then select the Security tab.
  4. Select Internet from the Select a zone to view or change security settings pane.
  5. Click Custom level, and then choose Enable for Downloads - Font download.
  6. Click OK to accept the changes made to the security settings.
  7. Click Apply, and then click OK to save the changes.
  8. Close Internet Explorer.
  9. Open HCL OneTest Performance, and then access the performance test report.

10.5.0

TP-84064

The Browser tab in the Protocol Data pane does not display the recorded web pages when you perform the following tasks:

  • Install Rational Performance Tester on Ubuntu 22.04.1 LTS
  • Highlight any page from the recorded test

10.5.0

10.5.1

TP-82960

When you want to install HCL OneTest UI, HCL OneTest API, or HCL OneTest Performance on Mac OS Big Sur (11.x), you must download all of the product offerings that are contained in the HCL OneTest Studio package to prevent installation errors.

10.5.0

TP-79188

When you use the double quotation marks ("") for the Labels or User comments options to run the test by using integration plugins, then the labels in the test result or the User Comments row of a report do not include the double quotation marks.The integration plugins that do not support double quotation marks ("") for the Labels or User comments options are as follows:
  • Ant
  • Azure DevOps
  • MicroFocus ALM
  • UrbanCode Deploy
  • Jenkins
  • Maven
To work around this problem, you must create a command-line config file, and then run the test by using the Configfile option.

10.2.3

TP-81353

When you use the double quotation marks ("") for the labels or usercomments parameters and then run tests from the command-line interface, the command-line interface does not accept values for these parameters.

To work around this problem, you must perform the following actions based on the operating system that you used to install HCL OneTest Performance:

On the Windows operating system:

1. Open the command-line interface.

2. Change the directory to a location that contains the CommandLine.exe file.

You can locate the directory in the following location:

<installation_directory>\IBM\IBMIMShared\plugins\com.ibm.rational.test.lt.cmdlineexecute<time_stamp>

3. Run the test by using valid parameters.

On Windows, Linux, and Mac operating systems:

1. Create a command-line config file by using HCL OneTest Performance.

2. Run the test by using the -configfile parameter.

10.2.3

TP-82527

When you run the performance schedule by enabling Resource Monitoring sources, the quick view report shows the following issues:

  • The selected counter names in All Resources for the specific Resource Monitoring source are displayed correctly for the first time. However, when you refresh the quick view report or reopen the report, the names of the counters are displayed as TRANSLATE ME.
  • The Pie chart collates the names of the legends when you set the Show legend option to At the top side.

To work around this problem, you can perform the following steps:

  1. Select or clear any other counter from the left navigation pane so that the correct names of the counters are displayed in the Legend.
  2. Set the value of the Show legend option to other than At the top side or set the product preferences to open the report on the external browser by navigating to WindowPreferencesTestPerformance Test Reports.

10.2.3

10.5.0

TP-51357

When you playback a Citrix test asset with Citrix Receiver 4.11 or later, the test asset fails to run.To work around this problem, you must install Citrix Receiver 4.9.

10.2.1

TP-76892

If your computer restarts due to any reason, you might not be able to uninstall or open the product at times. To work around this problem, you must always clear the files from the Temp directory before you install or after you uninstall the product.

While performing the uninstallation, if your computer prompted for a restart, perform the following steps:

  1. Click Continue to proceed with the uninstallation of the product.
  2. Clear the files from the Temp directory.

In a scenario where you are unable to open the product due to your computer restart, then you can perform the following steps to do a fresh installation of the product:

  1. Clear the files from the Temp directory.
  2. Close all the processes that are related to the product.
  3. Delete the installation folder of the product.
  4. Perform the following steps to delete the Registry entry of the product:

    1. Press Windows + R.
    2. Enter regedit in the Open field, and then click OK.
    3. Locate one of the following key based on your product:

      1. HCL OneTest™ Performance - HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall\HCL OneTest™ Performance
      2. HCL OneTest™ Performance Agent - HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall\HCL OneTest™ Performance Agent
      3. Shell-shared installer - HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall\HCL OneTest™
    4. Right-click the entry to be deleted, and then click Delete.
    5. Click Yes to confirm the deletion.
  5. Install the product.

10.2.0

TP-76105

If your application uses TLS1.1 or TLS1, then HCL OneTest Performance cannot record or run those test assets until you modify the java.security file. This issue is because TLS 1.1 and TLS1 are not supported by Java.

To work around this problem, you must perform the following steps:

  1. Navigate to <location_of_the_product>\ IBM\SDP\jdk\jre\lib\security.
  2. Open the java.security file in any of the text-editing programs to edit the content.
  3. Locate the following line of code: tls.disabledAlgorithms=SSLv3, TLSv1, TLSv1.1, RC4, DES, MD5withRSA
  4. Remove TLSv1 and TLSv1.1 from the code.
  5. Save the java.security file.
  6. Restart HCL OneTest Performance

10.2.0

TP-73401

When you install the product by using the stand-alone installer on macOS Catalina 10.15.7, the product installation fails with an error message. To work around this problem, you must set the Appearance option to Light under System preference before you install the product.

10.1.3

TP-72726

When you use a calendar dialog box to select a value in an SAP transaction session and record the SAP test in your product, the Test Generation page and the Error Log page display a warning message.The warning message states that the SAP calendar object has an unpredictable behavior when you play back the test and you must set the date in the value fields by using the string format.Therefore, when you select the Hide GUI during the execution option from the SAP Options tab in the Test Details section to play back the SAP test, the product is unable to create a calendar object. Hence the test run fails.

To work around this problem, you must perform the following steps:
  1. Open the SAP test.
  2. Perform the following actions to set the calendar date in a text format:
    1. Expand an SAP transaction, and then expand the test element (For example, IDoc List/WE05) that has the calendar control data.
    2. Select Set focus on <date>.
    3. Right-click the date from SAP Protocol Data, and then click Create Element. The Create Element page is displayed.
    4. Select Set text, and then enter the date in the Input value text field.
    5. Click Finish.
  3. Right-click the calendar control (For example, Calendar/WE05), and then click Disable to disable the test elements that have the calendar control.
  4. Save the changes, and then run the test.

10.1.3

TP-70696

When you record an SAP test by selecting the Record from a running session started with the SAP logon option, then the schedule run fails with the following error message on the Test Log page or Execution Event Console log page:
Connection with the existing SAP GUI session or shortcut is not allowed during schedule
          execution

To work around this problem, you must perform the following steps:

  1. Record an SAP test that has a logon session.
  2. Place the transaction session that you created by using the Record from a running session started with the SAP Logon option.
  3. Record an SAP test that has the logoff session.
  4. Save and run the schedule to verify the transaction details.
Note: The session created by the first test is considered as the current session.

10.1.2

TP-69141

You must decrypt and encrypt each dataset by using the CSV Editor to apply the strongest encryption on each dataset that you used in the earlier version of the product.

10.1.2

TP-62667

When you install HCL OneTest Performance 10.1.0 on Red Hat Linux Enterprise 8.0 or later, the installation fails with an error message. To work around this problem, you must first install libnsl.so.1 on your computer for a successful installation of the product. Alternatively, you can create a soft link from libnsl.so.2 by running the following command on the command-line interface:sudo ln -s /usr/lib64/libnsl.so.2 /usr/lib64/libnsl.so.1

10.1.0

TP-66551

When you record a Citrix test by using an ICA file, the recording fails with an error message. You must first verify the values for the parameters DesiredHRES and DesiredVRES in the ICA file because the values for these parameters are set to 0 instead of a valid number. To resolve this issue, you must first set a value for the parameters to record the Citrix test by using the ICA file.

10.1.0

TP-66806

On Windows Server operating systems, when you use HCL OneTest Performance to run a VU schedule that has Citrix test, sometimes the playback fails because an action from the test is incorrectly played back by the Citrix receiver. To resolve this issue, you must install HCL OneTest Performance and HCL OneTest Performance Agent on Windows 10 operating systems when you want to run the VU schedule that has Citrix test.

10.1.0

TP-67053

On Windows, there is an incompatibility between the version of Java packaged with the product (OpenJDK OpenJ9 V1.8.0_252) and AdoptOpenJDK14 when Symantec Endpoint Protection is installed. To work around this problem, uninstall the AdoptOpenJDK14 product or remove it from the PATH before using the product.

10.1.0

TP-67514

When you run tests or schedules that have a file name with non-English characters from the command-line interface, then the test run fails with an error message.

To work around this problem, you must use CommandLine.exe to run tests or schedules from the command-line interface. You can locate CommandLine.exe in the following folder path:

IBM\IBMIMShared\plugins\-com.ibm.rational.test.lt.cmdlineexecute_7.2.3200.v<YYYYMMDD_HHMM>

TP-57089

In HCL OneTest Performance 10.0.0 and later, when you set the environment variable, JAVA_HOME, to the bundled JDK that is shipped with the product, tests that run from Jenkins show a java.lang.OutOfMemoryError: Java heap space error after completion of the test run.

With 10.0.0 and later, you might expect a reduction in the number of Virtual Users (VUs) supported by HCL OneTest Performance Agent depending upon workload characteristics. This variation is the result of the product shipping with OpenJDK 8 with OpenJ9 instead of IBM JRE.

OpenJDK 8 with OpenJ9 JRE exhibits a higher utilization of CPU for the workload. Up to 30% or more decrease in the supported VUs capacity may be expected for CPU-bound workloads. However, for memory-bound workloads, a much smaller, if any reduction in VUs capacity may be expected. If you need higher performance and have access to IBM JRE 8.0.5.35 or later which contains the latest security fixes, you can switch from OpenJDK 8 with OpenJ9 to IBM JRE. For more information, see http://www.ibm.com/support/docview.wss?uid=ibm10956413.

When you do performance monitoring of the resources of a remote Windows computer, you specify the credentials of that computer in HCL OneTest Performance. The credentials are stored in a Windows file. If the credentials of the remote computer change and you updated the credentials from HCL OneTest Performance, the test run with Windows Performance Monitoring will still fail. You must restart the workbench computer and then change the credentials from HCL OneTest Performance.

When you playback a test remotely such as from the command line or Jenkins, the log file in the workspace displays IllegalStateException: Workbench has not been created yet. error message. The test will execute successfully.

On Mac OS X, if you have HCL OneTest Performance configured for a floating license or Authorized User License, you will get a com.ibm.rational.test.lt.licensing.RPTLicenseExceptionerror the first time you run a schedule. The exception forces the schedule to stop the execution with a failure. After the initial failure, all subsequent runs of schedules would pass without the above-mentioned error.

10.0.0

Permanent known issues

When you do performance monitoring of the resources of a remote Windows computer, you specify the credentials of that computer in HCL OneTest Performance. The credentials are stored in a Windows file. If the credentials of the remote computer changes and you updated the credentials from HCL OneTest Performance, the test run with Windows Performance Monitoring will still fail. You must restart the workbench computer and then change the credentials from HCL OneTest Performance.

You cannot install HCL OneTest Performance and Rational® Performance Tester on the same computer or package group. Also, you cannot install or shell-share HCL OneTest Performance with another Rational testing product such as Rational Test Workbench.

Running tests with Chrome while logged in as root on Linux computers is not supported.

When you start an information center for the first time, you might see an error "Unable to acquire PluginConverter service during generation for error messages". You can safely ignore the error.

Stop the information center and then restart it.

There are a bunch of issues related to Eclipse GTK 3. If you face any of such issues, you can switch to using GTK 2. See the list of issues.

To run SAP GUI tests with 20 or more virtual users on Oracle JDK, you can use the Long Run Mode option. Otherwise, the SAP GUI tests would fail.

After starting the product, a message such as the following appears in the product console: The IBM Class Sharing Adaptor will not work in this configuration. You are not running on a J9 Java VM. This message is displayed because the version of Eclipse that is used in the IDE is from IBM and has the IBM Java optimizations enabled. To resolve the issue:
  1. Locate the com.ibm.cds plugin in the Shared installation directory of the installed product.
  2. Back up the plugin and then remove it.