Running compound tests on iOS devices or simulators connected to a remote agent computer

You can run compound tests that contain mobile tests on iOS mobile devices or simulators that are connected to a remote agent computer.

Before you begin

You must have completed the following tasks:
  • Recorded mobile tests. See Recording mobile tests for iOS applications.
  • Created a compound test that contains mobile tests, see Creating a compound test.
  • Installed the Xcode and the CLI tools for Xcode on the computer that you want to use for testing iOS mobile applications.
  • Installed the iOS mobile application that you want to test on the iOS device or simulator.
  • Connected and started the iOS device that you want to use for testing iOS mobile applications. You can connect the iOS device to the computer through a USB cable.
  • Ensured that the UI Test Agent is running on the remote agent computer.
    Tip: You can hover the cursor over the System Tray to verify that the UI Test Agent is running and also view the port it uses.
  • Ensured that you have the following information if you want to run the test on a real device:
    • Apple Team ID
    • Version of the platform
    • Port
      Note: This is required only when the port is not the default port.
    • Name of the iOS mobile device

About this task

When you run mobile tests, you can enable Test UI to collect metrics for certain parameters of the resources used by the mobile applications or devices. You can select the Resource Monitoring option and set the time intervals for the collection of the metrics during the test run.
Important: The collection of Resource Monitoring metrics and display of the data graphically is supported only when you run a compound test on a single device.
Restriction: Resource Monitoring metrics of iOS simulators are not collected nor graphically displayed.

Procedure

  1. Open the UI Test perspective in Test UI if it is not already open.
  2. Select the compound test that contains the mobile tests from the Test Navigator pane.
    The test window is displayed.
  3. Click Window > Preferences > Test > Test Execution > UI Test Playback.

    The UI Test Playback pane is displayed.

  4. Click the Mobile Device tab, and then perform the following steps:
    1. Select the Host check box in the UI Test Agent panel, and then enter the IP address of the remote computer in the Host field.
      Note: The port in use by the UI Test Agent on the computer is automatically populated in the Port field.
    2. Select the iOS Device checkbox in the iOS Device panel, and then enter the name of the iOS device or simulator that is connected to the computer in the iOS Device field.

      The Platform Version field is enabled.

    3. Enter the version of the platform in the Platform Version field.
    4. Select the Apple Team ID checkbox in the iOS Device panel, and then enter the name of the Apple Developer Team ID provided by Apple in the Apple Team ID field.
    5. Enter the role that you are assigned by the Apple Developer Team in the Role field.
    6. Click Apply and Close.
  5. Click the Run Compound Test icon.

    The Run Configuration dialog is displayed.

    Perform any of the following actions:
    • To run each mobile test that are in the compound test on a specific device, go to step 6.
    • To simultaneously run all the tests that are in the compound test on the same set of devices, go to step 7.
  6. Clear the Run on several devices and browsers in parallel option, if selected, and then perform the following actions:
    1. Click the Run using option for each test, to view the mobile devices or emulators that are connected.
    2. Select a device from the list.
    3. Repeat steps 6.a and 6.b, for each of the tests in the Compound test.
    4. Click Next.
      The Advanced Playback Options dialog is displayed.
      Note: There is no action to be performed by you for mobile tests.
    5. Go to step 8.
  7. Select the Run on several devices and browsers in parallel option, if not selected.
    1. Select the devices on which you want to run the test.
    2. Click Next.
      The Advanced Playback Options dialog is displayed.
      Note: There is no action to be performed by you for mobile tests.
    3. Go to step 8.
  8. Click Next.

    The Performance Measurement dialog is displayed.

  9. Perform the following steps if you want Test UI to collect the Resource Monitoring metrics during the test run:
    1. Select the Resource Monitoring option.
    2. Set the interval to collect the metrics by entering a number in the Polling interval field.
      Note: The minimum value that you can enter in the Polling interval field is 1000 milliseconds.
  10. Click Finish.

Results

The test runs on the selected mobile devices or simulators. The test result is displayed as a unified report in Test UI.

What to do next

You can view the unified report for the mobile tests and choose to export the unified report. See Unified reports.

If you opted to collect the Resource Monitoring metrics, you can view the metrics displayed graphically in the UI Test Statistical report. You can analyze the Resource Monitoring metrics to manage the resources of the device or the mobile application under test. See UI Test Statistical report.