Monitoring A/B test progress in the A/B Test Performance Report

You can run the A/B Test Performance report at any time, even after the system sends the winning email version. The A/B Test Performance report continues to record recipient responses to email after the system sends the winning version of the test.

Procedure

To monitor the progress of the A/B test, run the A/B test report and observe the current values.

Results

As the A/B test runs and the system sends email to recipients in each test split, the system updates the values for messages sent. As recipients respond to the mailings, the system updates the results for received messages, message views, link clicks, and email abuse complaints. When the system evaluates the results, it also updates the reports with the scores for each test split.

After the winner is determined and the winning email is sent to the recipient list, the system continues to record responses. Because the system continues to update responses to the A/B test, the values in the report can change over time. The report values, including test scores, can be different from values that are contained in earlier runs of the report.