A/B Testing Performance Report

The A/B Testing Performance Report provides detailed mailing and response data that are generated by a single A/B test. You can run the report at any time before or after the system declares a test winner and completes the mailing.

The report lists results for each test split, including the number of messages that were sent and received. The report also lists results for unique views, clicks, and complaints regardless of which criteria is configured as the criterion for determining the winning email. If you view the report before the system declares a winner, the report indicates that the winner is pending and does not indicate which criteria is selected as the winning criteria.

The report displays results for one mailing at a time. You cannot display results for multiple mailings in a single A/B Test Performance Report.

The A/B test provides a test score to illustrate the relative effectiveness of each split to satisfy the evaluation criterion that is specified for the test. The higher the score, the better the version satisfied the evaluation criterion that is used to determine the test winner. The winning version always scores 100. You can use all of the test scores to learn more about audience preferences and improve email designs for future mailings.

Because the A/B Testing Performance Report is based on recipient responses, the report data can change over time as more recipients respond to the messages sent during the A/B test. Allow email recipients enough time to respond and for the system to determine the winning split.

The system continues to accept and record email responses after the winner is declared and the mailing is complete. You can view the additional results by running the A/B Test Performance report again at any time after the mailing completes.

You can also run the Detailed Link and Detailed Link by Cell reports for more link click and view data for the email messages that were sent during the A/B test.