{"id":33099,"date":"2025-04-14T10:00:00","date_gmt":"2025-04-14T10:00:00","guid":{"rendered":"https:\/\/doc.probance.com\/?post_type=tutoriels&#038;p=33099"},"modified":"2025-11-11T06:28:39","modified_gmt":"2025-11-11T06:28:39","slug":"run-a-simple-ab-testing-on-an-email-campaign","status":"publish","type":"tutoriels","link":"https:\/\/doc.probance.com\/en\/knowledge-base\/run-a-simple-ab-testing-on-an-email-campaign\/","title":{"rendered":"Run a simple A\/B testing on an email campaign"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><strong>Probance One lets you set up A\/B tests quickly and easily.<\/strong><br>You can create up to four versions of an automated campaign or newsletter to test different elements, such as the template, content personalization, sending time, subject line, or sender name. These A\/B tests can be either simple or optimized.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A <strong>simple A\/B test<\/strong> does <strong>not<\/strong> automatically select the best-performing version:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li><strong>For an automated campaign<\/strong>, you can monitor the test results and manually stop the test to select the version you want to keep.<\/li>\n\n\n\n<li><strong>For a newsletter<\/strong>, all tested versions are sent to the full audience with no automatic selection.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">This tutorial explains how to create a <strong>simple A\/B test<\/strong> for an automated campaign or a newsletter.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">1. Before you begin<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Here are some things to know and consider before creating your A\/B test:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A\/B tests are set up on existing campaigns and newsletters.<\/li>\n\n\n\n<li>When creating an A\/B test, the versions are generated based on all the elements of the original campaign.<\/li>\n\n\n\n<li>If the A\/B test is created from an empty campaign, you&#8217;ll need to configure each version manually. To save time, we recommend creating the A\/B test after setting up the common elements of the campaign.<\/li>\n\n\n\n<li>The <strong>Custom sending time<\/strong> option is not available for campaigns using A\/B testing. Conversely, if that option is enabled, you won&#8217;t be able to add an A\/B test to the campaign.<\/li>\n\n\n\n<li>You cannot create an A\/B test on follow-ups, or on campaigns that include follow-ups.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">2. Creating an A\/B test<\/h2>\n\n\n\n<ol class=\"wp-block-list\">\n<li>On your campaign configuration page, scroll down to the <strong>A\/B test<\/strong> block and click <strong>Create<\/strong>.<\/li>\n\n\n\n<li>Once the block is updated, click <strong>Edit<\/strong>.<\/li>\n\n\n\n<li>Check the <strong>Simple<\/strong> option.<\/li>\n\n\n\n<li>In the <strong>Number of versions<\/strong> dropdown, select your test configuration. For example, to create 3 versions, select <strong>A\/B\/C<\/strong>.<\/li>\n\n\n\n<li>Click <strong>Save<\/strong> to confirm.<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">3. Defining the variations<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">The <strong>Change<\/strong> section lets you define your variations by modifying the element(s) you want to test in each version. You can change the template, subject line, personalized offer, and sending time.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To create a variation, follow these steps:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Open the tab corresponding to the element you want to test.<\/li>\n\n\n\n<li>Each tab allows you to configure each test version individually: click <strong>Edit<\/strong> under <em>Campaign A<\/em> to modify version A.<\/li>\n\n\n\n<li>Enter the test parameters in the relevant fields, then click <strong>Save<\/strong> to confirm.<\/li>\n\n\n\n<li>Repeat these steps for each version of your A\/B test.<\/li>\n<\/ol>\n\n\n\n<blockquote class=\"wp-block-quote is-style-note is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>Tip:<\/strong> To get reliable conclusions from an A\/B test, it\u2019s best to vary only one element at a time. See our guide on A\/B testing best practices to make the most of this feature.<\/p>\n<\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">4. Testing your versions<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">We highly recommend testing each version before activating your A\/B test, to check the content and display across all configurations.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Go to the <strong>Template<\/strong> tab.<\/li>\n\n\n\n<li>To test version A, click <strong>Send a test<\/strong> below the <em>Campaign A<\/em> preview.<\/li>\n\n\n\n<li>In the <strong>Recipient list<\/strong> field, enter the email addresses for the test (one per line).<\/li>\n\n\n\n<li><strong>Customize the test (if needed):<\/strong>\n<ul class=\"wp-block-list\">\n<li>If the template or subject includes personalization fields, use the <strong>Profile personalization<\/strong> section to define values.<\/li>\n\n\n\n<li>If the email includes offers, set the number of offers and the selection mode to test different display configurations.<\/li>\n\n\n\n<li>To replicate real sending conditions, enable the <strong>Restrict to campaign filters<\/strong> option. This applies the filters defined in the Personalized Offer section of the tested version.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Click <strong>Send<\/strong> to send the test email.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Repeat this process for each version of your A\/B test.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">5. Adding notes to your A\/B test<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">You can add notes to your A\/B test to track changes and describe the tested variations.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the A\/B test configuration block, click <strong>Notes<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Enter your notes and click <strong>Save and close<\/strong> to confirm.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These notes can be edited at any time, even while the A\/B test is running or after it has ended.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">6. Starting the sends<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">6.1. For an automated campaign<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">To start your A\/B test sends, simply <strong>activate the campaign<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Each recipient will randomly receive one of the test versions, until you decide to stop the test.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-style-note is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>Note:<\/strong> You can stop the A\/B test at any time by deactivating the campaign.<\/p>\n<\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">6.2. For a newsletter<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>In the <strong>Timing<\/strong> section, click <strong>Edit<\/strong>.<\/li>\n\n\n\n<li>Enter the desired <strong>Date<\/strong> and <strong>Time<\/strong> for sending.<\/li>\n\n\n\n<li>Click <strong>Save<\/strong> to confirm.<\/li>\n\n\n\n<li>Then, switch your newsletter to <strong>Active<\/strong> status.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Your A\/B test will be sent at the defined time. Each recipient will randomly receive one of the test versions.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">7. Viewing the results<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">You can monitor the results of your A\/B test by clicking the <strong>Performance<\/strong> icon in the campaign details.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You can also access it via the <strong>Performance &gt; A\/B Tests<\/strong> menu and find your campaign in the list.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By default, the A\/B test performance page shows the overall campaign results. You can view each version\u2019s detailed results by selecting it in the carousel.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\">8. Stopping the test and selecting the best version<\/h3>\n\n\n\n<blockquote class=\"wp-block-quote is-style-note-probance is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">This step only applies to <strong>automated campaigns<\/strong>.<\/p>\n<\/blockquote>\n\n\n\n<p class=\"wp-block-paragraph\">To stop your A\/B test, follow these steps:<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>On your campaign configuration page, go to the <strong>A\/B test<\/strong> block and click <strong>Delete<\/strong>.<\/li>\n\n\n\n<li>Select the version you want to keep.<\/li>\n\n\n\n<li>Click <strong>Apply<\/strong>.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">The A\/B test will be removed from the campaign, which will now use the selected version\u2019s template, subject, and personalized offer.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The test results will remain available in the <strong>Performance &gt; A\/B Tests<\/strong> menu.<\/p>\n<div id=\"wpmem_restricted_msg\"><p>This content is restricted to site members.  If you are an existing user, please log in.  New users may register below.<\/p><\/div><div id=\"wpmem_login\"><a id=\"login\"><\/a><form action=\"https:\/\/doc.probance.com\/en\/knowledge-base\/run-a-simple-ab-testing-on-an-email-campaign\/\" method=\"POST\" id=\"wpmem_login_form\" class=\"form\"><input type=\"hidden\" id=\"_wpmem_login_nonce\" name=\"_wpmem_login_nonce\" value=\"af0e76e092\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/en\/wp-json\/wp\/v2\/tutoriels\/33099\" \/><fieldset><legend>Existing Users Log In<\/legend><label for=\"log\">Username or Email<\/label><div class=\"div_text\"><input name=\"log\" type=\"text\" id=\"log\" value=\"\" class=\"username\" required  \/><\/div><label for=\"pwd\">Password<\/label><div class=\"div_text\"><input name=\"pwd\" type=\"password\" id=\"pwd\" class=\"password\" required  \/><\/div><input name=\"a\" type=\"hidden\" value=\"login\" \/><input name=\"redirect_to\" type=\"hidden\" value=\"https:\/\/doc.probance.com\/en\/knowledge-base\/run-a-simple-ab-testing-on-an-email-campaign\/\" \/><div class=\"button_div\"><input name=\"rememberme\" type=\"checkbox\" id=\"rememberme\" value=\"forever\" \/>&nbsp;<label for=\"rememberme\">Remember Me<\/label>&nbsp;&nbsp;<input type=\"submit\" name=\"Submit\" value=\"Log In\" class=\"buttons\" \/><\/div><\/fieldset><\/form><\/div><div id=\"wpmem_reg\"><a id=\"register\"><\/a><form name=\"form\" method=\"post\" action=\"https:\/\/doc.probance.com\/en\/knowledge-base\/run-a-simple-ab-testing-on-an-email-campaign\/\" id=\"wpmem_register_form\" class=\"form\"><input type=\"hidden\" id=\"_wpmem_register_nonce\" name=\"_wpmem_register_nonce\" value=\"35f8bfaf05\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/en\/wp-json\/wp\/v2\/tutoriels\/33099\" \/><fieldset><legend>New User Registration<\/legend><label for=\"username\" class=\"text\">Choose a Username<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"username\" type=\"text\" id=\"username\" value=\"\" class=\"textbox\" required  \/><\/div><label for=\"first_name\" class=\"text\">First Name<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"first_name\" type=\"text\" id=\"first_name\" value=\"\" class=\"textbox\" required  \/><\/div><label for=\"last_name\" class=\"text\">Last Name<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"last_name\" type=\"text\" id=\"last_name\" value=\"\" class=\"textbox\" required  \/><\/div><label for=\"user_email\" class=\"text\">Email<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"user_email\" type=\"email\" id=\"user_email\" value=\"\" class=\"textbox\" required  \/><\/div><input name=\"a\" type=\"hidden\" value=\"register\" \/><input name=\"wpmem_reg_page\" type=\"hidden\" value=\"https:\/\/doc.probance.com\/en\/knowledge-base\/run-a-simple-ab-testing-on-an-email-campaign\/\" \/><div class=\"button_div\"><input name=\"submit\" type=\"submit\" value=\"Register\" class=\"buttons\" \/><\/div><div class=\"req-text\"><span class=\"req\">*<\/span>Required field<\/div><\/fieldset><\/form><\/div>","protected":false},"excerpt":{"rendered":"<p>Probance One lets you set up A\/B tests quickly and easily.You can create up to four versions of an automated campaign or newsletter to test different elements, such as the template, content personalization, sending time, subject line, or sender name. These A\/B tests can be either simple or optimized. A simple A\/B test does not [&hellip;]<\/p>\n","protected":false},"author":6,"featured_media":0,"template":"","sujets":[635],"class_list":["post-33099","tutoriels","type-tutoriels","status-publish","hentry","sujets-email-channel"],"_links":{"self":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/tutoriels\/33099","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/tutoriels"}],"about":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/types\/tutoriels"}],"author":[{"embeddable":true,"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/users\/6"}],"wp:attachment":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/media?parent=33099"}],"wp:term":[{"taxonomy":"sujets","embeddable":true,"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/sujets?post=33099"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}