{"id":37682,"date":"2026-04-17T08:00:00","date_gmt":"2026-04-17T08:00:00","guid":{"rendered":"https:\/\/doc.probance.com\/?post_type=tutoriels&#038;p=37682"},"modified":"2026-05-20T05:21:09","modified_gmt":"2026-05-20T05:21:09","slug":"create-an-optimized-a-b-test-on-an-sms-campaign","status":"publish","type":"tutoriels","link":"https:\/\/doc.probance.com\/en\/knowledge-base\/create-an-optimized-a-b-test-on-an-sms-campaign\/","title":{"rendered":"Create an optimized A\/B test on an SMS campaign"},"content":{"rendered":"\n<p class=\"wp-block-paragraph\"><em><em>Probance One allows you to set up A\/B tests quickly and easily. You can create up to four versions of an SMS to test different elements, such as message content, personalized offers, send time, or sender name. These A\/B tests can be <strong>simple<\/strong> or <strong>optimized<\/strong>.<\/em><\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>An optimized A\/B test is <strong>fully automated<\/strong>: several variants of the same campaign are sent over a defined period \u2014 a few hours for an ad-hoc campaign, several days or weeks for an automated campaign. At the end of this period, P-ONE automatically selects the best-performing version, which is then sent to the rest of the target audience and to all future campaign recipients.<\/em><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><em>This tutorial explains how to create an optimized A\/B test for an SMS campaign.<\/em><\/p>\n\n\n\n<h2 class=\"wp-block-heading\">1. Before you begin<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Here is some information to know and consider before creating your A\/B test.<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>A\/B tests are configured on existing campaigns.<\/li>\n\n\n\n<li>When creating an A\/B test, versions are generated by copying all elements from the base campaign.<\/li>\n\n\n\n<li>If the A\/B test is created from a blank campaign, you will need to manually configure each element for each version. To save time, it is recommended to set up the A\/B test after defining the elements common to all versions of the campaign.<\/li>\n\n\n\n<li>You cannot create an A\/B test on resends or on campaigns with resends.<\/li>\n<\/ul>\n\n\n\n<h2 class=\"wp-block-heading\">2. Create an A\/B test<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">2.1. For an automated campaign<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>On your campaign configuration page, go to the <strong>A\/B test<\/strong> block (at the bottom of the page) and click <strong>Create<\/strong>.<\/li>\n\n\n\n<li>Once the block has been updated, click <strong>Edit<\/strong>.<\/li>\n\n\n\n<li>Check the <strong>Optimized<\/strong> option.<\/li>\n\n\n\n<li>In the <strong>Number of versions<\/strong> dropdown list, select your A\/B test configuration. For example, to define 3 versions, select A\/B\/C.<\/li>\n\n\n\n<li>In <strong>Best version sent<\/strong>, select the deadline for selecting the best-performing version, after which the A\/B test will end. Two options are available:\n<ul class=\"wp-block-list\">\n<li><strong>As soon as possible<\/strong>: the best-performing version will be automatically selected by PONE once enough data has been collected for the results to be considered conclusive.<\/li>\n\n\n\n<li><strong>No later than<\/strong>: the best-performing version will be automatically selected by PONE no later than the date you specify.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Click <strong>Save<\/strong> to confirm.<\/li>\n<\/ol>\n\n\n\n<h3 class=\"wp-block-heading\">2.2. For a newsletter<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>On your campaign configuration page, go to the <strong>A\/B test<\/strong> block (at the bottom of the page) and click <strong>Create<\/strong>.<\/li>\n\n\n\n<li>Once the block has been updated, click <strong>Edit<\/strong>.<\/li>\n\n\n\n<li>Check the <strong>Optimized<\/strong> option.<\/li>\n\n\n\n<li>In the <strong>Total test volume<\/strong> dropdown list, select what proportion of the target audience should receive the tested versions. Two options are available:\n<ul class=\"wp-block-list\">\n<li><strong>5% per test<\/strong> means that each version will be sent to 5% of the newsletter&#8217;s target audience (5% will receive version A, another 5% of the target will receive version B, and so on if there are more than two versions). The rest of the target audience will receive the best version, automatically selected by Probance One.<\/li>\n\n\n\n<li><strong>10% per test<\/strong> means that each tested version will be sent to 10% of the target audience (10% will receive version A, another 10% of the target will receive version B, and so on if there are more than two versions). The rest of the target audience will receive the best version, automatically selected by Probance One.<\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>In the <strong>Number of versions<\/strong> dropdown list, select your A\/B test configuration. For example, to define 3 versions, select A\/B\/C.<\/li>\n\n\n\n<li>In <strong>Best version sent<\/strong>, select the delay for sending the best-performing version to the remainder of the target audience. Two options are available:\n<ul class=\"wp-block-list\">\n<li><strong>As soon as possible<\/strong>: as soon as the best-performing version is determined (results analyzed two hours after the A\/B test is sent), it is sent to the rest of the target audience.<\/li>\n\n\n\n<li><strong>The next day at the same time<\/strong><\/li>\n<\/ul>\n<\/li>\n\n\n\n<li>Click <strong>Save<\/strong> to confirm.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">3. Define the variants<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The <strong>Change<\/strong> section allows you to define your variants by modifying the element(s) you want to test for each version. You can vary the <strong>template<\/strong>, the <strong>subject<\/strong>, the <strong>personalized offer<\/strong>, and the <strong>send time<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">To create a variant, follow these steps.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Open the tab corresponding to the characteristic you want to test.<\/li>\n\n\n\n<li>These tabs allow you to individually configure each test version: click <strong>Edit<\/strong> next to <strong>Campaign A<\/strong> to modify the content of version A.<\/li>\n\n\n\n<li>Enter the parameters to test in the corresponding fields, then click <strong>Save<\/strong> to confirm.<\/li>\n\n\n\n<li>Repeat these steps for each of the other versions of your A\/B test.<\/li>\n<\/ol>\n\n\n\n<blockquote class=\"wp-block-quote is-style-note-probance is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\">To draw reliable conclusions from an A\/B test, it is advisable to vary only one element at a time. Check out <a href=\"https:\/\/doc.probance.com\/pourquoi-realiser-un-a-b-test\/\">our dedicated guide to A\/B testing best practices<\/a> to optimize your use of the feature.<\/p>\n<\/blockquote>\n\n\n\n<h2 class=\"wp-block-heading\">4. Test the versions<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">We strongly recommend testing each version before activating your A\/B test, to verify the content of your SMS in all possible configurations.<\/p>\n\n\n\n<ol class=\"wp-block-list\">\n<li>Go to the <strong>Template<\/strong> tab.<\/li>\n\n\n\n<li>Test version A: To test version A, click the <strong>Send a test<\/strong> button located below the <strong>Campaign A<\/strong> preview.<\/li>\n\n\n\n<li>Add test recipients: in the <strong>Recipients list<\/strong> field, enter the phone numbers that will receive the test, separating them with a line break.<\/li>\n\n\n\n<li>Customize the test (if needed):\n<ul class=\"wp-block-list\">\n<li>If the message contains <strong>personalization fields<\/strong>, use the <strong>Profile personalization<\/strong> section to define the values to apply.<\/li>\n\n\n\n<li>If the message includes <strong>offers<\/strong>, define the <strong>number of offers<\/strong> to include and the <strong>selection mode<\/strong> to test different display configurations.<\/li>\n<\/ul>\n<\/li>\n<\/ol>\n\n\n\n<blockquote class=\"wp-block-quote is-style-note is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>Note:<\/strong> For a test that closely matches real send conditions, enable the <strong>Restrict to campaign filters<\/strong> option. This option applies the constraints defined in the <strong>Personalized offer<\/strong> section of the tested version for product selection.<\/p>\n<\/blockquote>\n\n\n\n<ol start=\"5\" class=\"wp-block-list\">\n<li>Send the test: click <strong>Send<\/strong> to dispatch the test SMS.<\/li>\n\n\n\n<li>Repeat these steps for each version of your A\/B test.<\/li>\n<\/ol>\n\n\n\n<h2 class=\"wp-block-heading\">5. Annotate the A\/B test<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">You can add notes to your A\/B test. This allows you to keep a written record of the changes made to your test and to describe the different variants tested.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In the A\/B test configuration block, click <strong>Notes<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Enter your notes and click <strong>Save and close<\/strong> to confirm.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">These notes can be modified at any time, including during the A\/B test execution and after it is completed.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">6. Start sending<\/h2>\n\n\n\n<h3 class=\"wp-block-heading\">6.1. For an automated campaign<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Once your variants are configured, you can activate your campaign to start sending.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Each campaign recipient will receive one of the tested versions, randomly selected, until P-ONE selects the best version.<\/p>\n\n\n\n<blockquote class=\"wp-block-quote is-style-note is-layout-flow wp-block-quote-is-layout-flow\">\n<p class=\"wp-block-paragraph\"><strong>Note:<\/strong> You can stop your A\/B test at any time by deactivating the campaign.<\/p>\n<\/blockquote>\n\n\n\n<h3 class=\"wp-block-heading\">6.2. For a newsletter<\/h3>\n\n\n\n<ol class=\"wp-block-list\">\n<li>In the <strong>Timing<\/strong> section, click Edit.<\/li>\n\n\n\n<li>Enter the desired <strong>Date<\/strong> and <strong>Send time<\/strong>.<\/li>\n\n\n\n<li>Click <strong>Save<\/strong> to confirm.<\/li>\n\n\n\n<li>Then set your newsletter to <strong>Active<\/strong> status.<\/li>\n<\/ol>\n\n\n\n<p class=\"wp-block-paragraph\">Your A\/B test will be sent at the defined timing.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">7. View the A\/B test results<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">If your A\/B test is still in progress, or is for a newsletter, you can view its results by clicking the <strong>Performance<\/strong> icon of the campaign.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If the A\/B test is completed, you can access it through the <strong>Performance &gt; A\/B tests<\/strong> menu, by searching for your campaign in the list.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">By default, the A\/B test performance page displays overall campaign results. You can view the detailed results of each version by selecting it in the carousel.<\/p>\n<div id=\"wpmem_restricted_msg\"><p>This content is restricted to site members.  If you are an existing user, please log in.  New users may register below.<\/p><\/div><div id=\"wpmem_login\"><a id=\"login\"><\/a><form action=\"https:\/\/doc.probance.com\/en\/knowledge-base\/create-an-optimized-a-b-test-on-an-sms-campaign\/\" method=\"POST\" id=\"wpmem_login_form\" class=\"form\"><input type=\"hidden\" id=\"_wpmem_login_nonce\" name=\"_wpmem_login_nonce\" value=\"af0e76e092\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/en\/wp-json\/wp\/v2\/tutoriels\/37682\" \/><fieldset><legend>Existing Users Log In<\/legend><label for=\"log\">Username or Email<\/label><div class=\"div_text\"><input name=\"log\" type=\"text\" id=\"log\" value=\"\" class=\"username\" required  \/><\/div><label for=\"pwd\">Password<\/label><div class=\"div_text\"><input name=\"pwd\" type=\"password\" id=\"pwd\" class=\"password\" required  \/><\/div><input name=\"a\" type=\"hidden\" value=\"login\" \/><input name=\"redirect_to\" type=\"hidden\" value=\"https:\/\/doc.probance.com\/en\/knowledge-base\/create-an-optimized-a-b-test-on-an-sms-campaign\/\" \/><div class=\"button_div\"><input name=\"rememberme\" type=\"checkbox\" id=\"rememberme\" value=\"forever\" \/>&nbsp;<label for=\"rememberme\">Remember Me<\/label>&nbsp;&nbsp;<input type=\"submit\" name=\"Submit\" value=\"Log In\" class=\"buttons\" \/><\/div><\/fieldset><\/form><\/div><div id=\"wpmem_reg\"><a id=\"register\"><\/a><form name=\"form\" method=\"post\" action=\"https:\/\/doc.probance.com\/en\/knowledge-base\/create-an-optimized-a-b-test-on-an-sms-campaign\/\" id=\"wpmem_register_form\" class=\"form\"><input type=\"hidden\" id=\"_wpmem_register_nonce\" name=\"_wpmem_register_nonce\" value=\"35f8bfaf05\" \/><input type=\"hidden\" name=\"_wp_http_referer\" value=\"\/en\/wp-json\/wp\/v2\/tutoriels\/37682\" \/><fieldset><legend>New User Registration<\/legend><label for=\"username\" class=\"text\">Choose a Username<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"username\" type=\"text\" id=\"username\" value=\"\" class=\"textbox\" required  \/><\/div><label for=\"first_name\" class=\"text\">First Name<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"first_name\" type=\"text\" id=\"first_name\" value=\"\" class=\"textbox\" required  \/><\/div><label for=\"last_name\" class=\"text\">Last Name<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"last_name\" type=\"text\" id=\"last_name\" value=\"\" class=\"textbox\" required  \/><\/div><label for=\"user_email\" class=\"text\">Email<span class=\"req\">*<\/span><\/label><div class=\"div_text\"><input name=\"user_email\" type=\"email\" id=\"user_email\" value=\"\" class=\"textbox\" required  \/><\/div><input name=\"a\" type=\"hidden\" value=\"register\" \/><input name=\"wpmem_reg_page\" type=\"hidden\" value=\"https:\/\/doc.probance.com\/en\/knowledge-base\/create-an-optimized-a-b-test-on-an-sms-campaign\/\" \/><div class=\"button_div\"><input name=\"submit\" type=\"submit\" value=\"Register\" class=\"buttons\" \/><\/div><div class=\"req-text\"><span class=\"req\">*<\/span>Required field<\/div><\/fieldset><\/form><\/div>","protected":false},"excerpt":{"rendered":"<p>Probance One allows you to set up A\/B tests quickly and easily. You can create up to four versions of an SMS to test different elements, such as message content, personalized offers, send time, or sender name. These A\/B tests can be simple or optimized. An optimized A\/B test is fully automated: several variants of [&hellip;]<\/p>\n","protected":false},"author":6,"featured_media":0,"template":"","sujets":[636],"class_list":["post-37682","tutoriels","type-tutoriels","status-publish","hentry","sujets-sms-channel"],"_links":{"self":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/tutoriels\/37682","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/tutoriels"}],"about":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/types\/tutoriels"}],"author":[{"embeddable":true,"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/users\/6"}],"wp:attachment":[{"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/media?parent=37682"}],"wp:term":[{"taxonomy":"sujets","embeddable":true,"href":"https:\/\/doc.probance.com\/en\/wp-json\/wp\/v2\/sujets?post=37682"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}