All Latest 534 A/B Tests

In this experiment, as a multi-step sign up funnel launched as a modal, there was a different treatment of the background. In the A version the background was a flat color, whereas in the B version the background used a transparent opacity to show through the landing page underneath. Impact on sign ups was measured.

In this 4 step signup funnel experiment, social proof and customer reviews were appended at the bottom of the screen. Impact on conversions was measured.

In this signup flow experiment, form fields on the right hand side (control) were shifted to the left column (variation). Impact on account creations and checkouts was measured.

In this experiment, new paywall copy and messaging was used to encourage more users to signup and pay for access to a mental health app. The variation reinforced that users would be receiving a full featured application, with reminders about the upcoming billing. It reinforced that users will have a full week to decide and potentially cancel their application. Impact on lagging +7 day later transactions was measured.

In this experiment, a progress bar was added to a signup flow of a mental health app. It appeared on numerous steps of a onboarding flow. Impact on signup completions and checkouts was measured.

In this experiment two sections of a form on a single page (control) were broken out into 2 separate steps (variation). The two sections included personal details and shipping information. This step appeared after having received a product recommendation when filling out a questionnaire for a skin care product. Impact on next step progression and purchases was measured.

This experiment was a retest of a previously tested test 491. Simiarly, a photo of the real doctor behind a skin care product was shown throughout a signup / questionnaire flow in the variation. 

In this experiment, a photo of the real doctor behind a skin care product was shown throughout a signup / questionnaire flow. In the control version, the photo with introduction was only shown on the first screen. In the variation, the photo appeared on the first and all other screens - reinforcing expertise, authority and the idea of a consultation. Impact on signups and purchases was measured.

In this experiment, a password field was removed from a signup / account creation step. Instead of asking for a password, users received an email with an auto-generated password. This experiment ran on mobile and impact on sales (post-signup) was measured.

In this experiment, a right side form shifted in position to the left. Impact on leads was measured.

In this experiment, a social proof popups were added to the signup / funnel pages for a contract cancellation service. The added social testimonials appeared as other customers used the service, anywhere except on the final checkout page. Additionaly, the interval at which these messaged appeared was 60 seconds, and they were shown for 10s. The messages translated to "[Name] had recently canncelled a contract with [Company], in the last 38 minutes". Impact on sales was measured.

In this experiment, a more difficult step of a contract cancelation service flow was rearranged toward a later step. In the variation, the easier step (hypothetically) with personal details and address fields was placed as the first step. Whereas the step with contract or account numbers (hypothetically more difficult) were placed as the second step.

In this experiment, the call to action or button was raised above the legal text to be visible right away without scrolling. Additionally a error message was added for users that did not activate the checkbox to remind them that this is mandatory. Impact on signups and eventual follow-through to purchases (3 steps later) was measured.

In this experiment a dynamic canned response was added to a lead form. The contents of the copy reflected a handful of user choices from other form field selections. Impact on leads / form submissions was measured.

In this experiment, an upsell modal appeared during a signup funnel. In the variation, if users did not select a monthly plan, they were nudged to an annual one. Impact on overall and annual signups was measured.

In this test 1) a passive hint communicated to users that their data will be saved for 7 days for them to be able to continue their cancellation later and 2) dropped off users were targeted with an email campaign within the first 4 hours after drop off. The reminder email linked users to a shipping page (checkout page) without them requiring to fill out their personal, contract information one more time. 

CXL ran an interesting experiment that (1) added more specificity on a newsletter subscription page as well as (2) reinforced it consistently. Most visibly, an abstract or vague headline statement (control) was changed to a benefit oriented one - hinting that subscribers will eventually receive valuable case studies. This message was further reinforced with supporting copy that explained where these case studies are obtained from along with the frequency of the delivery. This same message was also reinforced with an image of actual case studies. The call to action button was also adjusted to mimic the benefit.

Impact on newsletter signups was measured.

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

In this experiment, the annual plan was preselected instead of starting off unselected in the control. Impact on two metrics was measured: any plan and annual plan purchases.

In this experiment, the button width was extended to the full width of the form above. Impact on leads was measured.