Pattern #124: Confirmed Selection

Pattern #124  Tested 4 timesFirst tested by Stanley Zuo Recently tested by Aleksandr Elesev on Jul 17, 2023

Based on 4 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Confirmed Selection (Variant A) Confirmed Selection (Variant B)

Expected Median Effects Of B

?

Progression

(2 tests)

-

Leads

?

Signups

(1 tests)

-

Engagement

?

Sales

(3 tests)

?

Revenue

(1 tests)

-

Retention

-

Referrals

?

ANY PRIMARY

(4 tests)

Tested on

Tests

Pattern #124: Confirmed Selection
Was Tested On Backstage.com by Stanley Zuo

Added

Isolated

Test # 367 on Backstage.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Stanley Zuo    Jul 22, 2021 Test link

Find Out How It Did With 29,480 Visitors

  • Measured by any plan selections

  • Measured by any plan purchase

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Signup

In this experiment, a confiming text was added at the top of a signup modal. The text reinforced the selection from a previous listing page, giving a good reason for continuing the signup process.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 483 on Menufy.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Aleksandr Elesev    Jul 17, 2023 Test link

Find Out How It Did With 8,626 Visitors

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Checkout

In this experiment, a thanking confirmation message was appended at the top of the checkout screen of a local food delivery service. Impact on completed transactions was measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 482 by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Jakub Linowski    Jul 13, 2023 Test link

Find Out How It Did With 3,379 Visitors

  • Measured by visits to checkout

  • Measured by completed sales

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Checkout

In this experiment, the choice of adding a product to cart was confirmed with a further positive message in the header of the next step (on the add to cart page). Once users left the product detail page, instead of simply stating the product name, the title was rephrased as "Product [X] Makes a Great Gift. They'll Love It!". I view this as a higher "intensity" experiment, given that the add-to-cart page was in some way already confirming the choice. Impact on sales was measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 396 on Depositphotos.co... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Gleb Hodorovskiy    Feb 13, 2022 Test link

Find Out How It Did With 801,039 Visitors

  • Measured by completed registrations

  • Measured by average revenue per user

Zoom In
A
B
Listing

In this experiment from Conversionrate.store, the framing of the registration message was changed from a generic account creation one to a specific image selected by the user. The experiment started on a listing page of a stock photography / illustration site. The control showed a more generic message with benefits for signing up and making the purchase. Whereas the variation repeated the actual image that customers clicked on from listing pages - establishing continuity as well as providing a reason for signing up. Impact on sales was measured.

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.