Pattern #113: More Or Fewer Plans

Pattern #113  Tested 5 timesFirst tested by Stanley Zuo Recently tested by Michal Fiech on Nov 17, 2023

Based on 5 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
More Or Fewer Plans (Variant A) More Or Fewer Plans (Variant B)

Expected Median Effects Of B

?

Progression

(2 tests)

-

Leads

?

Signups

(1 tests)

-

Engagement

?

Sales

(4 tests)

?

Revenue

(3 tests)

-

Retention

-

Referrals

?

ANY PRIMARY

(5 tests)

Tested on

Tests

Pattern #113: More Or Fewer Plans
Was Tested On Chaos.com by Velin Penev

Replaced

Isolated

Test # 394 on Chaos.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Velin Penev    Jan 29, 2022 Test link

Find Out How It Did With 23,261 Visitors

  • Measured by clicks on any plan

  • Measured by total sales of any plan

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

In this experiment, a two plan pricing plan (standalone product with a higher collection set) was tested against a single plan one (only a collection set). Impact on clicks and total sales was measured.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Removed

Isolated

Test # 504 on Volders.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Michal Fiech    Nov 17, 2023 Test link

Find Out How It Did

  • Measured by completed orders

  • Measured by total revenue

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Pricing

In this experiment, the cheapest pricing plan was removed from a set of 2 options. This only left the most expensive pricing plan as the option. Impact on sales and revenue was measured.

Get Access To See The Test Results

Replaced

Confounded

Test # 357 on Baremetrics.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Brian Sierakowski    Jun 02, 2021 Test link

Find Out How It Did With 4,947 Visitors

  • Measured by signup page visits

  • Measured by total signups

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Pricing

In this experiment, a single focus signup was transformed into a pricing comparison table. Impact on signups was measured.

Get Access To See The Test Results

Added

Isolated

Test # 319 on Backstage.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Stanley Zuo    Sep 30, 2020 Test link

Find Out How It Did With 11,005 Visitors

  • Measured by any completed checkouts

  • Measured by total revenue

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Pricing

In this experiment, a 3 plan vs 2 plan pricing page was shown to potential customers. Impact on sales and revenue were measured.

Get Access To See The Test Results

Replaced

Isolated

Test # 272 on Backstage.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Stanley Zuo    Dec 03, 2019 Test link

Find Out How It Did

  • Measured by total checkouts

  • Measured by total revenue

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Pricing

In this experiment, the three pricing plans were condensed into a single recommended plan (annual), with a secondary option to choose the monthly plan.

Get Access To See The Test Results

Leaks

Leak #35 from Netflix.com   |   Dec 2, 2019 Pricing

Netflix A/B Tests A Single Plan Recommendation And It Becomes Rejected

A - Nov 18, 2019
B - Nov 18, 2019 REJECTED

Netflix made a bold move and challenged their traditional 3 plan pricing page with a preselected single plan recommendation. Clear and equally balanced choice vs. a single mid tier plan.  View Leak

-0.5 Evidence

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.