Pattern #25: Nagging Results

Pattern #25  Tested 3 timesFirst tested by Daniel Bridges Recently tested by Stanley Zuo on Feb 28, 2021

Based on 3 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Nagging Results (Variant A) Nagging Results (Variant B)

Expected Median Effects Of B

?

Progression

(1 tests)

-

Leads

?

Signups

(3 tests)

?

Engagement

(2 tests)

-

Sales

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(3 tests)

Tested on

Tests

Pattern #25: Nagging Results
Was Tested On Findsomeone.co.nz by Daniel Bridges

Replaced

Isolated

Test # 21 on Findsomeone.co.n... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Daniel Bridges    Jan 01, 2016 Test link

Find Out How It Did With 55,182 Visitors

  • Measured by visits to first step of signup process

  • Measured by visits to successful signups

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Listing

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Replaced

Isolated

Test # 342 on Backstage.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Stanley Zuo    Feb 28, 2021 Test link

Find Out How It Did With 7,934 Visitors

  • Measured by account registrations

  • Measured by posting a job

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Listing

In this experiment, a registration wall was added on a listing page of casting call profiles. The registration wall appeared after the first 9 listings or so and encouraged users to sign up. Impact on registrations was measured, along with an engagement metric of "posting a job".

Get Access To See The Test Results

Replaced

Isolated

Test # 295 on Thomasnet.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Julian Gaviria    Apr 29, 2020 Test link

Find Out How It Did With 131,642 Visitors

  • Measured by successful registrations

  • Measured by viewing company detail pages

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Content

In this experiment, blog article pages were hidden behind a registration wall - requing a signup to access. The registration wall would appear after the first paragraph using gradual opacity to cover the rest of the article. We have published the effects of this change on registrations (signups) and on engagement (users viewing other more important company detail pages).

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.