Pattern #20: Canned Response

Pattern #20  Tested 11 timesFirst tested by Mark Freedle Recently tested by Ardit Veliu on Sep 30, 2022

Based on 11 Tests, Members See How Likely Version B Wins Or Loses And By How Much

LOSSES
-5
-4
-3
-2
-1
FLAT
+1
+2
+3
+4
+5
WINS

Measured by the sum of negative and positive tests.

A B
Canned Response (Variant A) Canned Response (Variant B)

Expected Median Effects Of B

?

Progression

(3 tests)

?

Leads

(9 tests)

-

Signups

-

Engagement

?

Sales

(2 tests)

-

Revenue

-

Retention

-

Referrals

?

ANY PRIMARY

(11 tests)

Tested on

Tests

Pattern #20: Canned Response
Was Tested On Expertinstitute.com by Ardit Veliu

Replaced

Isolated

Test # 409 on Expertinstitute.... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Ardit Veliu    Apr 30, 2022 Test link

Find Out How It Did With 2,831 Visitors

  • Measured by completed forms

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

In this experiment, the copy of an input textarea on a lead form was used to summarize a user's choices. Instead of showing using a generic "Message" statement, the variation use the following formula: "I'm a [Lead Type] located in [State] looking for [Expert Type]. Looking forward to hearing from you today. Thank You." Impact of leads was measured.

Get Access To See The Test Results

The Same Pattern Was Also Tested Here

Added

Isolated

Test # 433 on Expertinstitute.... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Ardit Veliu    Sep 30, 2022 Test link

Find Out How It Did With 14,490 Visitors

  • Measured by form submissions

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

In this experiment a dynamic canned response was added to a lead form. The contents of the copy reflected a handful of user choices from other form field selections. Impact on leads / form submissions was measured.

Get Access To See The Test Results

Added

Isolated

Test # 249 on Autoscout24.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Optimizely    Jul 17, 2019 Test link

Find Out How It Did

  • Measured by successful form completions

Zoom In
A
B
Product

AutoScout24 is Europe’s largest online marketplace for new and used cars. As published by Optimizely, they tested a form pre-filled with text that read: ‘Hello. I am interested in your vehicle. Please contact me. Kind regards.’ 

Get Access To See The Test Results

Replaced

Isolated

Test # 248 on Volders.de by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Alexander Krieger    Jul 16, 2019 Test link

Find Out How It Did With 13,878 Visitors

  • Measured by total contract cancellations

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

In this experiment, an editable contract cancellation letter was tested against a non-editable one. The editable letter first appeared in a text state, which required a click on a link in order for it to be transformed into an editable textarea field.

Get Access To See The Test Results

Added

Isolated

Test # 231 on Glass.net by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Mark Freedle    Mar 14, 2019 Test link

Find Out How It Did With 1,342 Visitors

  • Measured by form submit to next step (validation)

  • Measured by total form leads

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Replaced

Isolated

Test # 147 on Reverb.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Nicholas Evans    Jan 25, 2018 Test link

Find Out How It Did With 40,229 Visitors

  • Measured by offers started

  • Measured by sales from offers & direct buys

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

Added

Isolated

Test # 128 on Acousticalsurfac... by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Nina Bayatti    Dec 02, 2017 Test link

Find Out How It Did With 2,951 Visitors

  • Measured by successful form submissions

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Added

Isolated

Test # 100 on Vivareal.com.br by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rodrigo Maués    Aug 01, 2017 Test link

Find Out How It Did With 203,704 Visitors

  • Measured by form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

Added

Isolated

Test # 112 on Glass.net by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Mark Freedle    Jul 14, 2017 Test link

Find Out How It Did With 13,197 Visitors

  • Measured by visits to next screen

  • Measured by visits to thank you page

Zoom In
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Added

Isolated

Test # 109 on 3dhubs.com by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rob Draaijer    Jun 01, 2017 Test link

Find Out How It Did With 4,005 Visitors

  • Measured by placed quotes

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Signup

Get Access To See The Test Results

Removed

Isolated

Test # 85 on Vivareal.com.br by $conducted_test->test->user_->first_name . ' ' . $conducted_test->test->user_->last_name Rodrigo Maués    Mar 01, 2017 Test link

Find Out How It Did With 102,331 Visitors

  • Measured by lead form submits

Zoom In
  • ?% (? successes out of ? visits)
A
  • ?% (? successes out of ? visits)
B
Product

Get Access To See The Test Results

For each pattern, we measure three key data points derived from related tests:

REPEATABILITY - this is a measure of how often a given pattern has generated a positive or negative effect. The higher this number, the more likely the pattern will continue to repeat.

SHALLOW MEDIAN - this is a median effect measured with low intent actions such as initiating the first step of a lengthier process

DEEP MEDIAN - this is derived from the highest intent metrics that we have for a given test such as fully completed signups or sales.